2026-02-23T04:32:00.496 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-23T04:32:00.496 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:32:00.567 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:32:00.758 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x725ab9784e00>, signals=[15]) 2026-02-23T04:32:00.758 INFO:teuthology.lock.ops:Start node 'trial027.front.sepia.ceph.com' reimaging 2026-02-23T04:32:00.758 INFO:teuthology.lock.ops:Updating [trial027.front.sepia.ceph.com]: reset os type and version on server 2026-02-23T04:32:00.758 INFO:teuthology.lock.ops:Updating trial027.front.sepia.ceph.com on lock server 2026-02-23T04:32:00.815 INFO:teuthology.lock.ops:Start node 'trial194.front.sepia.ceph.com' reimaging 2026-02-23T04:32:00.815 INFO:teuthology.lock.ops:Updating [trial194.front.sepia.ceph.com]: reset os type and version on server 2026-02-23T04:32:00.815 INFO:teuthology.lock.ops:Updating trial194.front.sepia.ceph.com on lock server 2026-02-23T04:32:01.043 DEBUG:teuthology.provision.fog.trial027:Requesting image trial_centos_9.stream (ID 3) 2026-02-23T04:32:01.052 DEBUG:teuthology.provision.fog.trial194:Requesting image trial_centos_9.stream (ID 3) 2026-02-23T04:32:01.094 INFO:teuthology.provision.fog.trial027:Scheduling deploy of centos 9.stream 2026-02-23T04:32:01.102 INFO:teuthology.provision.fog.trial194:Scheduling deploy of centos 9.stream 2026-02-23T04:32:02.605 INFO:teuthology.orchestra.console.trial194:Power off 2026-02-23T04:32:02.605 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T04:32:02.623 INFO:teuthology.orchestra.console.trial027:Power off 2026-02-23T04:32:02.623 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T04:32:02.642 DEBUG:teuthology.orchestra.console.trial194:power off output: Chassis Power Control: Down/Off 2026-02-23T04:32:02.659 DEBUG:teuthology.orchestra.console.trial027:power off output: Chassis Power Control: Down/Off 2026-02-23T04:32:06.647 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T04:32:06.659 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T04:32:06.756 DEBUG:teuthology.orchestra.console.trial194:check power output: Chassis Power is off 2026-02-23T04:32:06.757 INFO:teuthology.orchestra.console.trial194:Power off completed 2026-02-23T04:32:06.766 DEBUG:teuthology.orchestra.console.trial027:check power output: Chassis Power is off 2026-02-23T04:32:06.767 INFO:teuthology.orchestra.console.trial027:Power off completed 2026-02-23T04:32:06.857 INFO:teuthology.orchestra.console.trial194:Power on 2026-02-23T04:32:06.858 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-23T04:32:06.867 INFO:teuthology.orchestra.console.trial027:Power on 2026-02-23T04:32:06.868 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-23T04:32:06.897 DEBUG:teuthology.orchestra.console.trial194:power on output: Chassis Power Control: Up/On 2026-02-23T04:32:06.910 DEBUG:teuthology.orchestra.console.trial027:power on output: Chassis Power Control: Up/On 2026-02-23T04:32:10.901 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T04:32:10.911 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T04:32:11.011 DEBUG:teuthology.orchestra.console.trial194:check power output: Chassis Power is on 2026-02-23T04:32:11.012 INFO:teuthology.orchestra.console.trial194:Power on completed 2026-02-23T04:32:11.021 DEBUG:teuthology.orchestra.console.trial027:check power output: Chassis Power is on 2026-02-23T04:32:11.021 INFO:teuthology.orchestra.console.trial027:Power on completed 2026-02-23T04:32:11.113 INFO:teuthology.provision.fog.trial194:Waiting for deploy to finish 2026-02-23T04:32:11.121 INFO:teuthology.provision.fog.trial027:Waiting for deploy to finish 2026-02-23T04:33:59.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T04:33:59.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T04:33:59.336 ERROR:teuthology.orchestra.connection:Error authenticating with trial194.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2026-02-23T04:34:59.156 WARNING:teuthology.provision.fog.trial027:timed out 2026-02-23T04:35:03.339 WARNING:teuthology.provision.fog.trial194:timed out 2026-02-23T04:35:05.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T04:35:09.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T04:35:12.452 ERROR:teuthology.orchestra.connection:Error authenticating with trial027.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-23T04:35:13.603 ERROR:teuthology.orchestra.connection:Error authenticating with trial194.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-23T04:35:16.613 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-23T04:35:16.613 DEBUG:teuthology.orchestra.run.trial027:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-23T04:35:17.729 ERROR:teuthology.orchestra.connection:Error authenticating with trial194.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-23T04:35:21.830 INFO:teuthology.provision.fog.trial027:Node is ready 2026-02-23T04:35:21.830 DEBUG:teuthology.orchestra.run.trial027:> hostname 2026-02-23T04:35:21.879 INFO:teuthology.orchestra.run.trial027.stdout:trial027.front.sepia.ceph.com 2026-02-23T04:35:21.880 DEBUG:teuthology.orchestra.run.trial027:> grep trial027.front.sepia.ceph.com /etc/hosts 2026-02-23T04:35:21.934 INFO:teuthology.orchestra.run.trial027.stdout:10.20.193.27 trial027.front.sepia.ceph.com trial027 2026-02-23T04:35:21.935 DEBUG:teuthology.orchestra.run.trial027:> sudo hostname trial027 2026-02-23T04:35:22.016 DEBUG:teuthology.orchestra.run.trial027:> sudo sed -i -e 's/trial027.front.sepia.ceph.com/trial027/g' /etc/hosts 2026-02-23T04:35:22.043 DEBUG:teuthology.orchestra.run.trial027:> sudo sed -i -e 's/10.20.193.27/10.20.193.27/g' /etc/hosts 2026-02-23T04:35:22.108 DEBUG:teuthology.orchestra.run.trial027:> sudo sed -i -e 's/trial027.front.sepia.ceph.com/trial027/g' /etc/hostname 2026-02-23T04:35:22.176 DEBUG:teuthology.orchestra.run.trial027:> sudo hostname trial027 2026-02-23T04:35:22.242 DEBUG:teuthology.orchestra.run.trial027:> cat /etc/os-release 2026-02-23T04:35:22.298 INFO:teuthology.orchestra.run.trial027.stdout:NAME="CentOS Stream" 2026-02-23T04:35:22.298 INFO:teuthology.orchestra.run.trial027.stdout:VERSION="9" 2026-02-23T04:35:22.299 INFO:teuthology.orchestra.run.trial027.stdout:ID="centos" 2026-02-23T04:35:22.299 INFO:teuthology.orchestra.run.trial027.stdout:ID_LIKE="rhel fedora" 2026-02-23T04:35:22.299 INFO:teuthology.orchestra.run.trial027.stdout:VERSION_ID="9" 2026-02-23T04:35:22.299 INFO:teuthology.orchestra.run.trial027.stdout:PLATFORM_ID="platform:el9" 2026-02-23T04:35:22.299 INFO:teuthology.orchestra.run.trial027.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T04:35:22.299 INFO:teuthology.orchestra.run.trial027.stdout:ANSI_COLOR="0;31" 2026-02-23T04:35:22.299 INFO:teuthology.orchestra.run.trial027.stdout:LOGO="fedora-logo-icon" 2026-02-23T04:35:22.299 INFO:teuthology.orchestra.run.trial027.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T04:35:22.299 INFO:teuthology.orchestra.run.trial027.stdout:HOME_URL="https://centos.org/" 2026-02-23T04:35:22.299 INFO:teuthology.orchestra.run.trial027.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T04:35:22.299 INFO:teuthology.orchestra.run.trial027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T04:35:22.299 INFO:teuthology.orchestra.run.trial027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T04:35:22.300 INFO:teuthology.provision.fog.trial027:Deploy complete! 2026-02-23T04:35:22.301 DEBUG:teuthology.parallel:result is None 2026-02-23T04:35:24.805 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-23T04:35:24.805 DEBUG:teuthology.orchestra.run.trial194:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-23T04:35:24.964 INFO:teuthology.provision.fog.trial194:Node is ready 2026-02-23T04:35:24.965 DEBUG:teuthology.orchestra.run.trial194:> hostname 2026-02-23T04:35:25.019 INFO:teuthology.orchestra.run.trial194.stdout:trial194.front.sepia.ceph.com 2026-02-23T04:35:25.019 DEBUG:teuthology.orchestra.run.trial194:> grep trial194.front.sepia.ceph.com /etc/hosts 2026-02-23T04:35:25.074 INFO:teuthology.orchestra.run.trial194.stdout:10.20.193.194 trial194.front.sepia.ceph.com trial194 2026-02-23T04:35:25.075 DEBUG:teuthology.orchestra.run.trial194:> sudo hostname trial194 2026-02-23T04:35:25.144 DEBUG:teuthology.orchestra.run.trial194:> sudo sed -i -e 's/trial194.front.sepia.ceph.com/trial194/g' /etc/hosts 2026-02-23T04:35:25.206 DEBUG:teuthology.orchestra.run.trial194:> sudo sed -i -e 's/10.20.193.194/10.20.193.194/g' /etc/hosts 2026-02-23T04:35:25.269 DEBUG:teuthology.orchestra.run.trial194:> sudo sed -i -e 's/trial194.front.sepia.ceph.com/trial194/g' /etc/hostname 2026-02-23T04:35:25.332 DEBUG:teuthology.orchestra.run.trial194:> sudo hostname trial194 2026-02-23T04:35:25.392 DEBUG:teuthology.orchestra.run.trial194:> cat /etc/os-release 2026-02-23T04:35:25.444 INFO:teuthology.orchestra.run.trial194.stdout:NAME="CentOS Stream" 2026-02-23T04:35:25.444 INFO:teuthology.orchestra.run.trial194.stdout:VERSION="9" 2026-02-23T04:35:25.445 INFO:teuthology.orchestra.run.trial194.stdout:ID="centos" 2026-02-23T04:35:25.445 INFO:teuthology.orchestra.run.trial194.stdout:ID_LIKE="rhel fedora" 2026-02-23T04:35:25.445 INFO:teuthology.orchestra.run.trial194.stdout:VERSION_ID="9" 2026-02-23T04:35:25.445 INFO:teuthology.orchestra.run.trial194.stdout:PLATFORM_ID="platform:el9" 2026-02-23T04:35:25.445 INFO:teuthology.orchestra.run.trial194.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T04:35:25.445 INFO:teuthology.orchestra.run.trial194.stdout:ANSI_COLOR="0;31" 2026-02-23T04:35:25.445 INFO:teuthology.orchestra.run.trial194.stdout:LOGO="fedora-logo-icon" 2026-02-23T04:35:25.445 INFO:teuthology.orchestra.run.trial194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T04:35:25.445 INFO:teuthology.orchestra.run.trial194.stdout:HOME_URL="https://centos.org/" 2026-02-23T04:35:25.445 INFO:teuthology.orchestra.run.trial194.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T04:35:25.445 INFO:teuthology.orchestra.run.trial194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T04:35:25.445 INFO:teuthology.orchestra.run.trial194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T04:35:25.445 INFO:teuthology.provision.fog.trial194:Deploy complete! 2026-02-23T04:35:25.445 DEBUG:teuthology.parallel:result is None 2026-02-23T04:35:25.840 INFO:teuthology.lock.ops:Checking trial027.front.sepia.ceph.com 2026-02-23T04:35:25.840 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-23T04:35:25.913 INFO:teuthology.lock.ops:Checking trial194.front.sepia.ceph.com 2026-02-23T04:35:25.913 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-23T04:35:25.972 INFO:teuthology.lock.ops:Updating [trial027.front.sepia.ceph.com]: set os type and version on server 2026-02-23T04:35:25.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial027.front.sepia.ceph.com' 2026-02-23T04:35:25.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T04:35:26.032 DEBUG:teuthology.orchestra.run.trial027:> true 2026-02-23T04:35:26.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial027.front.sepia.ceph.com' 2026-02-23T04:35:26.106 DEBUG:teuthology.orchestra.run.trial027:> uname -m 2026-02-23T04:35:26.161 INFO:teuthology.orchestra.run.trial027.stdout:x86_64 2026-02-23T04:35:26.162 DEBUG:teuthology.orchestra.run.trial027:> cat /etc/os-release 2026-02-23T04:35:26.218 INFO:teuthology.orchestra.run.trial027.stdout:NAME="CentOS Stream" 2026-02-23T04:35:26.218 INFO:teuthology.orchestra.run.trial027.stdout:VERSION="9" 2026-02-23T04:35:26.218 INFO:teuthology.orchestra.run.trial027.stdout:ID="centos" 2026-02-23T04:35:26.218 INFO:teuthology.orchestra.run.trial027.stdout:ID_LIKE="rhel fedora" 2026-02-23T04:35:26.218 INFO:teuthology.orchestra.run.trial027.stdout:VERSION_ID="9" 2026-02-23T04:35:26.219 INFO:teuthology.orchestra.run.trial027.stdout:PLATFORM_ID="platform:el9" 2026-02-23T04:35:26.219 INFO:teuthology.orchestra.run.trial027.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T04:35:26.219 INFO:teuthology.orchestra.run.trial027.stdout:ANSI_COLOR="0;31" 2026-02-23T04:35:26.219 INFO:teuthology.orchestra.run.trial027.stdout:LOGO="fedora-logo-icon" 2026-02-23T04:35:26.219 INFO:teuthology.orchestra.run.trial027.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T04:35:26.219 INFO:teuthology.orchestra.run.trial027.stdout:HOME_URL="https://centos.org/" 2026-02-23T04:35:26.219 INFO:teuthology.orchestra.run.trial027.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T04:35:26.219 INFO:teuthology.orchestra.run.trial027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T04:35:26.219 INFO:teuthology.orchestra.run.trial027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T04:35:26.220 INFO:teuthology.lock.ops:Updating trial027.front.sepia.ceph.com on lock server 2026-02-23T04:35:26.322 INFO:teuthology.lock.ops:Updating [trial194.front.sepia.ceph.com]: set os type and version on server 2026-02-23T04:35:26.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial194.front.sepia.ceph.com' 2026-02-23T04:35:26.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T04:35:26.396 DEBUG:teuthology.orchestra.run.trial194:> true 2026-02-23T04:35:26.466 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial194.front.sepia.ceph.com' 2026-02-23T04:35:26.466 DEBUG:teuthology.orchestra.run.trial194:> uname -m 2026-02-23T04:35:26.520 INFO:teuthology.orchestra.run.trial194.stdout:x86_64 2026-02-23T04:35:26.521 DEBUG:teuthology.orchestra.run.trial194:> cat /etc/os-release 2026-02-23T04:35:26.575 INFO:teuthology.orchestra.run.trial194.stdout:NAME="CentOS Stream" 2026-02-23T04:35:26.575 INFO:teuthology.orchestra.run.trial194.stdout:VERSION="9" 2026-02-23T04:35:26.575 INFO:teuthology.orchestra.run.trial194.stdout:ID="centos" 2026-02-23T04:35:26.575 INFO:teuthology.orchestra.run.trial194.stdout:ID_LIKE="rhel fedora" 2026-02-23T04:35:26.575 INFO:teuthology.orchestra.run.trial194.stdout:VERSION_ID="9" 2026-02-23T04:35:26.576 INFO:teuthology.orchestra.run.trial194.stdout:PLATFORM_ID="platform:el9" 2026-02-23T04:35:26.576 INFO:teuthology.orchestra.run.trial194.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T04:35:26.576 INFO:teuthology.orchestra.run.trial194.stdout:ANSI_COLOR="0;31" 2026-02-23T04:35:26.576 INFO:teuthology.orchestra.run.trial194.stdout:LOGO="fedora-logo-icon" 2026-02-23T04:35:26.576 INFO:teuthology.orchestra.run.trial194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T04:35:26.576 INFO:teuthology.orchestra.run.trial194.stdout:HOME_URL="https://centos.org/" 2026-02-23T04:35:26.576 INFO:teuthology.orchestra.run.trial194.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T04:35:26.576 INFO:teuthology.orchestra.run.trial194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T04:35:26.576 INFO:teuthology.orchestra.run.trial194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T04:35:26.577 INFO:teuthology.lock.ops:Updating trial194.front.sepia.ceph.com on lock server 2026-02-23T04:35:26.680 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:35:26.778 INFO:teuthology.dispatcher.supervisor:Running job 64821 2026-02-23T04:35:26.778 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_vshankar@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64821 --name vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health} tasks/multifs-auth} -- /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64821/orig.config.yaml 2026-02-23T04:35:26.778 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64821 2026-02-23T04:35:26.778 INFO:teuthology.dispatcher.supervisor:Job PID: 1618981 2026-02-23T04:35:26.778 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-23T04:37:26.779 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:39:26.893 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:41:27.143 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:43:27.271 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:45:27.463 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:47:28.049 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:49:28.175 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:51:28.293 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:51:28.421 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-23T04:51:28.550 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-23T04:51:29.104 INFO:teuthology.orchestra.console.trial027:Power off 2026-02-23T04:51:29.105 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T04:51:29.115 INFO:teuthology.orchestra.console.trial194:Power off 2026-02-23T04:51:29.115 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T04:51:29.142 DEBUG:teuthology.orchestra.console.trial027:power off output: Chassis Power Control: Down/Off 2026-02-23T04:51:29.153 DEBUG:teuthology.orchestra.console.trial194:power off output: Chassis Power Control: Down/Off 2026-02-23T04:51:33.143 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T04:51:33.154 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T04:51:33.251 DEBUG:teuthology.orchestra.console.trial027:check power output: Chassis Power is on 2026-02-23T04:51:33.261 DEBUG:teuthology.orchestra.console.trial194:check power output: Chassis Power is on 2026-02-23T04:51:37.252 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T04:51:37.262 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T04:51:37.363 DEBUG:teuthology.orchestra.console.trial027:check power output: Chassis Power is off 2026-02-23T04:51:37.363 INFO:teuthology.orchestra.console.trial027:Power off completed 2026-02-23T04:51:37.372 DEBUG:teuthology.orchestra.console.trial194:check power output: Chassis Power is off 2026-02-23T04:51:37.372 INFO:teuthology.orchestra.console.trial194:Power off completed 2026-02-23T04:51:37.611 INFO:teuthology.lock.ops:unlocked: trial027.front.sepia.ceph.com 2026-02-23T04:51:37.623 INFO:teuthology.lock.ops:unlocked: trial194.front.sepia.ceph.com