2026-02-26T02:57:49.904 INFO:root:teuthology version: 1.2.4.dev11+g6e3d0419c 2026-02-26T02:57:49.904 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T02:57:49.982 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T02:57:50.240 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0b09e382c0>, signals=[15]) 2026-02-26T02:57:50.240 INFO:teuthology.lock.ops:Start node 'trial130.front.sepia.ceph.com' reimaging 2026-02-26T02:57:50.240 INFO:teuthology.lock.ops:Updating [trial130.front.sepia.ceph.com]: reset os type and version on server 2026-02-26T02:57:50.240 INFO:teuthology.lock.ops:Updating trial130.front.sepia.ceph.com on lock server 2026-02-26T02:57:50.298 INFO:teuthology.lock.ops:Start node 'trial161.front.sepia.ceph.com' reimaging 2026-02-26T02:57:50.298 INFO:teuthology.lock.ops:Updating [trial161.front.sepia.ceph.com]: reset os type and version on server 2026-02-26T02:57:50.299 INFO:teuthology.lock.ops:Updating trial161.front.sepia.ceph.com on lock server 2026-02-26T02:57:50.481 DEBUG:teuthology.provision.fog.trial130:Requesting image trial_centos_9.stream (ID 3) 2026-02-26T02:57:50.498 INFO:teuthology.provision.fog.trial130:Scheduling deploy of centos 9.stream 2026-02-26T02:57:50.513 DEBUG:teuthology.provision.fog.trial161:Requesting image trial_centos_9.stream (ID 3) 2026-02-26T02:57:50.564 INFO:teuthology.provision.fog.trial161:Scheduling deploy of centos 9.stream 2026-02-26T02:57:52.381 INFO:teuthology.orchestra.console.trial130:Power off 2026-02-26T02:57:52.381 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-26T02:57:52.400 INFO:teuthology.orchestra.console.trial161:Power off 2026-02-26T02:57:52.401 DEBUG:teuthology.orchestra.console.trial161:pexpect command: ipmitool -H trial161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-26T02:57:52.419 DEBUG:teuthology.orchestra.console.trial130:power off output: Chassis Power Control: Down/Off 2026-02-26T02:57:52.439 DEBUG:teuthology.orchestra.console.trial161:power off output: Chassis Power Control: Down/Off 2026-02-26T02:57:56.422 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-26T02:57:56.440 DEBUG:teuthology.orchestra.console.trial161:pexpect command: ipmitool -H trial161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-26T02:57:56.531 DEBUG:teuthology.orchestra.console.trial130:check power output: Chassis Power is off 2026-02-26T02:57:56.531 INFO:teuthology.orchestra.console.trial130:Power off completed 2026-02-26T02:57:56.548 DEBUG:teuthology.orchestra.console.trial161:check power output: Chassis Power is off 2026-02-26T02:57:56.548 INFO:teuthology.orchestra.console.trial161:Power off completed 2026-02-26T02:57:56.632 INFO:teuthology.orchestra.console.trial130:Power on 2026-02-26T02:57:56.632 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-26T02:57:56.649 INFO:teuthology.orchestra.console.trial161:Power on 2026-02-26T02:57:56.650 DEBUG:teuthology.orchestra.console.trial161:pexpect command: ipmitool -H trial161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-26T02:57:56.675 DEBUG:teuthology.orchestra.console.trial130:power on output: Chassis Power Control: Up/On 2026-02-26T02:57:56.698 DEBUG:teuthology.orchestra.console.trial161:power on output: Chassis Power Control: Up/On 2026-02-26T02:58:00.680 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-26T02:58:00.698 DEBUG:teuthology.orchestra.console.trial161:pexpect command: ipmitool -H trial161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-26T02:58:00.790 DEBUG:teuthology.orchestra.console.trial130:check power output: Chassis Power is on 2026-02-26T02:58:00.790 INFO:teuthology.orchestra.console.trial130:Power on completed 2026-02-26T02:58:00.806 DEBUG:teuthology.orchestra.console.trial161:check power output: Chassis Power is on 2026-02-26T02:58:00.806 INFO:teuthology.orchestra.console.trial161:Power on completed 2026-02-26T02:58:00.890 INFO:teuthology.provision.fog.trial130:Waiting for deploy to finish 2026-02-26T02:58:00.907 INFO:teuthology.provision.fog.trial161:Waiting for deploy to finish 2026-02-26T02:59:48.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:59:49.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:59:49.057 ERROR:teuthology.orchestra.connection:Error authenticating with trial161.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2026-02-26T02:59:49.139 ERROR:teuthology.orchestra.connection:Error authenticating with trial130.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2026-02-26T03:00:53.060 WARNING:teuthology.provision.fog.trial161:timed out 2026-02-26T03:00:53.142 WARNING:teuthology.provision.fog.trial130:timed out 2026-02-26T03:00:59.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T03:00:59.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T03:01:02.299 ERROR:teuthology.orchestra.connection:Error authenticating with trial130.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-26T03:01:03.303 ERROR:teuthology.orchestra.connection:Error authenticating with trial161.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-26T03:01:06.371 ERROR:teuthology.orchestra.connection:Error authenticating with trial130.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-26T03:01:07.390 ERROR:teuthology.orchestra.connection:Error authenticating with trial161.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-26T03:01:13.490 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-26T03:01:13.490 DEBUG:teuthology.orchestra.run.trial130:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-26T03:01:13.673 INFO:teuthology.provision.fog.trial130:Node is ready 2026-02-26T03:01:13.674 DEBUG:teuthology.orchestra.run.trial130:> hostname 2026-02-26T03:01:13.730 INFO:teuthology.orchestra.run.trial130.stdout:trial130.front.sepia.ceph.com 2026-02-26T03:01:13.731 DEBUG:teuthology.orchestra.run.trial130:> grep trial130.front.sepia.ceph.com /etc/hosts 2026-02-26T03:01:13.787 INFO:teuthology.orchestra.run.trial130.stdout:10.20.193.130 trial130.front.sepia.ceph.com trial130 2026-02-26T03:01:13.787 DEBUG:teuthology.orchestra.run.trial130:> sudo hostname trial130 2026-02-26T03:01:13.858 DEBUG:teuthology.orchestra.run.trial130:> sudo sed -i -e 's/trial130.front.sepia.ceph.com/trial130/g' /etc/hosts 2026-02-26T03:01:13.928 DEBUG:teuthology.orchestra.run.trial130:> sudo sed -i -e 's/10.20.193.130/10.20.193.130/g' /etc/hosts 2026-02-26T03:01:13.994 DEBUG:teuthology.orchestra.run.trial130:> sudo sed -i -e 's/trial130.front.sepia.ceph.com/trial130/g' /etc/hostname 2026-02-26T03:01:14.060 DEBUG:teuthology.orchestra.run.trial130:> sudo hostname trial130 2026-02-26T03:01:14.127 DEBUG:teuthology.orchestra.run.trial130:> cat /etc/os-release 2026-02-26T03:01:14.184 INFO:teuthology.orchestra.run.trial130.stdout:NAME="CentOS Stream" 2026-02-26T03:01:14.184 INFO:teuthology.orchestra.run.trial130.stdout:VERSION="9" 2026-02-26T03:01:14.184 INFO:teuthology.orchestra.run.trial130.stdout:ID="centos" 2026-02-26T03:01:14.184 INFO:teuthology.orchestra.run.trial130.stdout:ID_LIKE="rhel fedora" 2026-02-26T03:01:14.184 INFO:teuthology.orchestra.run.trial130.stdout:VERSION_ID="9" 2026-02-26T03:01:14.184 INFO:teuthology.orchestra.run.trial130.stdout:PLATFORM_ID="platform:el9" 2026-02-26T03:01:14.184 INFO:teuthology.orchestra.run.trial130.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-26T03:01:14.184 INFO:teuthology.orchestra.run.trial130.stdout:ANSI_COLOR="0;31" 2026-02-26T03:01:14.184 INFO:teuthology.orchestra.run.trial130.stdout:LOGO="fedora-logo-icon" 2026-02-26T03:01:14.184 INFO:teuthology.orchestra.run.trial130.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-26T03:01:14.184 INFO:teuthology.orchestra.run.trial130.stdout:HOME_URL="https://centos.org/" 2026-02-26T03:01:14.184 INFO:teuthology.orchestra.run.trial130.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-26T03:01:14.184 INFO:teuthology.orchestra.run.trial130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-26T03:01:14.184 INFO:teuthology.orchestra.run.trial130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-26T03:01:14.185 INFO:teuthology.provision.fog.trial130:Deploy complete! 2026-02-26T03:01:14.185 DEBUG:teuthology.parallel:result is None 2026-02-26T03:01:14.458 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-26T03:01:14.458 DEBUG:teuthology.orchestra.run.trial161:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-26T03:01:14.779 INFO:teuthology.provision.fog.trial161:Node is ready 2026-02-26T03:01:14.780 DEBUG:teuthology.orchestra.run.trial161:> hostname 2026-02-26T03:01:14.836 INFO:teuthology.orchestra.run.trial161.stdout:trial161.front.sepia.ceph.com 2026-02-26T03:01:14.837 DEBUG:teuthology.orchestra.run.trial161:> grep trial161.front.sepia.ceph.com /etc/hosts 2026-02-26T03:01:14.892 INFO:teuthology.orchestra.run.trial161.stdout:10.20.193.161 trial161.front.sepia.ceph.com trial161 2026-02-26T03:01:14.893 DEBUG:teuthology.orchestra.run.trial161:> sudo hostname trial161 2026-02-26T03:01:14.964 DEBUG:teuthology.orchestra.run.trial161:> sudo sed -i -e 's/trial161.front.sepia.ceph.com/trial161/g' /etc/hosts 2026-02-26T03:01:15.031 DEBUG:teuthology.orchestra.run.trial161:> sudo sed -i -e 's/10.20.193.161/10.20.193.161/g' /etc/hosts 2026-02-26T03:01:15.097 DEBUG:teuthology.orchestra.run.trial161:> sudo sed -i -e 's/trial161.front.sepia.ceph.com/trial161/g' /etc/hostname 2026-02-26T03:01:15.163 DEBUG:teuthology.orchestra.run.trial161:> sudo hostname trial161 2026-02-26T03:01:15.227 DEBUG:teuthology.orchestra.run.trial161:> cat /etc/os-release 2026-02-26T03:01:15.283 INFO:teuthology.orchestra.run.trial161.stdout:NAME="CentOS Stream" 2026-02-26T03:01:15.284 INFO:teuthology.orchestra.run.trial161.stdout:VERSION="9" 2026-02-26T03:01:15.284 INFO:teuthology.orchestra.run.trial161.stdout:ID="centos" 2026-02-26T03:01:15.284 INFO:teuthology.orchestra.run.trial161.stdout:ID_LIKE="rhel fedora" 2026-02-26T03:01:15.284 INFO:teuthology.orchestra.run.trial161.stdout:VERSION_ID="9" 2026-02-26T03:01:15.284 INFO:teuthology.orchestra.run.trial161.stdout:PLATFORM_ID="platform:el9" 2026-02-26T03:01:15.284 INFO:teuthology.orchestra.run.trial161.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-26T03:01:15.284 INFO:teuthology.orchestra.run.trial161.stdout:ANSI_COLOR="0;31" 2026-02-26T03:01:15.284 INFO:teuthology.orchestra.run.trial161.stdout:LOGO="fedora-logo-icon" 2026-02-26T03:01:15.284 INFO:teuthology.orchestra.run.trial161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-26T03:01:15.284 INFO:teuthology.orchestra.run.trial161.stdout:HOME_URL="https://centos.org/" 2026-02-26T03:01:15.284 INFO:teuthology.orchestra.run.trial161.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-26T03:01:15.284 INFO:teuthology.orchestra.run.trial161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-26T03:01:15.284 INFO:teuthology.orchestra.run.trial161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-26T03:01:15.284 INFO:teuthology.provision.fog.trial161:Deploy complete! 2026-02-26T03:01:15.284 DEBUG:teuthology.parallel:result is None 2026-02-26T03:01:15.703 INFO:teuthology.lock.ops:Checking trial130.front.sepia.ceph.com 2026-02-26T03:01:15.703 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-26T03:01:15.763 INFO:teuthology.lock.ops:Checking trial161.front.sepia.ceph.com 2026-02-26T03:01:15.763 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-26T03:01:15.823 INFO:teuthology.lock.ops:Updating [trial130.front.sepia.ceph.com]: set os type and version on server 2026-02-26T03:01:15.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial130.front.sepia.ceph.com' 2026-02-26T03:01:15.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T03:01:15.885 DEBUG:teuthology.orchestra.run.trial130:> true 2026-02-26T03:01:15.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial130.front.sepia.ceph.com' 2026-02-26T03:01:15.961 DEBUG:teuthology.orchestra.run.trial130:> uname -m 2026-02-26T03:01:16.018 INFO:teuthology.orchestra.run.trial130.stdout:x86_64 2026-02-26T03:01:16.018 DEBUG:teuthology.orchestra.run.trial130:> cat /etc/os-release 2026-02-26T03:01:16.076 INFO:teuthology.orchestra.run.trial130.stdout:NAME="CentOS Stream" 2026-02-26T03:01:16.076 INFO:teuthology.orchestra.run.trial130.stdout:VERSION="9" 2026-02-26T03:01:16.076 INFO:teuthology.orchestra.run.trial130.stdout:ID="centos" 2026-02-26T03:01:16.076 INFO:teuthology.orchestra.run.trial130.stdout:ID_LIKE="rhel fedora" 2026-02-26T03:01:16.076 INFO:teuthology.orchestra.run.trial130.stdout:VERSION_ID="9" 2026-02-26T03:01:16.076 INFO:teuthology.orchestra.run.trial130.stdout:PLATFORM_ID="platform:el9" 2026-02-26T03:01:16.076 INFO:teuthology.orchestra.run.trial130.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-26T03:01:16.076 INFO:teuthology.orchestra.run.trial130.stdout:ANSI_COLOR="0;31" 2026-02-26T03:01:16.077 INFO:teuthology.orchestra.run.trial130.stdout:LOGO="fedora-logo-icon" 2026-02-26T03:01:16.077 INFO:teuthology.orchestra.run.trial130.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-26T03:01:16.077 INFO:teuthology.orchestra.run.trial130.stdout:HOME_URL="https://centos.org/" 2026-02-26T03:01:16.077 INFO:teuthology.orchestra.run.trial130.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-26T03:01:16.077 INFO:teuthology.orchestra.run.trial130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-26T03:01:16.077 INFO:teuthology.orchestra.run.trial130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-26T03:01:16.078 INFO:teuthology.lock.ops:Updating trial130.front.sepia.ceph.com on lock server 2026-02-26T03:01:16.236 INFO:teuthology.lock.ops:Updating [trial161.front.sepia.ceph.com]: set os type and version on server 2026-02-26T03:01:16.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial161.front.sepia.ceph.com' 2026-02-26T03:01:16.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T03:01:16.309 DEBUG:teuthology.orchestra.run.trial161:> true 2026-02-26T03:01:16.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial161.front.sepia.ceph.com' 2026-02-26T03:01:16.382 DEBUG:teuthology.orchestra.run.trial161:> uname -m 2026-02-26T03:01:16.438 INFO:teuthology.orchestra.run.trial161.stdout:x86_64 2026-02-26T03:01:16.438 DEBUG:teuthology.orchestra.run.trial161:> cat /etc/os-release 2026-02-26T03:01:16.493 INFO:teuthology.orchestra.run.trial161.stdout:NAME="CentOS Stream" 2026-02-26T03:01:16.493 INFO:teuthology.orchestra.run.trial161.stdout:VERSION="9" 2026-02-26T03:01:16.493 INFO:teuthology.orchestra.run.trial161.stdout:ID="centos" 2026-02-26T03:01:16.493 INFO:teuthology.orchestra.run.trial161.stdout:ID_LIKE="rhel fedora" 2026-02-26T03:01:16.493 INFO:teuthology.orchestra.run.trial161.stdout:VERSION_ID="9" 2026-02-26T03:01:16.493 INFO:teuthology.orchestra.run.trial161.stdout:PLATFORM_ID="platform:el9" 2026-02-26T03:01:16.494 INFO:teuthology.orchestra.run.trial161.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-26T03:01:16.494 INFO:teuthology.orchestra.run.trial161.stdout:ANSI_COLOR="0;31" 2026-02-26T03:01:16.494 INFO:teuthology.orchestra.run.trial161.stdout:LOGO="fedora-logo-icon" 2026-02-26T03:01:16.494 INFO:teuthology.orchestra.run.trial161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-26T03:01:16.494 INFO:teuthology.orchestra.run.trial161.stdout:HOME_URL="https://centos.org/" 2026-02-26T03:01:16.494 INFO:teuthology.orchestra.run.trial161.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-26T03:01:16.494 INFO:teuthology.orchestra.run.trial161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-26T03:01:16.494 INFO:teuthology.orchestra.run.trial161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-26T03:01:16.494 INFO:teuthology.lock.ops:Updating trial161.front.sepia.ceph.com on lock server 2026-02-26T03:01:16.557 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:01:16.645 INFO:teuthology.dispatcher.supervisor:Running job 71153 2026-02-26T03:01:16.645 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/bin/teuthology -v --owner scheduled_shraddhaag@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial/71153 --name shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{default} thrashosds-health workloads/small-objects-localized} -- /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial/71153/orig.config.yaml 2026-02-26T03:01:16.645 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial/71153 2026-02-26T03:01:16.645 INFO:teuthology.dispatcher.supervisor:Job PID: 848001 2026-02-26T03:01:16.645 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-26T03:03:16.646 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:05:16.765 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:07:16.865 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:09:16.957 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:11:17.086 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:13:17.177 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:15:17.286 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:17:17.362 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:19:17.594 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:21:17.672 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:23:17.794 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:25:17.980 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:27:18.100 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:29:18.218 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:31:18.347 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:33:18.501 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:35:18.622 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:37:18.742 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:37:18.864 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-26T03:37:18.984 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-26T03:37:19.499 INFO:teuthology.orchestra.console.trial161:Power off 2026-02-26T03:37:19.499 DEBUG:teuthology.orchestra.console.trial161:pexpect command: ipmitool -H trial161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-26T03:37:19.509 INFO:teuthology.orchestra.console.trial130:Power off 2026-02-26T03:37:19.509 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-26T03:37:19.539 DEBUG:teuthology.orchestra.console.trial161:power off output: Chassis Power Control: Down/Off 2026-02-26T03:37:19.546 DEBUG:teuthology.orchestra.console.trial130:power off output: Chassis Power Control: Down/Off 2026-02-26T03:37:23.539 DEBUG:teuthology.orchestra.console.trial161:pexpect command: ipmitool -H trial161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-26T03:37:23.548 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-26T03:37:23.650 DEBUG:teuthology.orchestra.console.trial161:check power output: Chassis Power is on 2026-02-26T03:37:23.657 DEBUG:teuthology.orchestra.console.trial130:check power output: Chassis Power is on 2026-02-26T03:37:27.652 DEBUG:teuthology.orchestra.console.trial161:pexpect command: ipmitool -H trial161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-26T03:37:27.660 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-26T03:37:27.763 DEBUG:teuthology.orchestra.console.trial161:check power output: Chassis Power is off 2026-02-26T03:37:27.763 INFO:teuthology.orchestra.console.trial161:Power off completed 2026-02-26T03:37:27.769 DEBUG:teuthology.orchestra.console.trial130:check power output: Chassis Power is off 2026-02-26T03:37:27.769 INFO:teuthology.orchestra.console.trial130:Power off completed 2026-02-26T03:37:28.006 INFO:teuthology.lock.ops:unlocked: trial161.front.sepia.ceph.com 2026-02-26T03:37:28.033 INFO:teuthology.lock.ops:unlocked: trial130.front.sepia.ceph.com