2026-02-17T08:37:52.750 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T08:37:52.750 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:37:52.823 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:37:53.077 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ee09072b9c0>, signals=[15]) 2026-02-17T08:37:53.078 INFO:teuthology.lock.ops:Start node 'trial109.front.sepia.ceph.com' reimaging 2026-02-17T08:37:53.078 INFO:teuthology.lock.ops:Updating [trial109.front.sepia.ceph.com]: reset os type and version on server 2026-02-17T08:37:53.078 INFO:teuthology.lock.ops:Updating trial109.front.sepia.ceph.com on lock server 2026-02-17T08:37:53.135 INFO:teuthology.lock.ops:Start node 'trial137.front.sepia.ceph.com' reimaging 2026-02-17T08:37:53.136 INFO:teuthology.lock.ops:Updating [trial137.front.sepia.ceph.com]: reset os type and version on server 2026-02-17T08:37:53.136 INFO:teuthology.lock.ops:Updating trial137.front.sepia.ceph.com on lock server 2026-02-17T08:37:53.198 INFO:teuthology.lock.ops:Start node 'trial153.front.sepia.ceph.com' reimaging 2026-02-17T08:37:53.198 INFO:teuthology.lock.ops:Updating [trial153.front.sepia.ceph.com]: reset os type and version on server 2026-02-17T08:37:53.198 INFO:teuthology.lock.ops:Updating trial153.front.sepia.ceph.com on lock server 2026-02-17T08:37:53.429 DEBUG:teuthology.provision.fog.trial109:Requesting image trial_centos_9.stream (ID 3) 2026-02-17T08:37:53.430 DEBUG:teuthology.provision.fog.trial137:Requesting image trial_centos_9.stream (ID 3) 2026-02-17T08:37:53.477 INFO:teuthology.provision.fog.trial109:Scheduling deploy of centos 9.stream 2026-02-17T08:37:53.479 INFO:teuthology.provision.fog.trial137:Scheduling deploy of centos 9.stream 2026-02-17T08:37:53.486 DEBUG:teuthology.provision.fog.trial153:Requesting image trial_centos_9.stream (ID 3) 2026-02-17T08:37:53.538 INFO:teuthology.provision.fog.trial153:Scheduling deploy of centos 9.stream 2026-02-17T08:37:54.761 INFO:teuthology.orchestra.console.trial109:Power off 2026-02-17T08:37:54.761 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-17T08:37:54.822 INFO:teuthology.orchestra.console.trial153:Power off 2026-02-17T08:37:54.822 DEBUG:teuthology.orchestra.console.trial153:pexpect command: ipmitool -H trial153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-17T08:37:54.828 DEBUG:teuthology.orchestra.console.trial109:power off output: Chassis Power Control: Down/Off 2026-02-17T08:37:54.841 INFO:teuthology.orchestra.console.trial137:Power off 2026-02-17T08:37:54.841 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-17T08:37:54.860 DEBUG:teuthology.orchestra.console.trial153:power off output: Chassis Power Control: Down/Off 2026-02-17T08:37:54.879 DEBUG:teuthology.orchestra.console.trial137:power off output: Chassis Power Control: Down/Off 2026-02-17T08:37:58.832 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T08:37:58.860 DEBUG:teuthology.orchestra.console.trial153:pexpect command: ipmitool -H trial153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T08:37:58.880 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T08:37:58.942 DEBUG:teuthology.orchestra.console.trial109:check power output: Chassis Power is off 2026-02-17T08:37:58.943 INFO:teuthology.orchestra.console.trial109:Power off completed 2026-02-17T08:37:58.969 DEBUG:teuthology.orchestra.console.trial153:check power output: Chassis Power is off 2026-02-17T08:37:58.970 INFO:teuthology.orchestra.console.trial153:Power off completed 2026-02-17T08:37:58.989 DEBUG:teuthology.orchestra.console.trial137:check power output: Chassis Power is off 2026-02-17T08:37:58.989 INFO:teuthology.orchestra.console.trial137:Power off completed 2026-02-17T08:37:59.043 INFO:teuthology.orchestra.console.trial109:Power on 2026-02-17T08:37:59.043 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-17T08:37:59.070 INFO:teuthology.orchestra.console.trial153:Power on 2026-02-17T08:37:59.070 DEBUG:teuthology.orchestra.console.trial153:pexpect command: ipmitool -H trial153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-17T08:37:59.081 DEBUG:teuthology.orchestra.console.trial109:power on output: Chassis Power Control: Up/On 2026-02-17T08:37:59.090 INFO:teuthology.orchestra.console.trial137:Power on 2026-02-17T08:37:59.090 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-17T08:37:59.109 DEBUG:teuthology.orchestra.console.trial153:power on output: Chassis Power Control: Up/On 2026-02-17T08:37:59.129 DEBUG:teuthology.orchestra.console.trial137:power on output: Chassis Power Control: Up/On 2026-02-17T08:38:03.086 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T08:38:03.110 DEBUG:teuthology.orchestra.console.trial153:pexpect command: ipmitool -H trial153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T08:38:03.130 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T08:38:03.196 DEBUG:teuthology.orchestra.console.trial109:check power output: Chassis Power is on 2026-02-17T08:38:03.196 INFO:teuthology.orchestra.console.trial109:Power on completed 2026-02-17T08:38:03.221 DEBUG:teuthology.orchestra.console.trial153:check power output: Chassis Power is on 2026-02-17T08:38:03.221 INFO:teuthology.orchestra.console.trial153:Power on completed 2026-02-17T08:38:03.238 DEBUG:teuthology.orchestra.console.trial137:check power output: Chassis Power is on 2026-02-17T08:38:03.238 INFO:teuthology.orchestra.console.trial137:Power on completed 2026-02-17T08:38:03.297 INFO:teuthology.provision.fog.trial109:Waiting for deploy to finish 2026-02-17T08:38:03.322 INFO:teuthology.provision.fog.trial153:Waiting for deploy to finish 2026-02-17T08:38:03.339 INFO:teuthology.provision.fog.trial137:Waiting for deploy to finish 2026-02-17T08:39:51.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:39:51.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:39:51.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:39:51.240 ERROR:teuthology.orchestra.connection:Error authenticating with trial153.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2026-02-17T08:39:51.248 ERROR:teuthology.orchestra.connection:Error authenticating with trial137.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2026-02-17T08:39:54.112 WARNING:teuthology.provision.fog.trial109:[Errno None] Unable to connect to port 22 on 10.20.193.109 2026-02-17T08:40:00.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:40:03.200 WARNING:teuthology.provision.fog.trial109:[Errno None] Unable to connect to port 22 on 10.20.193.109 2026-02-17T08:40:09.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:40:12.288 WARNING:teuthology.provision.fog.trial109:[Errno None] Unable to connect to port 22 on 10.20.193.109 2026-02-17T08:40:18.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:40:21.375 WARNING:teuthology.provision.fog.trial109:[Errno None] Unable to connect to port 22 on 10.20.193.109 2026-02-17T08:40:27.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:40:30.464 WARNING:teuthology.provision.fog.trial109:[Errno None] Unable to connect to port 22 on 10.20.193.109 2026-02-17T08:40:36.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:40:55.243 WARNING:teuthology.provision.fog.trial153:timed out 2026-02-17T08:40:55.250 WARNING:teuthology.provision.fog.trial137:timed out 2026-02-17T08:41:01.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:41:01.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:41:05.484 ERROR:teuthology.orchestra.connection:Error authenticating with trial153.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-17T08:41:06.731 ERROR:teuthology.orchestra.connection:Error authenticating with trial137.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-17T08:41:09.609 ERROR:teuthology.orchestra.connection:Error authenticating with trial153.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-17T08:41:10.884 ERROR:teuthology.orchestra.connection:Error authenticating with trial137.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-17T08:41:12.448 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-17T08:41:12.449 DEBUG:teuthology.orchestra.run.trial109:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-17T08:41:12.710 INFO:teuthology.provision.fog.trial109:Node is ready 2026-02-17T08:41:12.710 DEBUG:teuthology.orchestra.run.trial109:> hostname 2026-02-17T08:41:12.766 INFO:teuthology.orchestra.run.trial109.stdout:trial109.front.sepia.ceph.com 2026-02-17T08:41:12.767 DEBUG:teuthology.orchestra.run.trial109:> grep trial109.front.sepia.ceph.com /etc/hosts 2026-02-17T08:41:12.851 INFO:teuthology.orchestra.run.trial109.stdout:10.20.193.109 trial109.front.sepia.ceph.com trial109 2026-02-17T08:41:12.851 DEBUG:teuthology.orchestra.run.trial109:> sudo hostname trial109 2026-02-17T08:41:12.966 DEBUG:teuthology.orchestra.run.trial109:> sudo sed -i -e 's/trial109.front.sepia.ceph.com/trial109/g' /etc/hosts 2026-02-17T08:41:12.992 DEBUG:teuthology.orchestra.run.trial109:> sudo sed -i -e 's/10.20.193.109/10.20.193.109/g' /etc/hosts 2026-02-17T08:41:13.059 DEBUG:teuthology.orchestra.run.trial109:> sudo sed -i -e 's/trial109.front.sepia.ceph.com/trial109/g' /etc/hostname 2026-02-17T08:41:13.125 DEBUG:teuthology.orchestra.run.trial109:> sudo hostname trial109 2026-02-17T08:41:13.189 DEBUG:teuthology.orchestra.run.trial109:> cat /etc/os-release 2026-02-17T08:41:13.246 INFO:teuthology.orchestra.run.trial109.stdout:NAME="CentOS Stream" 2026-02-17T08:41:13.246 INFO:teuthology.orchestra.run.trial109.stdout:VERSION="9" 2026-02-17T08:41:13.246 INFO:teuthology.orchestra.run.trial109.stdout:ID="centos" 2026-02-17T08:41:13.246 INFO:teuthology.orchestra.run.trial109.stdout:ID_LIKE="rhel fedora" 2026-02-17T08:41:13.246 INFO:teuthology.orchestra.run.trial109.stdout:VERSION_ID="9" 2026-02-17T08:41:13.247 INFO:teuthology.orchestra.run.trial109.stdout:PLATFORM_ID="platform:el9" 2026-02-17T08:41:13.247 INFO:teuthology.orchestra.run.trial109.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T08:41:13.247 INFO:teuthology.orchestra.run.trial109.stdout:ANSI_COLOR="0;31" 2026-02-17T08:41:13.247 INFO:teuthology.orchestra.run.trial109.stdout:LOGO="fedora-logo-icon" 2026-02-17T08:41:13.247 INFO:teuthology.orchestra.run.trial109.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T08:41:13.247 INFO:teuthology.orchestra.run.trial109.stdout:HOME_URL="https://centos.org/" 2026-02-17T08:41:13.247 INFO:teuthology.orchestra.run.trial109.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T08:41:13.247 INFO:teuthology.orchestra.run.trial109.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T08:41:13.247 INFO:teuthology.orchestra.run.trial109.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T08:41:13.248 INFO:teuthology.provision.fog.trial109:Deploy complete! 2026-02-17T08:41:13.249 DEBUG:teuthology.parallel:result is None 2026-02-17T08:41:16.724 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-17T08:41:16.724 DEBUG:teuthology.orchestra.run.trial153:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-17T08:41:16.896 INFO:teuthology.provision.fog.trial153:Node is ready 2026-02-17T08:41:16.896 DEBUG:teuthology.orchestra.run.trial153:> hostname 2026-02-17T08:41:16.956 INFO:teuthology.orchestra.run.trial153.stdout:trial153.front.sepia.ceph.com 2026-02-17T08:41:16.957 DEBUG:teuthology.orchestra.run.trial153:> grep trial153.front.sepia.ceph.com /etc/hosts 2026-02-17T08:41:17.017 INFO:teuthology.orchestra.run.trial153.stdout:10.20.193.153 trial153.front.sepia.ceph.com trial153 2026-02-17T08:41:17.017 DEBUG:teuthology.orchestra.run.trial153:> sudo hostname trial153 2026-02-17T08:41:17.087 DEBUG:teuthology.orchestra.run.trial153:> sudo sed -i -e 's/trial153.front.sepia.ceph.com/trial153/g' /etc/hosts 2026-02-17T08:41:17.152 DEBUG:teuthology.orchestra.run.trial153:> sudo sed -i -e 's/10.20.193.153/10.20.193.153/g' /etc/hosts 2026-02-17T08:41:17.216 DEBUG:teuthology.orchestra.run.trial153:> sudo sed -i -e 's/trial153.front.sepia.ceph.com/trial153/g' /etc/hostname 2026-02-17T08:41:17.281 DEBUG:teuthology.orchestra.run.trial153:> sudo hostname trial153 2026-02-17T08:41:17.345 DEBUG:teuthology.orchestra.run.trial153:> cat /etc/os-release 2026-02-17T08:41:17.401 INFO:teuthology.orchestra.run.trial153.stdout:NAME="CentOS Stream" 2026-02-17T08:41:17.401 INFO:teuthology.orchestra.run.trial153.stdout:VERSION="9" 2026-02-17T08:41:17.401 INFO:teuthology.orchestra.run.trial153.stdout:ID="centos" 2026-02-17T08:41:17.401 INFO:teuthology.orchestra.run.trial153.stdout:ID_LIKE="rhel fedora" 2026-02-17T08:41:17.401 INFO:teuthology.orchestra.run.trial153.stdout:VERSION_ID="9" 2026-02-17T08:41:17.401 INFO:teuthology.orchestra.run.trial153.stdout:PLATFORM_ID="platform:el9" 2026-02-17T08:41:17.401 INFO:teuthology.orchestra.run.trial153.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T08:41:17.402 INFO:teuthology.orchestra.run.trial153.stdout:ANSI_COLOR="0;31" 2026-02-17T08:41:17.402 INFO:teuthology.orchestra.run.trial153.stdout:LOGO="fedora-logo-icon" 2026-02-17T08:41:17.402 INFO:teuthology.orchestra.run.trial153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T08:41:17.402 INFO:teuthology.orchestra.run.trial153.stdout:HOME_URL="https://centos.org/" 2026-02-17T08:41:17.402 INFO:teuthology.orchestra.run.trial153.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T08:41:17.402 INFO:teuthology.orchestra.run.trial153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T08:41:17.402 INFO:teuthology.orchestra.run.trial153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T08:41:17.403 INFO:teuthology.provision.fog.trial153:Deploy complete! 2026-02-17T08:41:17.403 DEBUG:teuthology.parallel:result is None 2026-02-17T08:41:17.979 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-17T08:41:17.979 DEBUG:teuthology.orchestra.run.trial137:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-17T08:41:18.127 INFO:teuthology.provision.fog.trial137:Node is ready 2026-02-17T08:41:18.127 DEBUG:teuthology.orchestra.run.trial137:> hostname 2026-02-17T08:41:18.183 INFO:teuthology.orchestra.run.trial137.stdout:trial137.front.sepia.ceph.com 2026-02-17T08:41:18.183 DEBUG:teuthology.orchestra.run.trial137:> grep trial137.front.sepia.ceph.com /etc/hosts 2026-02-17T08:41:18.240 INFO:teuthology.orchestra.run.trial137.stdout:10.20.193.137 trial137.front.sepia.ceph.com trial137 2026-02-17T08:41:18.240 DEBUG:teuthology.orchestra.run.trial137:> sudo hostname trial137 2026-02-17T08:41:18.309 DEBUG:teuthology.orchestra.run.trial137:> sudo sed -i -e 's/trial137.front.sepia.ceph.com/trial137/g' /etc/hosts 2026-02-17T08:41:18.374 DEBUG:teuthology.orchestra.run.trial137:> sudo sed -i -e 's/10.20.193.137/10.20.193.137/g' /etc/hosts 2026-02-17T08:41:18.438 DEBUG:teuthology.orchestra.run.trial137:> sudo sed -i -e 's/trial137.front.sepia.ceph.com/trial137/g' /etc/hostname 2026-02-17T08:41:18.502 DEBUG:teuthology.orchestra.run.trial137:> sudo hostname trial137 2026-02-17T08:41:18.566 DEBUG:teuthology.orchestra.run.trial137:> cat /etc/os-release 2026-02-17T08:41:18.622 INFO:teuthology.orchestra.run.trial137.stdout:NAME="CentOS Stream" 2026-02-17T08:41:18.622 INFO:teuthology.orchestra.run.trial137.stdout:VERSION="9" 2026-02-17T08:41:18.622 INFO:teuthology.orchestra.run.trial137.stdout:ID="centos" 2026-02-17T08:41:18.623 INFO:teuthology.orchestra.run.trial137.stdout:ID_LIKE="rhel fedora" 2026-02-17T08:41:18.623 INFO:teuthology.orchestra.run.trial137.stdout:VERSION_ID="9" 2026-02-17T08:41:18.623 INFO:teuthology.orchestra.run.trial137.stdout:PLATFORM_ID="platform:el9" 2026-02-17T08:41:18.623 INFO:teuthology.orchestra.run.trial137.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T08:41:18.623 INFO:teuthology.orchestra.run.trial137.stdout:ANSI_COLOR="0;31" 2026-02-17T08:41:18.623 INFO:teuthology.orchestra.run.trial137.stdout:LOGO="fedora-logo-icon" 2026-02-17T08:41:18.623 INFO:teuthology.orchestra.run.trial137.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T08:41:18.623 INFO:teuthology.orchestra.run.trial137.stdout:HOME_URL="https://centos.org/" 2026-02-17T08:41:18.623 INFO:teuthology.orchestra.run.trial137.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T08:41:18.623 INFO:teuthology.orchestra.run.trial137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T08:41:18.623 INFO:teuthology.orchestra.run.trial137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T08:41:18.624 INFO:teuthology.provision.fog.trial137:Deploy complete! 2026-02-17T08:41:18.625 DEBUG:teuthology.parallel:result is None 2026-02-17T08:41:19.161 INFO:teuthology.lock.ops:Checking trial109.front.sepia.ceph.com 2026-02-17T08:41:19.161 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-17T08:41:19.268 INFO:teuthology.lock.ops:Checking trial137.front.sepia.ceph.com 2026-02-17T08:41:19.268 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-17T08:41:19.336 INFO:teuthology.lock.ops:Checking trial153.front.sepia.ceph.com 2026-02-17T08:41:19.336 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-17T08:41:19.393 INFO:teuthology.lock.ops:Updating [trial109.front.sepia.ceph.com]: set os type and version on server 2026-02-17T08:41:19.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-17T08:41:19.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:41:19.453 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-17T08:41:19.532 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-17T08:41:19.532 DEBUG:teuthology.orchestra.run.trial109:> uname -m 2026-02-17T08:41:19.588 INFO:teuthology.orchestra.run.trial109.stdout:x86_64 2026-02-17T08:41:19.588 DEBUG:teuthology.orchestra.run.trial109:> cat /etc/os-release 2026-02-17T08:41:19.644 INFO:teuthology.orchestra.run.trial109.stdout:NAME="CentOS Stream" 2026-02-17T08:41:19.644 INFO:teuthology.orchestra.run.trial109.stdout:VERSION="9" 2026-02-17T08:41:19.644 INFO:teuthology.orchestra.run.trial109.stdout:ID="centos" 2026-02-17T08:41:19.644 INFO:teuthology.orchestra.run.trial109.stdout:ID_LIKE="rhel fedora" 2026-02-17T08:41:19.644 INFO:teuthology.orchestra.run.trial109.stdout:VERSION_ID="9" 2026-02-17T08:41:19.644 INFO:teuthology.orchestra.run.trial109.stdout:PLATFORM_ID="platform:el9" 2026-02-17T08:41:19.645 INFO:teuthology.orchestra.run.trial109.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T08:41:19.645 INFO:teuthology.orchestra.run.trial109.stdout:ANSI_COLOR="0;31" 2026-02-17T08:41:19.645 INFO:teuthology.orchestra.run.trial109.stdout:LOGO="fedora-logo-icon" 2026-02-17T08:41:19.645 INFO:teuthology.orchestra.run.trial109.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T08:41:19.645 INFO:teuthology.orchestra.run.trial109.stdout:HOME_URL="https://centos.org/" 2026-02-17T08:41:19.645 INFO:teuthology.orchestra.run.trial109.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T08:41:19.645 INFO:teuthology.orchestra.run.trial109.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T08:41:19.645 INFO:teuthology.orchestra.run.trial109.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T08:41:19.646 INFO:teuthology.lock.ops:Updating trial109.front.sepia.ceph.com on lock server 2026-02-17T08:41:19.748 INFO:teuthology.lock.ops:Updating [trial137.front.sepia.ceph.com]: set os type and version on server 2026-02-17T08:41:19.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial137.front.sepia.ceph.com' 2026-02-17T08:41:19.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:41:19.816 DEBUG:teuthology.orchestra.run.trial137:> true 2026-02-17T08:41:19.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial137.front.sepia.ceph.com' 2026-02-17T08:41:19.889 DEBUG:teuthology.orchestra.run.trial137:> uname -m 2026-02-17T08:41:19.945 INFO:teuthology.orchestra.run.trial137.stdout:x86_64 2026-02-17T08:41:19.945 DEBUG:teuthology.orchestra.run.trial137:> cat /etc/os-release 2026-02-17T08:41:20.001 INFO:teuthology.orchestra.run.trial137.stdout:NAME="CentOS Stream" 2026-02-17T08:41:20.002 INFO:teuthology.orchestra.run.trial137.stdout:VERSION="9" 2026-02-17T08:41:20.002 INFO:teuthology.orchestra.run.trial137.stdout:ID="centos" 2026-02-17T08:41:20.002 INFO:teuthology.orchestra.run.trial137.stdout:ID_LIKE="rhel fedora" 2026-02-17T08:41:20.002 INFO:teuthology.orchestra.run.trial137.stdout:VERSION_ID="9" 2026-02-17T08:41:20.002 INFO:teuthology.orchestra.run.trial137.stdout:PLATFORM_ID="platform:el9" 2026-02-17T08:41:20.002 INFO:teuthology.orchestra.run.trial137.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T08:41:20.002 INFO:teuthology.orchestra.run.trial137.stdout:ANSI_COLOR="0;31" 2026-02-17T08:41:20.002 INFO:teuthology.orchestra.run.trial137.stdout:LOGO="fedora-logo-icon" 2026-02-17T08:41:20.002 INFO:teuthology.orchestra.run.trial137.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T08:41:20.002 INFO:teuthology.orchestra.run.trial137.stdout:HOME_URL="https://centos.org/" 2026-02-17T08:41:20.003 INFO:teuthology.orchestra.run.trial137.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T08:41:20.003 INFO:teuthology.orchestra.run.trial137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T08:41:20.003 INFO:teuthology.orchestra.run.trial137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T08:41:20.003 INFO:teuthology.lock.ops:Updating trial137.front.sepia.ceph.com on lock server 2026-02-17T08:41:20.103 INFO:teuthology.lock.ops:Updating [trial153.front.sepia.ceph.com]: set os type and version on server 2026-02-17T08:41:20.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial153.front.sepia.ceph.com' 2026-02-17T08:41:20.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:41:20.166 DEBUG:teuthology.orchestra.run.trial153:> true 2026-02-17T08:41:20.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial153.front.sepia.ceph.com' 2026-02-17T08:41:20.245 DEBUG:teuthology.orchestra.run.trial153:> uname -m 2026-02-17T08:41:20.301 INFO:teuthology.orchestra.run.trial153.stdout:x86_64 2026-02-17T08:41:20.301 DEBUG:teuthology.orchestra.run.trial153:> cat /etc/os-release 2026-02-17T08:41:20.357 INFO:teuthology.orchestra.run.trial153.stdout:NAME="CentOS Stream" 2026-02-17T08:41:20.357 INFO:teuthology.orchestra.run.trial153.stdout:VERSION="9" 2026-02-17T08:41:20.358 INFO:teuthology.orchestra.run.trial153.stdout:ID="centos" 2026-02-17T08:41:20.358 INFO:teuthology.orchestra.run.trial153.stdout:ID_LIKE="rhel fedora" 2026-02-17T08:41:20.358 INFO:teuthology.orchestra.run.trial153.stdout:VERSION_ID="9" 2026-02-17T08:41:20.358 INFO:teuthology.orchestra.run.trial153.stdout:PLATFORM_ID="platform:el9" 2026-02-17T08:41:20.358 INFO:teuthology.orchestra.run.trial153.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T08:41:20.358 INFO:teuthology.orchestra.run.trial153.stdout:ANSI_COLOR="0;31" 2026-02-17T08:41:20.358 INFO:teuthology.orchestra.run.trial153.stdout:LOGO="fedora-logo-icon" 2026-02-17T08:41:20.358 INFO:teuthology.orchestra.run.trial153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T08:41:20.358 INFO:teuthology.orchestra.run.trial153.stdout:HOME_URL="https://centos.org/" 2026-02-17T08:41:20.358 INFO:teuthology.orchestra.run.trial153.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T08:41:20.358 INFO:teuthology.orchestra.run.trial153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T08:41:20.359 INFO:teuthology.orchestra.run.trial153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T08:41:20.359 INFO:teuthology.lock.ops:Updating trial153.front.sepia.ceph.com on lock server 2026-02-17T08:41:20.461 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:41:20.557 INFO:teuthology.dispatcher.supervisor:Running job 51183 2026-02-17T08:41:20.557 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_skanta@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51183 --name skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51183/orig.config.yaml 2026-02-17T08:41:20.558 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51183 2026-02-17T08:41:20.558 INFO:teuthology.dispatcher.supervisor:Job PID: 3548916 2026-02-17T08:41:20.558 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-17T08:43:20.558 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:45:20.679 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:47:20.803 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:49:20.922 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:51:21.058 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:53:21.183 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:55:21.309 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:57:21.431 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:59:21.503 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T09:01:21.623 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T09:03:21.746 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T09:05:21.831 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T09:05:21.908 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-17T09:05:22.087 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-17T09:05:22.823 INFO:teuthology.orchestra.console.trial137:Power off 2026-02-17T09:05:22.823 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-17T09:05:22.831 INFO:teuthology.orchestra.console.trial153:Power off 2026-02-17T09:05:22.831 DEBUG:teuthology.orchestra.console.trial153:pexpect command: ipmitool -H trial153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-17T09:05:22.849 INFO:teuthology.orchestra.console.trial109:Power off 2026-02-17T09:05:22.849 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-17T09:05:22.862 DEBUG:teuthology.orchestra.console.trial137:power off output: Chassis Power Control: Down/Off 2026-02-17T09:05:22.868 DEBUG:teuthology.orchestra.console.trial153:power off output: Chassis Power Control: Down/Off 2026-02-17T09:05:22.886 DEBUG:teuthology.orchestra.console.trial109:power off output: Chassis Power Control: Down/Off 2026-02-17T09:05:26.863 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T09:05:26.872 DEBUG:teuthology.orchestra.console.trial153:pexpect command: ipmitool -H trial153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T09:05:26.886 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T09:05:26.974 DEBUG:teuthology.orchestra.console.trial137:check power output: Chassis Power is on 2026-02-17T09:05:26.980 DEBUG:teuthology.orchestra.console.trial153:check power output: Chassis Power is on 2026-02-17T09:05:26.996 DEBUG:teuthology.orchestra.console.trial109:check power output: Chassis Power is on 2026-02-17T09:05:30.975 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T09:05:30.984 DEBUG:teuthology.orchestra.console.trial153:pexpect command: ipmitool -H trial153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T09:05:30.997 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T09:05:31.085 DEBUG:teuthology.orchestra.console.trial137:check power output: Chassis Power is off 2026-02-17T09:05:31.086 INFO:teuthology.orchestra.console.trial137:Power off completed 2026-02-17T09:05:31.093 DEBUG:teuthology.orchestra.console.trial153:check power output: Chassis Power is off 2026-02-17T09:05:31.093 INFO:teuthology.orchestra.console.trial153:Power off completed 2026-02-17T09:05:31.107 DEBUG:teuthology.orchestra.console.trial109:check power output: Chassis Power is off 2026-02-17T09:05:31.107 INFO:teuthology.orchestra.console.trial109:Power off completed 2026-02-17T09:05:31.387 INFO:teuthology.lock.ops:unlocked: trial137.front.sepia.ceph.com 2026-02-17T09:05:31.395 INFO:teuthology.lock.ops:unlocked: trial153.front.sepia.ceph.com 2026-02-17T09:05:31.399 INFO:teuthology.lock.ops:unlocked: trial109.front.sepia.ceph.com