2026-02-17T08:26:14.028 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T08:26:14.028 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:26:14.102 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:26:14.358 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x796a45a52de0>, signals=[15]) 2026-02-17T08:26:14.358 INFO:teuthology.lock.ops:Start node 'trial036.front.sepia.ceph.com' reimaging 2026-02-17T08:26:14.358 INFO:teuthology.lock.ops:Updating [trial036.front.sepia.ceph.com]: reset os type and version on server 2026-02-17T08:26:14.358 INFO:teuthology.lock.ops:Updating trial036.front.sepia.ceph.com on lock server 2026-02-17T08:26:14.415 INFO:teuthology.lock.ops:Start node 'trial040.front.sepia.ceph.com' reimaging 2026-02-17T08:26:14.415 INFO:teuthology.lock.ops:Updating [trial040.front.sepia.ceph.com]: reset os type and version on server 2026-02-17T08:26:14.415 INFO:teuthology.lock.ops:Updating trial040.front.sepia.ceph.com on lock server 2026-02-17T08:26:14.474 INFO:teuthology.lock.ops:Start node 'trial195.front.sepia.ceph.com' reimaging 2026-02-17T08:26:14.475 INFO:teuthology.lock.ops:Updating [trial195.front.sepia.ceph.com]: reset os type and version on server 2026-02-17T08:26:14.475 INFO:teuthology.lock.ops:Updating trial195.front.sepia.ceph.com on lock server 2026-02-17T08:26:14.702 DEBUG:teuthology.provision.fog.trial036:Requesting image trial_centos_9.stream (ID 3) 2026-02-17T08:26:14.703 DEBUG:teuthology.provision.fog.trial040:Requesting image trial_centos_9.stream (ID 3) 2026-02-17T08:26:14.756 INFO:teuthology.provision.fog.trial036:Scheduling deploy of centos 9.stream 2026-02-17T08:26:14.758 INFO:teuthology.provision.fog.trial040:Scheduling deploy of centos 9.stream 2026-02-17T08:26:14.759 DEBUG:teuthology.provision.fog.trial195:Requesting image trial_centos_9.stream (ID 3) 2026-02-17T08:26:14.810 INFO:teuthology.provision.fog.trial195:Scheduling deploy of centos 9.stream 2026-02-17T08:26:16.007 INFO:teuthology.orchestra.console.trial036:Power off 2026-02-17T08:26:16.007 DEBUG:teuthology.orchestra.console.trial036:pexpect command: ipmitool -H trial036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-17T08:26:16.019 INFO:teuthology.orchestra.console.trial040:Power off 2026-02-17T08:26:16.019 DEBUG:teuthology.orchestra.console.trial040:pexpect command: ipmitool -H trial040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-17T08:26:16.026 INFO:teuthology.orchestra.console.trial195:Power off 2026-02-17T08:26:16.026 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-17T08:26:16.045 DEBUG:teuthology.orchestra.console.trial036:power off output: Chassis Power Control: Down/Off 2026-02-17T08:26:16.056 DEBUG:teuthology.orchestra.console.trial040:power off output: Chassis Power Control: Down/Off 2026-02-17T08:26:16.065 DEBUG:teuthology.orchestra.console.trial195:power off output: Chassis Power Control: Down/Off 2026-02-17T08:26:20.047 DEBUG:teuthology.orchestra.console.trial036:pexpect command: ipmitool -H trial036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T08:26:20.056 DEBUG:teuthology.orchestra.console.trial040:pexpect command: ipmitool -H trial040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T08:26:20.066 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T08:26:20.157 DEBUG:teuthology.orchestra.console.trial036:check power output: Chassis Power is off 2026-02-17T08:26:20.157 INFO:teuthology.orchestra.console.trial036:Power off completed 2026-02-17T08:26:20.165 DEBUG:teuthology.orchestra.console.trial040:check power output: Chassis Power is off 2026-02-17T08:26:20.165 INFO:teuthology.orchestra.console.trial040:Power off completed 2026-02-17T08:26:20.174 DEBUG:teuthology.orchestra.console.trial195:check power output: Chassis Power is off 2026-02-17T08:26:20.174 INFO:teuthology.orchestra.console.trial195:Power off completed 2026-02-17T08:26:20.259 INFO:teuthology.orchestra.console.trial036:Power on 2026-02-17T08:26:20.259 DEBUG:teuthology.orchestra.console.trial036:pexpect command: ipmitool -H trial036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-17T08:26:20.268 INFO:teuthology.orchestra.console.trial040:Power on 2026-02-17T08:26:20.269 DEBUG:teuthology.orchestra.console.trial040:pexpect command: ipmitool -H trial040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-17T08:26:20.277 INFO:teuthology.orchestra.console.trial195:Power on 2026-02-17T08:26:20.277 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-17T08:26:20.299 DEBUG:teuthology.orchestra.console.trial036:power on output: Chassis Power Control: Up/On 2026-02-17T08:26:20.309 DEBUG:teuthology.orchestra.console.trial040:power on output: Chassis Power Control: Up/On 2026-02-17T08:26:20.317 DEBUG:teuthology.orchestra.console.trial195:power on output: Chassis Power Control: Up/On 2026-02-17T08:26:24.304 DEBUG:teuthology.orchestra.console.trial036:pexpect command: ipmitool -H trial036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T08:26:24.313 DEBUG:teuthology.orchestra.console.trial040:pexpect command: ipmitool -H trial040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T08:26:24.320 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T08:26:24.415 DEBUG:teuthology.orchestra.console.trial036:check power output: Chassis Power is on 2026-02-17T08:26:24.416 INFO:teuthology.orchestra.console.trial036:Power on completed 2026-02-17T08:26:24.421 DEBUG:teuthology.orchestra.console.trial040:check power output: Chassis Power is on 2026-02-17T08:26:24.422 INFO:teuthology.orchestra.console.trial040:Power on completed 2026-02-17T08:26:24.428 DEBUG:teuthology.orchestra.console.trial195:check power output: Chassis Power is on 2026-02-17T08:26:24.428 INFO:teuthology.orchestra.console.trial195:Power on completed 2026-02-17T08:26:24.517 INFO:teuthology.provision.fog.trial036:Waiting for deploy to finish 2026-02-17T08:26:24.523 INFO:teuthology.provision.fog.trial040:Waiting for deploy to finish 2026-02-17T08:26:24.529 INFO:teuthology.provision.fog.trial195:Waiting for deploy to finish 2026-02-17T08:28:11.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:28:12.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:28:12.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:28:12.210 ERROR:teuthology.orchestra.connection:Error authenticating with trial036.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2026-02-17T08:28:12.215 ERROR:teuthology.orchestra.connection:Error authenticating with trial040.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2026-02-17T08:28:15.040 WARNING:teuthology.provision.fog.trial195:[Errno None] Unable to connect to port 22 on 10.20.193.195 2026-02-17T08:28:21.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:28:24.128 WARNING:teuthology.provision.fog.trial195:[Errno None] Unable to connect to port 22 on 10.20.193.195 2026-02-17T08:28:30.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:28:33.216 WARNING:teuthology.provision.fog.trial195:[Errno None] Unable to connect to port 22 on 10.20.193.195 2026-02-17T08:28:39.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:28:42.304 WARNING:teuthology.provision.fog.trial195:[Errno None] Unable to connect to port 22 on 10.20.193.195 2026-02-17T08:28:48.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:28:51.392 WARNING:teuthology.provision.fog.trial195:[Errno None] Unable to connect to port 22 on 10.20.193.195 2026-02-17T08:28:57.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:29:16.213 WARNING:teuthology.provision.fog.trial036:timed out 2026-02-17T08:29:16.216 WARNING:teuthology.provision.fog.trial040:timed out 2026-02-17T08:29:22.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:29:22.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:29:24.419 ERROR:teuthology.orchestra.connection:Error authenticating with trial040.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-17T08:29:27.491 ERROR:teuthology.orchestra.connection:Error authenticating with trial036.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-17T08:29:28.543 ERROR:teuthology.orchestra.connection:Error authenticating with trial040.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-17T08:29:31.653 ERROR:teuthology.orchestra.connection:Error authenticating with trial036.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-17T08:29:33.578 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-17T08:29:33.579 DEBUG:teuthology.orchestra.run.trial195:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-17T08:29:33.778 INFO:teuthology.provision.fog.trial195:Node is ready 2026-02-17T08:29:33.778 DEBUG:teuthology.orchestra.run.trial195:> hostname 2026-02-17T08:29:33.839 INFO:teuthology.orchestra.run.trial195.stdout:trial195.front.sepia.ceph.com 2026-02-17T08:29:33.839 DEBUG:teuthology.orchestra.run.trial195:> grep trial195.front.sepia.ceph.com /etc/hosts 2026-02-17T08:29:33.901 INFO:teuthology.orchestra.run.trial195.stdout:10.20.193.195 trial195.front.sepia.ceph.com trial195 2026-02-17T08:29:33.901 DEBUG:teuthology.orchestra.run.trial195:> sudo hostname trial195 2026-02-17T08:29:33.977 DEBUG:teuthology.orchestra.run.trial195:> sudo sed -i -e 's/trial195.front.sepia.ceph.com/trial195/g' /etc/hosts 2026-02-17T08:29:34.045 DEBUG:teuthology.orchestra.run.trial195:> sudo sed -i -e 's/10.20.193.195/10.20.193.195/g' /etc/hosts 2026-02-17T08:29:34.110 DEBUG:teuthology.orchestra.run.trial195:> sudo sed -i -e 's/trial195.front.sepia.ceph.com/trial195/g' /etc/hostname 2026-02-17T08:29:34.175 DEBUG:teuthology.orchestra.run.trial195:> sudo hostname trial195 2026-02-17T08:29:34.239 DEBUG:teuthology.orchestra.run.trial195:> cat /etc/os-release 2026-02-17T08:29:34.296 INFO:teuthology.orchestra.run.trial195.stdout:NAME="CentOS Stream" 2026-02-17T08:29:34.296 INFO:teuthology.orchestra.run.trial195.stdout:VERSION="9" 2026-02-17T08:29:34.296 INFO:teuthology.orchestra.run.trial195.stdout:ID="centos" 2026-02-17T08:29:34.296 INFO:teuthology.orchestra.run.trial195.stdout:ID_LIKE="rhel fedora" 2026-02-17T08:29:34.297 INFO:teuthology.orchestra.run.trial195.stdout:VERSION_ID="9" 2026-02-17T08:29:34.297 INFO:teuthology.orchestra.run.trial195.stdout:PLATFORM_ID="platform:el9" 2026-02-17T08:29:34.297 INFO:teuthology.orchestra.run.trial195.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T08:29:34.297 INFO:teuthology.orchestra.run.trial195.stdout:ANSI_COLOR="0;31" 2026-02-17T08:29:34.297 INFO:teuthology.orchestra.run.trial195.stdout:LOGO="fedora-logo-icon" 2026-02-17T08:29:34.297 INFO:teuthology.orchestra.run.trial195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T08:29:34.297 INFO:teuthology.orchestra.run.trial195.stdout:HOME_URL="https://centos.org/" 2026-02-17T08:29:34.297 INFO:teuthology.orchestra.run.trial195.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T08:29:34.297 INFO:teuthology.orchestra.run.trial195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T08:29:34.297 INFO:teuthology.orchestra.run.trial195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T08:29:34.299 INFO:teuthology.provision.fog.trial195:Deploy complete! 2026-02-17T08:29:34.299 DEBUG:teuthology.parallel:result is None 2026-02-17T08:29:35.699 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-17T08:29:35.699 DEBUG:teuthology.orchestra.run.trial040:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-17T08:29:35.857 INFO:teuthology.provision.fog.trial040:Node is ready 2026-02-17T08:29:35.857 DEBUG:teuthology.orchestra.run.trial040:> hostname 2026-02-17T08:29:35.913 INFO:teuthology.orchestra.run.trial040.stdout:trial040.front.sepia.ceph.com 2026-02-17T08:29:35.914 DEBUG:teuthology.orchestra.run.trial040:> grep trial040.front.sepia.ceph.com /etc/hosts 2026-02-17T08:29:35.970 INFO:teuthology.orchestra.run.trial040.stdout:10.20.193.40 trial040.front.sepia.ceph.com trial040 2026-02-17T08:29:35.970 DEBUG:teuthology.orchestra.run.trial040:> sudo hostname trial040 2026-02-17T08:29:36.039 DEBUG:teuthology.orchestra.run.trial040:> sudo sed -i -e 's/trial040.front.sepia.ceph.com/trial040/g' /etc/hosts 2026-02-17T08:29:36.104 DEBUG:teuthology.orchestra.run.trial040:> sudo sed -i -e 's/10.20.193.40/10.20.193.40/g' /etc/hosts 2026-02-17T08:29:36.168 DEBUG:teuthology.orchestra.run.trial040:> sudo sed -i -e 's/trial040.front.sepia.ceph.com/trial040/g' /etc/hostname 2026-02-17T08:29:36.233 DEBUG:teuthology.orchestra.run.trial040:> sudo hostname trial040 2026-02-17T08:29:36.297 DEBUG:teuthology.orchestra.run.trial040:> cat /etc/os-release 2026-02-17T08:29:36.354 INFO:teuthology.orchestra.run.trial040.stdout:NAME="CentOS Stream" 2026-02-17T08:29:36.354 INFO:teuthology.orchestra.run.trial040.stdout:VERSION="9" 2026-02-17T08:29:36.354 INFO:teuthology.orchestra.run.trial040.stdout:ID="centos" 2026-02-17T08:29:36.354 INFO:teuthology.orchestra.run.trial040.stdout:ID_LIKE="rhel fedora" 2026-02-17T08:29:36.355 INFO:teuthology.orchestra.run.trial040.stdout:VERSION_ID="9" 2026-02-17T08:29:36.355 INFO:teuthology.orchestra.run.trial040.stdout:PLATFORM_ID="platform:el9" 2026-02-17T08:29:36.355 INFO:teuthology.orchestra.run.trial040.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T08:29:36.355 INFO:teuthology.orchestra.run.trial040.stdout:ANSI_COLOR="0;31" 2026-02-17T08:29:36.355 INFO:teuthology.orchestra.run.trial040.stdout:LOGO="fedora-logo-icon" 2026-02-17T08:29:36.355 INFO:teuthology.orchestra.run.trial040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T08:29:36.355 INFO:teuthology.orchestra.run.trial040.stdout:HOME_URL="https://centos.org/" 2026-02-17T08:29:36.355 INFO:teuthology.orchestra.run.trial040.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T08:29:36.355 INFO:teuthology.orchestra.run.trial040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T08:29:36.355 INFO:teuthology.orchestra.run.trial040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T08:29:36.356 INFO:teuthology.provision.fog.trial040:Deploy complete! 2026-02-17T08:29:36.357 DEBUG:teuthology.parallel:result is None 2026-02-17T08:29:38.765 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-17T08:29:38.766 DEBUG:teuthology.orchestra.run.trial036:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-17T08:29:38.939 INFO:teuthology.provision.fog.trial036:Node is ready 2026-02-17T08:29:38.939 DEBUG:teuthology.orchestra.run.trial036:> hostname 2026-02-17T08:29:38.995 INFO:teuthology.orchestra.run.trial036.stdout:trial036.front.sepia.ceph.com 2026-02-17T08:29:38.996 DEBUG:teuthology.orchestra.run.trial036:> grep trial036.front.sepia.ceph.com /etc/hosts 2026-02-17T08:29:39.052 INFO:teuthology.orchestra.run.trial036.stdout:10.20.193.36 trial036.front.sepia.ceph.com trial036 2026-02-17T08:29:39.053 DEBUG:teuthology.orchestra.run.trial036:> sudo hostname trial036 2026-02-17T08:29:39.121 DEBUG:teuthology.orchestra.run.trial036:> sudo sed -i -e 's/trial036.front.sepia.ceph.com/trial036/g' /etc/hosts 2026-02-17T08:29:39.186 DEBUG:teuthology.orchestra.run.trial036:> sudo sed -i -e 's/10.20.193.36/10.20.193.36/g' /etc/hosts 2026-02-17T08:29:39.250 DEBUG:teuthology.orchestra.run.trial036:> sudo sed -i -e 's/trial036.front.sepia.ceph.com/trial036/g' /etc/hostname 2026-02-17T08:29:39.315 DEBUG:teuthology.orchestra.run.trial036:> sudo hostname trial036 2026-02-17T08:29:39.380 DEBUG:teuthology.orchestra.run.trial036:> cat /etc/os-release 2026-02-17T08:29:39.436 INFO:teuthology.orchestra.run.trial036.stdout:NAME="CentOS Stream" 2026-02-17T08:29:39.436 INFO:teuthology.orchestra.run.trial036.stdout:VERSION="9" 2026-02-17T08:29:39.436 INFO:teuthology.orchestra.run.trial036.stdout:ID="centos" 2026-02-17T08:29:39.436 INFO:teuthology.orchestra.run.trial036.stdout:ID_LIKE="rhel fedora" 2026-02-17T08:29:39.436 INFO:teuthology.orchestra.run.trial036.stdout:VERSION_ID="9" 2026-02-17T08:29:39.436 INFO:teuthology.orchestra.run.trial036.stdout:PLATFORM_ID="platform:el9" 2026-02-17T08:29:39.437 INFO:teuthology.orchestra.run.trial036.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T08:29:39.437 INFO:teuthology.orchestra.run.trial036.stdout:ANSI_COLOR="0;31" 2026-02-17T08:29:39.437 INFO:teuthology.orchestra.run.trial036.stdout:LOGO="fedora-logo-icon" 2026-02-17T08:29:39.437 INFO:teuthology.orchestra.run.trial036.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T08:29:39.437 INFO:teuthology.orchestra.run.trial036.stdout:HOME_URL="https://centos.org/" 2026-02-17T08:29:39.437 INFO:teuthology.orchestra.run.trial036.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T08:29:39.437 INFO:teuthology.orchestra.run.trial036.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T08:29:39.437 INFO:teuthology.orchestra.run.trial036.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T08:29:39.438 INFO:teuthology.provision.fog.trial036:Deploy complete! 2026-02-17T08:29:39.438 DEBUG:teuthology.parallel:result is None 2026-02-17T08:29:39.960 INFO:teuthology.lock.ops:Checking trial036.front.sepia.ceph.com 2026-02-17T08:29:39.961 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-17T08:29:40.063 INFO:teuthology.lock.ops:Checking trial040.front.sepia.ceph.com 2026-02-17T08:29:40.064 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-17T08:29:40.125 INFO:teuthology.lock.ops:Checking trial195.front.sepia.ceph.com 2026-02-17T08:29:40.125 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-17T08:29:40.182 INFO:teuthology.lock.ops:Updating [trial036.front.sepia.ceph.com]: set os type and version on server 2026-02-17T08:29:40.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial036.front.sepia.ceph.com' 2026-02-17T08:29:40.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:29:40.242 DEBUG:teuthology.orchestra.run.trial036:> true 2026-02-17T08:29:40.321 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial036.front.sepia.ceph.com' 2026-02-17T08:29:40.322 DEBUG:teuthology.orchestra.run.trial036:> uname -m 2026-02-17T08:29:40.378 INFO:teuthology.orchestra.run.trial036.stdout:x86_64 2026-02-17T08:29:40.379 DEBUG:teuthology.orchestra.run.trial036:> cat /etc/os-release 2026-02-17T08:29:40.435 INFO:teuthology.orchestra.run.trial036.stdout:NAME="CentOS Stream" 2026-02-17T08:29:40.435 INFO:teuthology.orchestra.run.trial036.stdout:VERSION="9" 2026-02-17T08:29:40.435 INFO:teuthology.orchestra.run.trial036.stdout:ID="centos" 2026-02-17T08:29:40.435 INFO:teuthology.orchestra.run.trial036.stdout:ID_LIKE="rhel fedora" 2026-02-17T08:29:40.435 INFO:teuthology.orchestra.run.trial036.stdout:VERSION_ID="9" 2026-02-17T08:29:40.436 INFO:teuthology.orchestra.run.trial036.stdout:PLATFORM_ID="platform:el9" 2026-02-17T08:29:40.436 INFO:teuthology.orchestra.run.trial036.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T08:29:40.436 INFO:teuthology.orchestra.run.trial036.stdout:ANSI_COLOR="0;31" 2026-02-17T08:29:40.436 INFO:teuthology.orchestra.run.trial036.stdout:LOGO="fedora-logo-icon" 2026-02-17T08:29:40.436 INFO:teuthology.orchestra.run.trial036.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T08:29:40.436 INFO:teuthology.orchestra.run.trial036.stdout:HOME_URL="https://centos.org/" 2026-02-17T08:29:40.436 INFO:teuthology.orchestra.run.trial036.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T08:29:40.436 INFO:teuthology.orchestra.run.trial036.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T08:29:40.436 INFO:teuthology.orchestra.run.trial036.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T08:29:40.437 INFO:teuthology.lock.ops:Updating trial036.front.sepia.ceph.com on lock server 2026-02-17T08:29:40.536 INFO:teuthology.lock.ops:Updating [trial040.front.sepia.ceph.com]: set os type and version on server 2026-02-17T08:29:40.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-17T08:29:40.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:29:40.596 DEBUG:teuthology.orchestra.run.trial040:> true 2026-02-17T08:29:40.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-17T08:29:40.677 DEBUG:teuthology.orchestra.run.trial040:> uname -m 2026-02-17T08:29:40.738 INFO:teuthology.orchestra.run.trial040.stdout:x86_64 2026-02-17T08:29:40.739 DEBUG:teuthology.orchestra.run.trial040:> cat /etc/os-release 2026-02-17T08:29:40.798 INFO:teuthology.orchestra.run.trial040.stdout:NAME="CentOS Stream" 2026-02-17T08:29:40.798 INFO:teuthology.orchestra.run.trial040.stdout:VERSION="9" 2026-02-17T08:29:40.798 INFO:teuthology.orchestra.run.trial040.stdout:ID="centos" 2026-02-17T08:29:40.798 INFO:teuthology.orchestra.run.trial040.stdout:ID_LIKE="rhel fedora" 2026-02-17T08:29:40.799 INFO:teuthology.orchestra.run.trial040.stdout:VERSION_ID="9" 2026-02-17T08:29:40.799 INFO:teuthology.orchestra.run.trial040.stdout:PLATFORM_ID="platform:el9" 2026-02-17T08:29:40.799 INFO:teuthology.orchestra.run.trial040.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T08:29:40.799 INFO:teuthology.orchestra.run.trial040.stdout:ANSI_COLOR="0;31" 2026-02-17T08:29:40.799 INFO:teuthology.orchestra.run.trial040.stdout:LOGO="fedora-logo-icon" 2026-02-17T08:29:40.799 INFO:teuthology.orchestra.run.trial040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T08:29:40.799 INFO:teuthology.orchestra.run.trial040.stdout:HOME_URL="https://centos.org/" 2026-02-17T08:29:40.799 INFO:teuthology.orchestra.run.trial040.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T08:29:40.799 INFO:teuthology.orchestra.run.trial040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T08:29:40.799 INFO:teuthology.orchestra.run.trial040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T08:29:40.800 INFO:teuthology.lock.ops:Updating trial040.front.sepia.ceph.com on lock server 2026-02-17T08:29:40.903 INFO:teuthology.lock.ops:Updating [trial195.front.sepia.ceph.com]: set os type and version on server 2026-02-17T08:29:40.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial195.front.sepia.ceph.com' 2026-02-17T08:29:40.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:29:40.967 DEBUG:teuthology.orchestra.run.trial195:> true 2026-02-17T08:29:41.041 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial195.front.sepia.ceph.com' 2026-02-17T08:29:41.041 DEBUG:teuthology.orchestra.run.trial195:> uname -m 2026-02-17T08:29:41.097 INFO:teuthology.orchestra.run.trial195.stdout:x86_64 2026-02-17T08:29:41.097 DEBUG:teuthology.orchestra.run.trial195:> cat /etc/os-release 2026-02-17T08:29:41.153 INFO:teuthology.orchestra.run.trial195.stdout:NAME="CentOS Stream" 2026-02-17T08:29:41.154 INFO:teuthology.orchestra.run.trial195.stdout:VERSION="9" 2026-02-17T08:29:41.154 INFO:teuthology.orchestra.run.trial195.stdout:ID="centos" 2026-02-17T08:29:41.154 INFO:teuthology.orchestra.run.trial195.stdout:ID_LIKE="rhel fedora" 2026-02-17T08:29:41.154 INFO:teuthology.orchestra.run.trial195.stdout:VERSION_ID="9" 2026-02-17T08:29:41.154 INFO:teuthology.orchestra.run.trial195.stdout:PLATFORM_ID="platform:el9" 2026-02-17T08:29:41.154 INFO:teuthology.orchestra.run.trial195.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T08:29:41.154 INFO:teuthology.orchestra.run.trial195.stdout:ANSI_COLOR="0;31" 2026-02-17T08:29:41.154 INFO:teuthology.orchestra.run.trial195.stdout:LOGO="fedora-logo-icon" 2026-02-17T08:29:41.154 INFO:teuthology.orchestra.run.trial195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T08:29:41.155 INFO:teuthology.orchestra.run.trial195.stdout:HOME_URL="https://centos.org/" 2026-02-17T08:29:41.155 INFO:teuthology.orchestra.run.trial195.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T08:29:41.155 INFO:teuthology.orchestra.run.trial195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T08:29:41.155 INFO:teuthology.orchestra.run.trial195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T08:29:41.156 INFO:teuthology.lock.ops:Updating trial195.front.sepia.ceph.com on lock server 2026-02-17T08:29:41.259 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:29:41.355 INFO:teuthology.dispatcher.supervisor:Running job 51155 2026-02-17T08:29:41.355 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_skanta@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51155 --name skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} -- /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51155/orig.config.yaml 2026-02-17T08:29:41.356 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51155 2026-02-17T08:29:41.356 INFO:teuthology.dispatcher.supervisor:Job PID: 3461147 2026-02-17T08:29:41.356 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-17T08:31:41.357 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:33:41.480 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:35:41.571 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:37:41.670 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:39:41.746 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:41:41.848 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:41:41.976 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-17T08:41:42.157 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-17T08:41:42.860 INFO:teuthology.orchestra.console.trial195:Power off 2026-02-17T08:41:42.860 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-17T08:41:42.915 DEBUG:teuthology.orchestra.console.trial195:power off output: Chassis Power Control: Down/Off 2026-02-17T08:41:42.925 INFO:teuthology.orchestra.console.trial036:Power off 2026-02-17T08:41:42.925 DEBUG:teuthology.orchestra.console.trial036:pexpect command: ipmitool -H trial036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-17T08:41:42.937 INFO:teuthology.orchestra.console.trial040:Power off 2026-02-17T08:41:42.937 DEBUG:teuthology.orchestra.console.trial040:pexpect command: ipmitool -H trial040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-17T08:41:42.965 DEBUG:teuthology.orchestra.console.trial036:power off output: Chassis Power Control: Down/Off 2026-02-17T08:41:42.975 DEBUG:teuthology.orchestra.console.trial040:power off output: Chassis Power Control: Down/Off 2026-02-17T08:41:46.915 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T08:41:46.966 DEBUG:teuthology.orchestra.console.trial036:pexpect command: ipmitool -H trial036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T08:41:46.976 DEBUG:teuthology.orchestra.console.trial040:pexpect command: ipmitool -H trial040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T08:41:47.027 DEBUG:teuthology.orchestra.console.trial195:check power output: Chassis Power is on 2026-02-17T08:41:47.077 DEBUG:teuthology.orchestra.console.trial036:check power output: Chassis Power is on 2026-02-17T08:41:47.086 DEBUG:teuthology.orchestra.console.trial040:check power output: Chassis Power is on 2026-02-17T08:41:51.029 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T08:41:51.078 DEBUG:teuthology.orchestra.console.trial036:pexpect command: ipmitool -H trial036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T08:41:51.087 DEBUG:teuthology.orchestra.console.trial040:pexpect command: ipmitool -H trial040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-17T08:41:51.137 DEBUG:teuthology.orchestra.console.trial195:check power output: Chassis Power is off 2026-02-17T08:41:51.137 INFO:teuthology.orchestra.console.trial195:Power off completed 2026-02-17T08:41:51.188 DEBUG:teuthology.orchestra.console.trial036:check power output: Chassis Power is off 2026-02-17T08:41:51.188 INFO:teuthology.orchestra.console.trial036:Power off completed 2026-02-17T08:41:51.196 DEBUG:teuthology.orchestra.console.trial040:check power output: Chassis Power is off 2026-02-17T08:41:51.196 INFO:teuthology.orchestra.console.trial040:Power off completed 2026-02-17T08:41:51.335 INFO:teuthology.lock.ops:unlocked: trial195.front.sepia.ceph.com 2026-02-17T08:41:51.382 INFO:teuthology.lock.ops:unlocked: trial036.front.sepia.ceph.com 2026-02-17T08:41:51.395 INFO:teuthology.lock.ops:unlocked: trial040.front.sepia.ceph.com