2026-02-12T03:50:42.275 INFO:root:teuthology version: 0.0.1.dev31+g5f66ecfb3 2026-02-12T03:50:42.275 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:50:42.347 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:50:42.597 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x79b78fd6a700>, signals=[15]) 2026-02-12T03:50:42.597 INFO:teuthology.lock.ops:Start node 'trial013.front.sepia.ceph.com' reimaging 2026-02-12T03:50:42.598 INFO:teuthology.lock.ops:Updating [trial013.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T03:50:42.598 INFO:teuthology.lock.ops:Updating trial013.front.sepia.ceph.com on lock server 2026-02-12T03:50:42.654 INFO:teuthology.lock.ops:Start node 'trial035.front.sepia.ceph.com' reimaging 2026-02-12T03:50:42.655 INFO:teuthology.lock.ops:Updating [trial035.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T03:50:42.655 INFO:teuthology.lock.ops:Updating trial035.front.sepia.ceph.com on lock server 2026-02-12T03:50:42.713 INFO:teuthology.lock.ops:Start node 'trial080.front.sepia.ceph.com' reimaging 2026-02-12T03:50:42.713 INFO:teuthology.lock.ops:Updating [trial080.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T03:50:42.713 INFO:teuthology.lock.ops:Updating trial080.front.sepia.ceph.com on lock server 2026-02-12T03:50:42.889 DEBUG:teuthology.provision.fog.trial035:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T03:50:42.949 INFO:teuthology.provision.fog.trial035:Scheduling deploy of centos 9.stream 2026-02-12T03:50:42.950 DEBUG:teuthology.provision.fog.trial013:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T03:50:42.999 DEBUG:teuthology.provision.fog.trial080:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T03:50:43.004 INFO:teuthology.provision.fog.trial013:Scheduling deploy of centos 9.stream 2026-02-12T03:50:43.035 INFO:teuthology.provision.fog.trial080:Scheduling deploy of centos 9.stream 2026-02-12T03:50:44.041 INFO:teuthology.orchestra.console.trial035:Power off 2026-02-12T03:50:44.041 DEBUG:teuthology.orchestra.console.trial035:pexpect command: ipmitool -H trial035.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T03:50:44.054 INFO:teuthology.orchestra.console.trial013:Power off 2026-02-12T03:50:44.054 DEBUG:teuthology.orchestra.console.trial013:pexpect command: ipmitool -H trial013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T03:50:44.063 INFO:teuthology.orchestra.console.trial080:Power off 2026-02-12T03:50:44.064 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T03:50:44.082 DEBUG:teuthology.orchestra.console.trial035:power off output: Chassis Power Control: Down/Off 2026-02-12T03:50:44.097 DEBUG:teuthology.orchestra.console.trial013:power off output: Chassis Power Control: Down/Off 2026-02-12T03:50:44.102 DEBUG:teuthology.orchestra.console.trial080:power off output: Chassis Power Control: Down/Off 2026-02-12T03:50:48.087 DEBUG:teuthology.orchestra.console.trial035:pexpect command: ipmitool -H trial035.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T03:50:48.097 DEBUG:teuthology.orchestra.console.trial013:pexpect command: ipmitool -H trial013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T03:50:48.104 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T03:50:48.196 DEBUG:teuthology.orchestra.console.trial035:check power output: Chassis Power is off 2026-02-12T03:50:48.197 INFO:teuthology.orchestra.console.trial035:Power off completed 2026-02-12T03:50:48.205 DEBUG:teuthology.orchestra.console.trial013:check power output: Chassis Power is off 2026-02-12T03:50:48.206 INFO:teuthology.orchestra.console.trial013:Power off completed 2026-02-12T03:50:48.212 DEBUG:teuthology.orchestra.console.trial080:check power output: Chassis Power is off 2026-02-12T03:50:48.213 INFO:teuthology.orchestra.console.trial080:Power off completed 2026-02-12T03:50:48.298 INFO:teuthology.orchestra.console.trial035:Power on 2026-02-12T03:50:48.298 DEBUG:teuthology.orchestra.console.trial035:pexpect command: ipmitool -H trial035.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T03:50:48.307 INFO:teuthology.orchestra.console.trial013:Power on 2026-02-12T03:50:48.307 DEBUG:teuthology.orchestra.console.trial013:pexpect command: ipmitool -H trial013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T03:50:48.315 INFO:teuthology.orchestra.console.trial080:Power on 2026-02-12T03:50:48.316 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T03:50:48.341 DEBUG:teuthology.orchestra.console.trial035:power on output: Chassis Power Control: Up/On 2026-02-12T03:50:48.346 DEBUG:teuthology.orchestra.console.trial013:power on output: Chassis Power Control: Up/On 2026-02-12T03:50:48.358 DEBUG:teuthology.orchestra.console.trial080:power on output: Chassis Power Control: Up/On 2026-02-12T03:50:52.346 DEBUG:teuthology.orchestra.console.trial035:pexpect command: ipmitool -H trial035.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T03:50:52.354 DEBUG:teuthology.orchestra.console.trial013:pexpect command: ipmitool -H trial013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T03:50:52.361 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T03:50:52.456 DEBUG:teuthology.orchestra.console.trial035:check power output: Chassis Power is on 2026-02-12T03:50:52.456 INFO:teuthology.orchestra.console.trial035:Power on completed 2026-02-12T03:50:52.463 DEBUG:teuthology.orchestra.console.trial013:check power output: Chassis Power is on 2026-02-12T03:50:52.463 INFO:teuthology.orchestra.console.trial013:Power on completed 2026-02-12T03:50:52.470 DEBUG:teuthology.orchestra.console.trial080:check power output: Chassis Power is on 2026-02-12T03:50:52.470 INFO:teuthology.orchestra.console.trial080:Power on completed 2026-02-12T03:50:52.558 INFO:teuthology.provision.fog.trial035:Waiting for deploy to finish 2026-02-12T03:50:52.564 INFO:teuthology.provision.fog.trial013:Waiting for deploy to finish 2026-02-12T03:50:52.571 INFO:teuthology.provision.fog.trial080:Waiting for deploy to finish 2026-02-12T03:52:39.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:52:39.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:52:42.845 WARNING:teuthology.provision.fog.trial035:[Errno None] Unable to connect to port 22 on 10.20.193.35 2026-02-12T03:52:48.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:52:51.933 WARNING:teuthology.provision.fog.trial035:[Errno None] Unable to connect to port 22 on 10.20.193.35 2026-02-12T03:52:55.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:52:57.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:52:58.141 WARNING:teuthology.provision.fog.trial013:[Errno None] Unable to connect to port 22 on 10.20.193.13 2026-02-12T03:53:01.021 WARNING:teuthology.provision.fog.trial035:[Errno None] Unable to connect to port 22 on 10.20.193.35 2026-02-12T03:53:04.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:53:07.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:53:07.229 WARNING:teuthology.provision.fog.trial013:[Errno None] Unable to connect to port 22 on 10.20.193.13 2026-02-12T03:53:10.109 WARNING:teuthology.provision.fog.trial035:[Errno None] Unable to connect to port 22 on 10.20.193.35 2026-02-12T03:53:13.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:53:16.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:53:16.317 WARNING:teuthology.provision.fog.trial013:[Errno None] Unable to connect to port 22 on 10.20.193.13 2026-02-12T03:53:22.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:53:39.716 WARNING:teuthology.provision.fog.trial080:timed out 2026-02-12T03:53:45.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:53:45.858 ERROR:teuthology.orchestra.connection:Error authenticating with trial080.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-12T03:53:49.952 ERROR:teuthology.orchestra.connection:Error authenticating with trial080.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-12T03:53:52.109 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T03:53:52.110 DEBUG:teuthology.orchestra.run.trial035:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T03:53:52.346 INFO:teuthology.provision.fog.trial035:Node is ready 2026-02-12T03:53:52.347 DEBUG:teuthology.orchestra.run.trial035:> hostname 2026-02-12T03:53:52.404 INFO:teuthology.orchestra.run.trial035.stdout:trial035.front.sepia.ceph.com 2026-02-12T03:53:52.404 DEBUG:teuthology.orchestra.run.trial035:> grep trial035.front.sepia.ceph.com /etc/hosts 2026-02-12T03:53:52.461 INFO:teuthology.orchestra.run.trial035.stdout:10.20.193.35 trial035.front.sepia.ceph.com trial035 2026-02-12T03:53:52.461 DEBUG:teuthology.orchestra.run.trial035:> sudo hostname trial035 2026-02-12T03:53:52.532 DEBUG:teuthology.orchestra.run.trial035:> sudo sed -i -e 's/trial035.front.sepia.ceph.com/trial035/g' /etc/hosts 2026-02-12T03:53:52.599 DEBUG:teuthology.orchestra.run.trial035:> sudo sed -i -e 's/10.20.193.35/10.20.193.35/g' /etc/hosts 2026-02-12T03:53:52.664 DEBUG:teuthology.orchestra.run.trial035:> sudo sed -i -e 's/trial035.front.sepia.ceph.com/trial035/g' /etc/hostname 2026-02-12T03:53:52.730 DEBUG:teuthology.orchestra.run.trial035:> sudo hostname trial035 2026-02-12T03:53:52.793 DEBUG:teuthology.orchestra.run.trial035:> cat /etc/os-release 2026-02-12T03:53:52.850 INFO:teuthology.orchestra.run.trial035.stdout:NAME="CentOS Stream" 2026-02-12T03:53:52.851 INFO:teuthology.orchestra.run.trial035.stdout:VERSION="9" 2026-02-12T03:53:52.851 INFO:teuthology.orchestra.run.trial035.stdout:ID="centos" 2026-02-12T03:53:52.851 INFO:teuthology.orchestra.run.trial035.stdout:ID_LIKE="rhel fedora" 2026-02-12T03:53:52.851 INFO:teuthology.orchestra.run.trial035.stdout:VERSION_ID="9" 2026-02-12T03:53:52.851 INFO:teuthology.orchestra.run.trial035.stdout:PLATFORM_ID="platform:el9" 2026-02-12T03:53:52.851 INFO:teuthology.orchestra.run.trial035.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T03:53:52.851 INFO:teuthology.orchestra.run.trial035.stdout:ANSI_COLOR="0;31" 2026-02-12T03:53:52.851 INFO:teuthology.orchestra.run.trial035.stdout:LOGO="fedora-logo-icon" 2026-02-12T03:53:52.851 INFO:teuthology.orchestra.run.trial035.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T03:53:52.851 INFO:teuthology.orchestra.run.trial035.stdout:HOME_URL="https://centos.org/" 2026-02-12T03:53:52.852 INFO:teuthology.orchestra.run.trial035.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T03:53:52.852 INFO:teuthology.orchestra.run.trial035.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T03:53:52.852 INFO:teuthology.orchestra.run.trial035.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T03:53:52.853 INFO:teuthology.provision.fog.trial035:Deploy complete! 2026-02-12T03:53:52.853 DEBUG:teuthology.parallel:result is None 2026-02-12T03:53:57.064 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T03:53:57.064 DEBUG:teuthology.orchestra.run.trial080:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T03:53:57.233 INFO:teuthology.provision.fog.trial080:Node is ready 2026-02-12T03:53:57.234 DEBUG:teuthology.orchestra.run.trial080:> hostname 2026-02-12T03:53:57.290 INFO:teuthology.orchestra.run.trial080.stdout:trial080.front.sepia.ceph.com 2026-02-12T03:53:57.290 DEBUG:teuthology.orchestra.run.trial080:> grep trial080.front.sepia.ceph.com /etc/hosts 2026-02-12T03:53:57.346 INFO:teuthology.orchestra.run.trial080.stdout:10.20.193.80 trial080.front.sepia.ceph.com trial080 2026-02-12T03:53:57.346 DEBUG:teuthology.orchestra.run.trial080:> sudo hostname trial080 2026-02-12T03:53:57.415 DEBUG:teuthology.orchestra.run.trial080:> sudo sed -i -e 's/trial080.front.sepia.ceph.com/trial080/g' /etc/hosts 2026-02-12T03:53:57.479 DEBUG:teuthology.orchestra.run.trial080:> sudo sed -i -e 's/10.20.193.80/10.20.193.80/g' /etc/hosts 2026-02-12T03:53:57.543 DEBUG:teuthology.orchestra.run.trial080:> sudo sed -i -e 's/trial080.front.sepia.ceph.com/trial080/g' /etc/hostname 2026-02-12T03:53:57.607 DEBUG:teuthology.orchestra.run.trial080:> sudo hostname trial080 2026-02-12T03:53:57.671 DEBUG:teuthology.orchestra.run.trial080:> cat /etc/os-release 2026-02-12T03:53:57.727 INFO:teuthology.orchestra.run.trial080.stdout:NAME="CentOS Stream" 2026-02-12T03:53:57.727 INFO:teuthology.orchestra.run.trial080.stdout:VERSION="9" 2026-02-12T03:53:57.727 INFO:teuthology.orchestra.run.trial080.stdout:ID="centos" 2026-02-12T03:53:57.727 INFO:teuthology.orchestra.run.trial080.stdout:ID_LIKE="rhel fedora" 2026-02-12T03:53:57.727 INFO:teuthology.orchestra.run.trial080.stdout:VERSION_ID="9" 2026-02-12T03:53:57.727 INFO:teuthology.orchestra.run.trial080.stdout:PLATFORM_ID="platform:el9" 2026-02-12T03:53:57.728 INFO:teuthology.orchestra.run.trial080.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T03:53:57.728 INFO:teuthology.orchestra.run.trial080.stdout:ANSI_COLOR="0;31" 2026-02-12T03:53:57.728 INFO:teuthology.orchestra.run.trial080.stdout:LOGO="fedora-logo-icon" 2026-02-12T03:53:57.728 INFO:teuthology.orchestra.run.trial080.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T03:53:57.728 INFO:teuthology.orchestra.run.trial080.stdout:HOME_URL="https://centos.org/" 2026-02-12T03:53:57.728 INFO:teuthology.orchestra.run.trial080.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T03:53:57.728 INFO:teuthology.orchestra.run.trial080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T03:53:57.728 INFO:teuthology.orchestra.run.trial080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T03:53:57.729 INFO:teuthology.provision.fog.trial080:Deploy complete! 2026-02-12T03:53:57.729 DEBUG:teuthology.parallel:result is None 2026-02-12T03:53:58.311 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T03:53:58.311 DEBUG:teuthology.orchestra.run.trial013:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T03:53:58.490 INFO:teuthology.provision.fog.trial013:Node is ready 2026-02-12T03:53:58.491 DEBUG:teuthology.orchestra.run.trial013:> hostname 2026-02-12T03:53:58.547 INFO:teuthology.orchestra.run.trial013.stdout:trial013.front.sepia.ceph.com 2026-02-12T03:53:58.547 DEBUG:teuthology.orchestra.run.trial013:> grep trial013.front.sepia.ceph.com /etc/hosts 2026-02-12T03:53:58.603 INFO:teuthology.orchestra.run.trial013.stdout:10.20.193.13 trial013.front.sepia.ceph.com trial013 2026-02-12T03:53:58.603 DEBUG:teuthology.orchestra.run.trial013:> sudo hostname trial013 2026-02-12T03:53:58.671 DEBUG:teuthology.orchestra.run.trial013:> sudo sed -i -e 's/trial013.front.sepia.ceph.com/trial013/g' /etc/hosts 2026-02-12T03:53:58.737 DEBUG:teuthology.orchestra.run.trial013:> sudo sed -i -e 's/10.20.193.13/10.20.193.13/g' /etc/hosts 2026-02-12T03:53:58.802 DEBUG:teuthology.orchestra.run.trial013:> sudo sed -i -e 's/trial013.front.sepia.ceph.com/trial013/g' /etc/hostname 2026-02-12T03:53:58.866 DEBUG:teuthology.orchestra.run.trial013:> sudo hostname trial013 2026-02-12T03:53:58.929 DEBUG:teuthology.orchestra.run.trial013:> cat /etc/os-release 2026-02-12T03:53:58.985 INFO:teuthology.orchestra.run.trial013.stdout:NAME="CentOS Stream" 2026-02-12T03:53:58.985 INFO:teuthology.orchestra.run.trial013.stdout:VERSION="9" 2026-02-12T03:53:58.985 INFO:teuthology.orchestra.run.trial013.stdout:ID="centos" 2026-02-12T03:53:58.985 INFO:teuthology.orchestra.run.trial013.stdout:ID_LIKE="rhel fedora" 2026-02-12T03:53:58.985 INFO:teuthology.orchestra.run.trial013.stdout:VERSION_ID="9" 2026-02-12T03:53:58.985 INFO:teuthology.orchestra.run.trial013.stdout:PLATFORM_ID="platform:el9" 2026-02-12T03:53:58.985 INFO:teuthology.orchestra.run.trial013.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T03:53:58.986 INFO:teuthology.orchestra.run.trial013.stdout:ANSI_COLOR="0;31" 2026-02-12T03:53:58.986 INFO:teuthology.orchestra.run.trial013.stdout:LOGO="fedora-logo-icon" 2026-02-12T03:53:58.986 INFO:teuthology.orchestra.run.trial013.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T03:53:58.986 INFO:teuthology.orchestra.run.trial013.stdout:HOME_URL="https://centos.org/" 2026-02-12T03:53:58.986 INFO:teuthology.orchestra.run.trial013.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T03:53:58.986 INFO:teuthology.orchestra.run.trial013.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T03:53:58.986 INFO:teuthology.orchestra.run.trial013.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T03:53:58.987 INFO:teuthology.provision.fog.trial013:Deploy complete! 2026-02-12T03:53:58.987 DEBUG:teuthology.parallel:result is None 2026-02-12T03:53:59.532 INFO:teuthology.lock.ops:Checking trial013.front.sepia.ceph.com 2026-02-12T03:53:59.532 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T03:53:59.639 INFO:teuthology.lock.ops:Checking trial035.front.sepia.ceph.com 2026-02-12T03:53:59.639 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T03:53:59.707 INFO:teuthology.lock.ops:Checking trial080.front.sepia.ceph.com 2026-02-12T03:53:59.707 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T03:53:59.764 INFO:teuthology.lock.ops:Updating [trial013.front.sepia.ceph.com]: set os type and version on server 2026-02-12T03:53:59.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T03:53:59.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:53:59.824 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T03:53:59.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T03:53:59.895 DEBUG:teuthology.orchestra.run.trial013:> uname -m 2026-02-12T03:53:59.949 INFO:teuthology.orchestra.run.trial013.stdout:x86_64 2026-02-12T03:53:59.950 DEBUG:teuthology.orchestra.run.trial013:> cat /etc/os-release 2026-02-12T03:54:00.005 INFO:teuthology.orchestra.run.trial013.stdout:NAME="CentOS Stream" 2026-02-12T03:54:00.006 INFO:teuthology.orchestra.run.trial013.stdout:VERSION="9" 2026-02-12T03:54:00.006 INFO:teuthology.orchestra.run.trial013.stdout:ID="centos" 2026-02-12T03:54:00.006 INFO:teuthology.orchestra.run.trial013.stdout:ID_LIKE="rhel fedora" 2026-02-12T03:54:00.006 INFO:teuthology.orchestra.run.trial013.stdout:VERSION_ID="9" 2026-02-12T03:54:00.006 INFO:teuthology.orchestra.run.trial013.stdout:PLATFORM_ID="platform:el9" 2026-02-12T03:54:00.006 INFO:teuthology.orchestra.run.trial013.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T03:54:00.006 INFO:teuthology.orchestra.run.trial013.stdout:ANSI_COLOR="0;31" 2026-02-12T03:54:00.006 INFO:teuthology.orchestra.run.trial013.stdout:LOGO="fedora-logo-icon" 2026-02-12T03:54:00.006 INFO:teuthology.orchestra.run.trial013.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T03:54:00.006 INFO:teuthology.orchestra.run.trial013.stdout:HOME_URL="https://centos.org/" 2026-02-12T03:54:00.007 INFO:teuthology.orchestra.run.trial013.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T03:54:00.007 INFO:teuthology.orchestra.run.trial013.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T03:54:00.007 INFO:teuthology.orchestra.run.trial013.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T03:54:00.007 INFO:teuthology.lock.ops:Updating trial013.front.sepia.ceph.com on lock server 2026-02-12T03:54:00.109 INFO:teuthology.lock.ops:Updating [trial035.front.sepia.ceph.com]: set os type and version on server 2026-02-12T03:54:00.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial035.front.sepia.ceph.com' 2026-02-12T03:54:00.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:54:00.180 DEBUG:teuthology.orchestra.run.trial035:> true 2026-02-12T03:54:00.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial035.front.sepia.ceph.com' 2026-02-12T03:54:00.255 DEBUG:teuthology.orchestra.run.trial035:> uname -m 2026-02-12T03:54:00.310 INFO:teuthology.orchestra.run.trial035.stdout:x86_64 2026-02-12T03:54:00.311 DEBUG:teuthology.orchestra.run.trial035:> cat /etc/os-release 2026-02-12T03:54:00.366 INFO:teuthology.orchestra.run.trial035.stdout:NAME="CentOS Stream" 2026-02-12T03:54:00.367 INFO:teuthology.orchestra.run.trial035.stdout:VERSION="9" 2026-02-12T03:54:00.367 INFO:teuthology.orchestra.run.trial035.stdout:ID="centos" 2026-02-12T03:54:00.367 INFO:teuthology.orchestra.run.trial035.stdout:ID_LIKE="rhel fedora" 2026-02-12T03:54:00.367 INFO:teuthology.orchestra.run.trial035.stdout:VERSION_ID="9" 2026-02-12T03:54:00.367 INFO:teuthology.orchestra.run.trial035.stdout:PLATFORM_ID="platform:el9" 2026-02-12T03:54:00.367 INFO:teuthology.orchestra.run.trial035.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T03:54:00.367 INFO:teuthology.orchestra.run.trial035.stdout:ANSI_COLOR="0;31" 2026-02-12T03:54:00.367 INFO:teuthology.orchestra.run.trial035.stdout:LOGO="fedora-logo-icon" 2026-02-12T03:54:00.367 INFO:teuthology.orchestra.run.trial035.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T03:54:00.367 INFO:teuthology.orchestra.run.trial035.stdout:HOME_URL="https://centos.org/" 2026-02-12T03:54:00.367 INFO:teuthology.orchestra.run.trial035.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T03:54:00.368 INFO:teuthology.orchestra.run.trial035.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T03:54:00.368 INFO:teuthology.orchestra.run.trial035.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T03:54:00.368 INFO:teuthology.lock.ops:Updating trial035.front.sepia.ceph.com on lock server 2026-02-12T03:54:00.470 INFO:teuthology.lock.ops:Updating [trial080.front.sepia.ceph.com]: set os type and version on server 2026-02-12T03:54:00.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial080.front.sepia.ceph.com' 2026-02-12T03:54:00.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:54:00.534 DEBUG:teuthology.orchestra.run.trial080:> true 2026-02-12T03:54:00.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial080.front.sepia.ceph.com' 2026-02-12T03:54:00.606 DEBUG:teuthology.orchestra.run.trial080:> uname -m 2026-02-12T03:54:00.661 INFO:teuthology.orchestra.run.trial080.stdout:x86_64 2026-02-12T03:54:00.662 DEBUG:teuthology.orchestra.run.trial080:> cat /etc/os-release 2026-02-12T03:54:00.718 INFO:teuthology.orchestra.run.trial080.stdout:NAME="CentOS Stream" 2026-02-12T03:54:00.718 INFO:teuthology.orchestra.run.trial080.stdout:VERSION="9" 2026-02-12T03:54:00.718 INFO:teuthology.orchestra.run.trial080.stdout:ID="centos" 2026-02-12T03:54:00.718 INFO:teuthology.orchestra.run.trial080.stdout:ID_LIKE="rhel fedora" 2026-02-12T03:54:00.718 INFO:teuthology.orchestra.run.trial080.stdout:VERSION_ID="9" 2026-02-12T03:54:00.718 INFO:teuthology.orchestra.run.trial080.stdout:PLATFORM_ID="platform:el9" 2026-02-12T03:54:00.718 INFO:teuthology.orchestra.run.trial080.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T03:54:00.718 INFO:teuthology.orchestra.run.trial080.stdout:ANSI_COLOR="0;31" 2026-02-12T03:54:00.719 INFO:teuthology.orchestra.run.trial080.stdout:LOGO="fedora-logo-icon" 2026-02-12T03:54:00.719 INFO:teuthology.orchestra.run.trial080.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T03:54:00.719 INFO:teuthology.orchestra.run.trial080.stdout:HOME_URL="https://centos.org/" 2026-02-12T03:54:00.719 INFO:teuthology.orchestra.run.trial080.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T03:54:00.719 INFO:teuthology.orchestra.run.trial080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T03:54:00.719 INFO:teuthology.orchestra.run.trial080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T03:54:00.720 INFO:teuthology.lock.ops:Updating trial080.front.sepia.ceph.com on lock server 2026-02-12T03:54:00.821 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:54:00.915 INFO:teuthology.dispatcher.supervisor:Running job 45788 2026-02-12T03:54:00.915 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45788 --name yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds} ec_optimizations/ec_optimizations_on mon_election/classic msgr-failures/osd-dispatch-delay objectstore/{bluestore/{alloc$/{hybrid} base mem$/{normal-1} onode-segment$/{512K} write$/{random/{compr$/{no$/{no}} random}}}} rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} -- /home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45788/orig.config.yaml 2026-02-12T03:54:00.915 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45788 2026-02-12T03:54:00.915 INFO:teuthology.dispatcher.supervisor:Job PID: 2702028 2026-02-12T03:54:00.915 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-12T03:56:00.938 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:58:01.133 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:00:01.311 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:02:01.504 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:04:01.678 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:04:01.761 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-12T04:04:01.929 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-12T04:04:02.667 INFO:teuthology.orchestra.console.trial013:Power off 2026-02-12T04:04:02.667 DEBUG:teuthology.orchestra.console.trial013:pexpect command: ipmitool -H trial013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T04:04:02.678 INFO:teuthology.orchestra.console.trial035:Power off 2026-02-12T04:04:02.679 DEBUG:teuthology.orchestra.console.trial035:pexpect command: ipmitool -H trial035.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T04:04:02.688 INFO:teuthology.orchestra.console.trial080:Power off 2026-02-12T04:04:02.688 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T04:04:02.706 DEBUG:teuthology.orchestra.console.trial013:power off output: Chassis Power Control: Down/Off 2026-02-12T04:04:02.716 DEBUG:teuthology.orchestra.console.trial035:power off output: Chassis Power Control: Down/Off 2026-02-12T04:04:02.724 DEBUG:teuthology.orchestra.console.trial080:power off output: Chassis Power Control: Down/Off 2026-02-12T04:04:06.712 DEBUG:teuthology.orchestra.console.trial013:pexpect command: ipmitool -H trial013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T04:04:06.718 DEBUG:teuthology.orchestra.console.trial035:pexpect command: ipmitool -H trial035.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T04:04:06.725 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T04:04:06.821 DEBUG:teuthology.orchestra.console.trial013:check power output: Chassis Power is on 2026-02-12T04:04:06.827 DEBUG:teuthology.orchestra.console.trial035:check power output: Chassis Power is on 2026-02-12T04:04:06.832 DEBUG:teuthology.orchestra.console.trial080:check power output: Chassis Power is on 2026-02-12T04:04:10.826 DEBUG:teuthology.orchestra.console.trial013:pexpect command: ipmitool -H trial013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T04:04:10.834 DEBUG:teuthology.orchestra.console.trial035:pexpect command: ipmitool -H trial035.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T04:04:10.841 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T04:04:10.936 DEBUG:teuthology.orchestra.console.trial013:check power output: Chassis Power is off 2026-02-12T04:04:10.937 INFO:teuthology.orchestra.console.trial013:Power off completed 2026-02-12T04:04:10.943 DEBUG:teuthology.orchestra.console.trial035:check power output: Chassis Power is off 2026-02-12T04:04:10.943 INFO:teuthology.orchestra.console.trial035:Power off completed 2026-02-12T04:04:10.951 DEBUG:teuthology.orchestra.console.trial080:check power output: Chassis Power is off 2026-02-12T04:04:10.951 INFO:teuthology.orchestra.console.trial080:Power off completed 2026-02-12T04:04:11.230 INFO:teuthology.lock.ops:unlocked: trial013.front.sepia.ceph.com 2026-02-12T04:04:11.240 INFO:teuthology.lock.ops:unlocked: trial035.front.sepia.ceph.com 2026-02-12T04:04:11.244 INFO:teuthology.lock.ops:unlocked: trial080.front.sepia.ceph.com