2026-02-12T10:18:28.554 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062 2026-02-12T10:18:28.554 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:18:28.626 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:18:28.822 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x76d7e7980d60>, signals=[15]) 2026-02-12T10:18:28.822 INFO:teuthology.lock.ops:Start node 'trial043.front.sepia.ceph.com' reimaging 2026-02-12T10:18:28.822 INFO:teuthology.lock.ops:Updating [trial043.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T10:18:28.822 INFO:teuthology.lock.ops:Updating trial043.front.sepia.ceph.com on lock server 2026-02-12T10:18:28.880 INFO:teuthology.lock.ops:Start node 'trial123.front.sepia.ceph.com' reimaging 2026-02-12T10:18:28.880 INFO:teuthology.lock.ops:Updating [trial123.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T10:18:28.880 INFO:teuthology.lock.ops:Updating trial123.front.sepia.ceph.com on lock server 2026-02-12T10:18:29.135 DEBUG:teuthology.provision.fog.trial043:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T10:18:29.141 DEBUG:teuthology.provision.fog.trial123:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T10:18:29.187 INFO:teuthology.provision.fog.trial043:Scheduling deploy of centos 9.stream 2026-02-12T10:18:29.193 INFO:teuthology.provision.fog.trial123:Scheduling deploy of centos 9.stream 2026-02-12T10:18:30.327 INFO:teuthology.orchestra.console.trial123:Power off 2026-02-12T10:18:30.327 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T10:18:30.346 INFO:teuthology.orchestra.console.trial043:Power off 2026-02-12T10:18:30.346 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T10:18:30.366 DEBUG:teuthology.orchestra.console.trial123:power off output: Chassis Power Control: Down/Off 2026-02-12T10:18:30.386 DEBUG:teuthology.orchestra.console.trial043:power off output: Chassis Power Control: Down/Off 2026-02-12T10:18:34.371 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:18:34.386 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:18:34.480 DEBUG:teuthology.orchestra.console.trial123:check power output: Chassis Power is off 2026-02-12T10:18:34.480 INFO:teuthology.orchestra.console.trial123:Power off completed 2026-02-12T10:18:34.494 DEBUG:teuthology.orchestra.console.trial043:check power output: Chassis Power is off 2026-02-12T10:18:34.494 INFO:teuthology.orchestra.console.trial043:Power off completed 2026-02-12T10:18:34.581 INFO:teuthology.orchestra.console.trial123:Power on 2026-02-12T10:18:34.581 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T10:18:34.595 INFO:teuthology.orchestra.console.trial043:Power on 2026-02-12T10:18:34.595 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T10:18:34.627 DEBUG:teuthology.orchestra.console.trial123:power on output: Chassis Power Control: Up/On 2026-02-12T10:18:34.635 DEBUG:teuthology.orchestra.console.trial043:power on output: Chassis Power Control: Up/On 2026-02-12T10:18:38.632 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:18:38.640 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:18:38.742 DEBUG:teuthology.orchestra.console.trial123:check power output: Chassis Power is on 2026-02-12T10:18:38.742 INFO:teuthology.orchestra.console.trial123:Power on completed 2026-02-12T10:18:38.748 DEBUG:teuthology.orchestra.console.trial043:check power output: Chassis Power is on 2026-02-12T10:18:38.748 INFO:teuthology.orchestra.console.trial043:Power on completed 2026-02-12T10:18:38.843 INFO:teuthology.provision.fog.trial123:Waiting for deploy to finish 2026-02-12T10:18:38.849 INFO:teuthology.provision.fog.trial043:Waiting for deploy to finish 2026-02-12T10:20:26.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:20:26.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:20:29.341 WARNING:teuthology.provision.fog.trial043:[Errno None] Unable to connect to port 22 on 10.20.193.43 2026-02-12T10:20:35.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:20:38.429 WARNING:teuthology.provision.fog.trial043:[Errno None] Unable to connect to port 22 on 10.20.193.43 2026-02-12T10:20:44.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:20:47.517 WARNING:teuthology.provision.fog.trial043:[Errno None] Unable to connect to port 22 on 10.20.193.43 2026-02-12T10:20:53.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:20:56.605 WARNING:teuthology.provision.fog.trial043:[Errno None] Unable to connect to port 22 on 10.20.193.43 2026-02-12T10:21:02.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:21:26.246 WARNING:teuthology.provision.fog.trial123:timed out 2026-02-12T10:21:32.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:21:38.474 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T10:21:38.474 DEBUG:teuthology.orchestra.run.trial043:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T10:21:38.634 INFO:teuthology.provision.fog.trial043:Node is ready 2026-02-12T10:21:38.634 DEBUG:teuthology.orchestra.run.trial043:> hostname 2026-02-12T10:21:38.691 INFO:teuthology.orchestra.run.trial043.stdout:trial043.front.sepia.ceph.com 2026-02-12T10:21:38.692 DEBUG:teuthology.orchestra.run.trial043:> grep trial043.front.sepia.ceph.com /etc/hosts 2026-02-12T10:21:38.748 INFO:teuthology.orchestra.run.trial043.stdout:10.20.193.43 trial043.front.sepia.ceph.com trial043 2026-02-12T10:21:38.748 DEBUG:teuthology.orchestra.run.trial043:> sudo hostname trial043 2026-02-12T10:21:38.825 DEBUG:teuthology.orchestra.run.trial043:> sudo sed -i -e 's/trial043.front.sepia.ceph.com/trial043/g' /etc/hosts 2026-02-12T10:21:38.892 DEBUG:teuthology.orchestra.run.trial043:> sudo sed -i -e 's/10.20.193.43/10.20.193.43/g' /etc/hosts 2026-02-12T10:21:38.958 DEBUG:teuthology.orchestra.run.trial043:> sudo sed -i -e 's/trial043.front.sepia.ceph.com/trial043/g' /etc/hostname 2026-02-12T10:21:39.023 DEBUG:teuthology.orchestra.run.trial043:> sudo hostname trial043 2026-02-12T10:21:39.087 DEBUG:teuthology.orchestra.run.trial043:> cat /etc/os-release 2026-02-12T10:21:39.145 INFO:teuthology.orchestra.run.trial043.stdout:NAME="CentOS Stream" 2026-02-12T10:21:39.145 INFO:teuthology.orchestra.run.trial043.stdout:VERSION="9" 2026-02-12T10:21:39.145 INFO:teuthology.orchestra.run.trial043.stdout:ID="centos" 2026-02-12T10:21:39.145 INFO:teuthology.orchestra.run.trial043.stdout:ID_LIKE="rhel fedora" 2026-02-12T10:21:39.145 INFO:teuthology.orchestra.run.trial043.stdout:VERSION_ID="9" 2026-02-12T10:21:39.145 INFO:teuthology.orchestra.run.trial043.stdout:PLATFORM_ID="platform:el9" 2026-02-12T10:21:39.146 INFO:teuthology.orchestra.run.trial043.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T10:21:39.146 INFO:teuthology.orchestra.run.trial043.stdout:ANSI_COLOR="0;31" 2026-02-12T10:21:39.146 INFO:teuthology.orchestra.run.trial043.stdout:LOGO="fedora-logo-icon" 2026-02-12T10:21:39.146 INFO:teuthology.orchestra.run.trial043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T10:21:39.146 INFO:teuthology.orchestra.run.trial043.stdout:HOME_URL="https://centos.org/" 2026-02-12T10:21:39.146 INFO:teuthology.orchestra.run.trial043.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T10:21:39.146 INFO:teuthology.orchestra.run.trial043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T10:21:39.146 INFO:teuthology.orchestra.run.trial043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T10:21:39.147 INFO:teuthology.provision.fog.trial043:Deploy complete! 2026-02-12T10:21:39.148 DEBUG:teuthology.parallel:result is None 2026-02-12T10:21:39.821 ERROR:teuthology.orchestra.connection:Error authenticating with trial123.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-12T10:21:43.954 ERROR:teuthology.orchestra.connection:Error authenticating with trial123.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-12T10:21:51.059 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T10:21:51.059 DEBUG:teuthology.orchestra.run.trial123:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T10:21:51.211 INFO:teuthology.provision.fog.trial123:Node is ready 2026-02-12T10:21:51.211 DEBUG:teuthology.orchestra.run.trial123:> hostname 2026-02-12T10:21:51.268 INFO:teuthology.orchestra.run.trial123.stdout:trial123.front.sepia.ceph.com 2026-02-12T10:21:51.268 DEBUG:teuthology.orchestra.run.trial123:> grep trial123.front.sepia.ceph.com /etc/hosts 2026-02-12T10:21:51.325 INFO:teuthology.orchestra.run.trial123.stdout:10.20.193.123 trial123.front.sepia.ceph.com trial123 2026-02-12T10:21:51.325 DEBUG:teuthology.orchestra.run.trial123:> sudo hostname trial123 2026-02-12T10:21:51.394 DEBUG:teuthology.orchestra.run.trial123:> sudo sed -i -e 's/trial123.front.sepia.ceph.com/trial123/g' /etc/hosts 2026-02-12T10:21:51.458 DEBUG:teuthology.orchestra.run.trial123:> sudo sed -i -e 's/10.20.193.123/10.20.193.123/g' /etc/hosts 2026-02-12T10:21:51.523 DEBUG:teuthology.orchestra.run.trial123:> sudo sed -i -e 's/trial123.front.sepia.ceph.com/trial123/g' /etc/hostname 2026-02-12T10:21:51.586 DEBUG:teuthology.orchestra.run.trial123:> sudo hostname trial123 2026-02-12T10:21:51.650 DEBUG:teuthology.orchestra.run.trial123:> cat /etc/os-release 2026-02-12T10:21:51.707 INFO:teuthology.orchestra.run.trial123.stdout:NAME="CentOS Stream" 2026-02-12T10:21:51.707 INFO:teuthology.orchestra.run.trial123.stdout:VERSION="9" 2026-02-12T10:21:51.707 INFO:teuthology.orchestra.run.trial123.stdout:ID="centos" 2026-02-12T10:21:51.707 INFO:teuthology.orchestra.run.trial123.stdout:ID_LIKE="rhel fedora" 2026-02-12T10:21:51.707 INFO:teuthology.orchestra.run.trial123.stdout:VERSION_ID="9" 2026-02-12T10:21:51.707 INFO:teuthology.orchestra.run.trial123.stdout:PLATFORM_ID="platform:el9" 2026-02-12T10:21:51.707 INFO:teuthology.orchestra.run.trial123.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T10:21:51.707 INFO:teuthology.orchestra.run.trial123.stdout:ANSI_COLOR="0;31" 2026-02-12T10:21:51.708 INFO:teuthology.orchestra.run.trial123.stdout:LOGO="fedora-logo-icon" 2026-02-12T10:21:51.708 INFO:teuthology.orchestra.run.trial123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T10:21:51.708 INFO:teuthology.orchestra.run.trial123.stdout:HOME_URL="https://centos.org/" 2026-02-12T10:21:51.708 INFO:teuthology.orchestra.run.trial123.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T10:21:51.708 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T10:21:51.708 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T10:21:51.708 INFO:teuthology.provision.fog.trial123:Deploy complete! 2026-02-12T10:21:51.709 DEBUG:teuthology.parallel:result is None 2026-02-12T10:21:52.108 INFO:teuthology.lock.ops:Checking trial043.front.sepia.ceph.com 2026-02-12T10:21:52.108 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T10:21:52.208 INFO:teuthology.lock.ops:Checking trial123.front.sepia.ceph.com 2026-02-12T10:21:52.208 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T10:21:52.273 INFO:teuthology.lock.ops:Updating [trial043.front.sepia.ceph.com]: set os type and version on server 2026-02-12T10:21:52.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial043.front.sepia.ceph.com' 2026-02-12T10:21:52.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:21:52.335 DEBUG:teuthology.orchestra.run.trial043:> true 2026-02-12T10:21:52.479 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial043.front.sepia.ceph.com' 2026-02-12T10:21:52.479 DEBUG:teuthology.orchestra.run.trial043:> uname -m 2026-02-12T10:21:52.535 INFO:teuthology.orchestra.run.trial043.stdout:x86_64 2026-02-12T10:21:52.536 DEBUG:teuthology.orchestra.run.trial043:> cat /etc/os-release 2026-02-12T10:21:52.592 INFO:teuthology.orchestra.run.trial043.stdout:NAME="CentOS Stream" 2026-02-12T10:21:52.592 INFO:teuthology.orchestra.run.trial043.stdout:VERSION="9" 2026-02-12T10:21:52.592 INFO:teuthology.orchestra.run.trial043.stdout:ID="centos" 2026-02-12T10:21:52.592 INFO:teuthology.orchestra.run.trial043.stdout:ID_LIKE="rhel fedora" 2026-02-12T10:21:52.592 INFO:teuthology.orchestra.run.trial043.stdout:VERSION_ID="9" 2026-02-12T10:21:52.592 INFO:teuthology.orchestra.run.trial043.stdout:PLATFORM_ID="platform:el9" 2026-02-12T10:21:52.592 INFO:teuthology.orchestra.run.trial043.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T10:21:52.592 INFO:teuthology.orchestra.run.trial043.stdout:ANSI_COLOR="0;31" 2026-02-12T10:21:52.592 INFO:teuthology.orchestra.run.trial043.stdout:LOGO="fedora-logo-icon" 2026-02-12T10:21:52.593 INFO:teuthology.orchestra.run.trial043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T10:21:52.593 INFO:teuthology.orchestra.run.trial043.stdout:HOME_URL="https://centos.org/" 2026-02-12T10:21:52.593 INFO:teuthology.orchestra.run.trial043.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T10:21:52.593 INFO:teuthology.orchestra.run.trial043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T10:21:52.593 INFO:teuthology.orchestra.run.trial043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T10:21:52.594 INFO:teuthology.lock.ops:Updating trial043.front.sepia.ceph.com on lock server 2026-02-12T10:21:52.696 INFO:teuthology.lock.ops:Updating [trial123.front.sepia.ceph.com]: set os type and version on server 2026-02-12T10:21:52.697 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T10:21:52.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:21:52.767 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T10:21:52.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T10:21:52.842 DEBUG:teuthology.orchestra.run.trial123:> uname -m 2026-02-12T10:21:52.896 INFO:teuthology.orchestra.run.trial123.stdout:x86_64 2026-02-12T10:21:52.897 DEBUG:teuthology.orchestra.run.trial123:> cat /etc/os-release 2026-02-12T10:21:52.953 INFO:teuthology.orchestra.run.trial123.stdout:NAME="CentOS Stream" 2026-02-12T10:21:52.953 INFO:teuthology.orchestra.run.trial123.stdout:VERSION="9" 2026-02-12T10:21:52.953 INFO:teuthology.orchestra.run.trial123.stdout:ID="centos" 2026-02-12T10:21:52.953 INFO:teuthology.orchestra.run.trial123.stdout:ID_LIKE="rhel fedora" 2026-02-12T10:21:52.953 INFO:teuthology.orchestra.run.trial123.stdout:VERSION_ID="9" 2026-02-12T10:21:52.953 INFO:teuthology.orchestra.run.trial123.stdout:PLATFORM_ID="platform:el9" 2026-02-12T10:21:52.953 INFO:teuthology.orchestra.run.trial123.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T10:21:52.953 INFO:teuthology.orchestra.run.trial123.stdout:ANSI_COLOR="0;31" 2026-02-12T10:21:52.954 INFO:teuthology.orchestra.run.trial123.stdout:LOGO="fedora-logo-icon" 2026-02-12T10:21:52.954 INFO:teuthology.orchestra.run.trial123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T10:21:52.954 INFO:teuthology.orchestra.run.trial123.stdout:HOME_URL="https://centos.org/" 2026-02-12T10:21:52.954 INFO:teuthology.orchestra.run.trial123.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T10:21:52.954 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T10:21:52.954 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T10:21:52.955 INFO:teuthology.lock.ops:Updating trial123.front.sepia.ceph.com on lock server 2026-02-12T10:21:53.057 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:21:53.155 INFO:teuthology.dispatcher.supervisor:Running job 41764 2026-02-12T10:21:53.155 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/bin/teuthology -v --owner scheduled_matan@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41764 --name matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{pggrow} thrashosds-health workloads/radosbench-high-concurrency} -- /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41764/orig.config.yaml 2026-02-12T10:21:53.155 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41764 2026-02-12T10:21:53.155 INFO:teuthology.dispatcher.supervisor:Job PID: 3611352 2026-02-12T10:21:53.155 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-12T10:23:53.256 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:25:53.410 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:27:53.548 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:29:53.737 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:31:53.931 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:33:54.052 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:35:54.201 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:37:54.403 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:39:54.612 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:41:54.837 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:43:55.068 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:45:55.267 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:47:55.362 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:49:55.621 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:51:55.827 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:53:56.010 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:55:56.217 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:57:56.335 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:59:56.549 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:01:56.752 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:03:56.907 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:03:57.001 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-12T11:03:57.119 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-12T11:03:57.639 INFO:teuthology.orchestra.console.trial043:Power off 2026-02-12T11:03:57.639 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T11:03:57.650 INFO:teuthology.orchestra.console.trial123:Power off 2026-02-12T11:03:57.650 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T11:03:57.678 DEBUG:teuthology.orchestra.console.trial043:power off output: Chassis Power Control: Down/Off 2026-02-12T11:03:57.687 DEBUG:teuthology.orchestra.console.trial123:power off output: Chassis Power Control: Down/Off 2026-02-12T11:04:01.683 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T11:04:01.689 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T11:04:01.791 DEBUG:teuthology.orchestra.console.trial043:check power output: Chassis Power is on 2026-02-12T11:04:01.796 DEBUG:teuthology.orchestra.console.trial123:check power output: Chassis Power is on 2026-02-12T11:04:05.796 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T11:04:05.805 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T11:04:05.907 DEBUG:teuthology.orchestra.console.trial043:check power output: Chassis Power is off 2026-02-12T11:04:05.907 INFO:teuthology.orchestra.console.trial043:Power off completed 2026-02-12T11:04:05.915 DEBUG:teuthology.orchestra.console.trial123:check power output: Chassis Power is off 2026-02-12T11:04:05.915 INFO:teuthology.orchestra.console.trial123:Power off completed 2026-02-12T11:04:06.151 INFO:teuthology.lock.ops:unlocked: trial043.front.sepia.ceph.com 2026-02-12T11:04:06.190 INFO:teuthology.lock.ops:unlocked: trial123.front.sepia.ceph.com