2026-02-26T03:00:04.958 INFO:root:teuthology version: 1.2.4.dev11+g6e3d0419c 2026-02-26T03:00:04.958 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:00:05.031 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:00:05.168 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x763da93279c0>, signals=[15]) 2026-02-26T03:00:05.168 INFO:teuthology.lock.ops:Start node 'trial134.front.sepia.ceph.com' reimaging 2026-02-26T03:00:05.168 INFO:teuthology.lock.ops:Updating [trial134.front.sepia.ceph.com]: reset os type and version on server 2026-02-26T03:00:05.168 INFO:teuthology.lock.ops:Updating trial134.front.sepia.ceph.com on lock server 2026-02-26T03:00:05.385 DEBUG:teuthology.provision.fog.trial134:Requesting image trial_centos_9.stream (ID 3) 2026-02-26T03:00:05.434 INFO:teuthology.provision.fog.trial134:Scheduling deploy of centos 9.stream 2026-02-26T03:00:06.758 INFO:teuthology.orchestra.console.trial134:Power off 2026-02-26T03:00:06.758 DEBUG:teuthology.orchestra.console.trial134:pexpect command: ipmitool -H trial134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-26T03:00:06.797 DEBUG:teuthology.orchestra.console.trial134:power off output: Chassis Power Control: Down/Off 2026-02-26T03:00:10.801 DEBUG:teuthology.orchestra.console.trial134:pexpect command: ipmitool -H trial134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-26T03:00:10.909 DEBUG:teuthology.orchestra.console.trial134:check power output: Chassis Power is off 2026-02-26T03:00:10.910 INFO:teuthology.orchestra.console.trial134:Power off completed 2026-02-26T03:00:11.010 INFO:teuthology.orchestra.console.trial134:Power on 2026-02-26T03:00:11.011 DEBUG:teuthology.orchestra.console.trial134:pexpect command: ipmitool -H trial134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-26T03:00:11.055 DEBUG:teuthology.orchestra.console.trial134:power on output: Chassis Power Control: Up/On 2026-02-26T03:00:15.059 DEBUG:teuthology.orchestra.console.trial134:pexpect command: ipmitool -H trial134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-26T03:00:15.171 DEBUG:teuthology.orchestra.console.trial134:check power output: Chassis Power is on 2026-02-26T03:00:15.172 INFO:teuthology.orchestra.console.trial134:Power on completed 2026-02-26T03:00:15.272 INFO:teuthology.provision.fog.trial134:Waiting for deploy to finish 2026-02-26T03:02:04.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T03:02:04.458 ERROR:teuthology.orchestra.connection:Error authenticating with trial134.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2026-02-26T03:03:08.461 WARNING:teuthology.provision.fog.trial134:timed out 2026-02-26T03:03:14.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T03:03:21.785 ERROR:teuthology.orchestra.connection:Error authenticating with trial134.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-26T03:03:25.899 ERROR:teuthology.orchestra.connection:Error authenticating with trial134.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-26T03:03:32.966 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-26T03:03:32.966 DEBUG:teuthology.orchestra.run.trial134:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-26T03:03:33.136 INFO:teuthology.provision.fog.trial134:Node is ready 2026-02-26T03:03:33.136 DEBUG:teuthology.orchestra.run.trial134:> hostname 2026-02-26T03:03:33.193 INFO:teuthology.orchestra.run.trial134.stdout:trial134.front.sepia.ceph.com 2026-02-26T03:03:33.193 DEBUG:teuthology.orchestra.run.trial134:> grep trial134.front.sepia.ceph.com /etc/hosts 2026-02-26T03:03:33.248 INFO:teuthology.orchestra.run.trial134.stdout:10.20.193.134 trial134.front.sepia.ceph.com trial134 2026-02-26T03:03:33.249 DEBUG:teuthology.orchestra.run.trial134:> sudo hostname trial134 2026-02-26T03:03:33.317 DEBUG:teuthology.orchestra.run.trial134:> sudo sed -i -e 's/trial134.front.sepia.ceph.com/trial134/g' /etc/hosts 2026-02-26T03:03:33.382 DEBUG:teuthology.orchestra.run.trial134:> sudo sed -i -e 's/10.20.193.134/10.20.193.134/g' /etc/hosts 2026-02-26T03:03:33.447 DEBUG:teuthology.orchestra.run.trial134:> sudo sed -i -e 's/trial134.front.sepia.ceph.com/trial134/g' /etc/hostname 2026-02-26T03:03:33.511 DEBUG:teuthology.orchestra.run.trial134:> sudo hostname trial134 2026-02-26T03:03:33.576 DEBUG:teuthology.orchestra.run.trial134:> cat /etc/os-release 2026-02-26T03:03:33.633 INFO:teuthology.orchestra.run.trial134.stdout:NAME="CentOS Stream" 2026-02-26T03:03:33.634 INFO:teuthology.orchestra.run.trial134.stdout:VERSION="9" 2026-02-26T03:03:33.634 INFO:teuthology.orchestra.run.trial134.stdout:ID="centos" 2026-02-26T03:03:33.634 INFO:teuthology.orchestra.run.trial134.stdout:ID_LIKE="rhel fedora" 2026-02-26T03:03:33.634 INFO:teuthology.orchestra.run.trial134.stdout:VERSION_ID="9" 2026-02-26T03:03:33.635 INFO:teuthology.orchestra.run.trial134.stdout:PLATFORM_ID="platform:el9" 2026-02-26T03:03:33.635 INFO:teuthology.orchestra.run.trial134.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-26T03:03:33.635 INFO:teuthology.orchestra.run.trial134.stdout:ANSI_COLOR="0;31" 2026-02-26T03:03:33.635 INFO:teuthology.orchestra.run.trial134.stdout:LOGO="fedora-logo-icon" 2026-02-26T03:03:33.635 INFO:teuthology.orchestra.run.trial134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-26T03:03:33.635 INFO:teuthology.orchestra.run.trial134.stdout:HOME_URL="https://centos.org/" 2026-02-26T03:03:33.635 INFO:teuthology.orchestra.run.trial134.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-26T03:03:33.636 INFO:teuthology.orchestra.run.trial134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-26T03:03:33.636 INFO:teuthology.orchestra.run.trial134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-26T03:03:33.637 INFO:teuthology.provision.fog.trial134:Deploy complete! 2026-02-26T03:03:33.637 DEBUG:teuthology.parallel:result is None 2026-02-26T03:03:33.901 INFO:teuthology.lock.ops:Checking trial134.front.sepia.ceph.com 2026-02-26T03:03:33.901 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-26T03:03:33.991 INFO:teuthology.lock.ops:Updating [trial134.front.sepia.ceph.com]: set os type and version on server 2026-02-26T03:03:33.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial134.front.sepia.ceph.com' 2026-02-26T03:03:33.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T03:03:34.054 DEBUG:teuthology.orchestra.run.trial134:> true 2026-02-26T03:03:34.129 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial134.front.sepia.ceph.com' 2026-02-26T03:03:34.129 DEBUG:teuthology.orchestra.run.trial134:> uname -m 2026-02-26T03:03:34.185 INFO:teuthology.orchestra.run.trial134.stdout:x86_64 2026-02-26T03:03:34.185 DEBUG:teuthology.orchestra.run.trial134:> cat /etc/os-release 2026-02-26T03:03:34.241 INFO:teuthology.orchestra.run.trial134.stdout:NAME="CentOS Stream" 2026-02-26T03:03:34.241 INFO:teuthology.orchestra.run.trial134.stdout:VERSION="9" 2026-02-26T03:03:34.241 INFO:teuthology.orchestra.run.trial134.stdout:ID="centos" 2026-02-26T03:03:34.241 INFO:teuthology.orchestra.run.trial134.stdout:ID_LIKE="rhel fedora" 2026-02-26T03:03:34.242 INFO:teuthology.orchestra.run.trial134.stdout:VERSION_ID="9" 2026-02-26T03:03:34.242 INFO:teuthology.orchestra.run.trial134.stdout:PLATFORM_ID="platform:el9" 2026-02-26T03:03:34.242 INFO:teuthology.orchestra.run.trial134.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-26T03:03:34.242 INFO:teuthology.orchestra.run.trial134.stdout:ANSI_COLOR="0;31" 2026-02-26T03:03:34.242 INFO:teuthology.orchestra.run.trial134.stdout:LOGO="fedora-logo-icon" 2026-02-26T03:03:34.242 INFO:teuthology.orchestra.run.trial134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-26T03:03:34.242 INFO:teuthology.orchestra.run.trial134.stdout:HOME_URL="https://centos.org/" 2026-02-26T03:03:34.242 INFO:teuthology.orchestra.run.trial134.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-26T03:03:34.242 INFO:teuthology.orchestra.run.trial134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-26T03:03:34.242 INFO:teuthology.orchestra.run.trial134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-26T03:03:34.243 INFO:teuthology.lock.ops:Updating trial134.front.sepia.ceph.com on lock server 2026-02-26T03:03:34.337 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:03:34.427 INFO:teuthology.dispatcher.supervisor:Running job 71162 2026-02-26T03:03:34.427 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/bin/teuthology -v --owner scheduled_shraddhaag@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial/71162 --name shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial --description crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} perf_ignorelist settings/optimized workloads/radosbench_4K_rand_read} -- /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial/71162/orig.config.yaml 2026-02-26T03:03:34.427 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial/71162 2026-02-26T03:03:34.428 INFO:teuthology.dispatcher.supervisor:Job PID: 873814 2026-02-26T03:03:34.428 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-26T03:05:34.428 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:07:34.504 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:09:34.631 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:11:34.751 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:13:34.895 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:15:35.023 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:17:35.151 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:19:35.263 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:21:35.374 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:23:35.498 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:25:35.617 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:27:35.740 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:29:35.863 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:31:36.376 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:33:36.497 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:35:36.628 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:37:36.752 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:37:36.871 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-26T03:37:36.937 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-26T03:37:37.233 INFO:teuthology.orchestra.console.trial134:Power off 2026-02-26T03:37:37.233 DEBUG:teuthology.orchestra.console.trial134:pexpect command: ipmitool -H trial134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-26T03:37:37.272 DEBUG:teuthology.orchestra.console.trial134:power off output: Chassis Power Control: Down/Off 2026-02-26T03:37:41.272 DEBUG:teuthology.orchestra.console.trial134:pexpect command: ipmitool -H trial134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-26T03:37:41.380 DEBUG:teuthology.orchestra.console.trial134:check power output: Chassis Power is on 2026-02-26T03:37:45.381 DEBUG:teuthology.orchestra.console.trial134:pexpect command: ipmitool -H trial134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-26T03:37:45.491 DEBUG:teuthology.orchestra.console.trial134:check power output: Chassis Power is off 2026-02-26T03:37:45.491 INFO:teuthology.orchestra.console.trial134:Power off completed 2026-02-26T03:37:45.700 INFO:teuthology.lock.ops:unlocked: trial134.front.sepia.ceph.com