2026-02-24T17:15:21.979 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-24T17:15:21.980 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T17:15:22.053 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T17:15:22.193 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7b694609a160>, signals=[15]) 2026-02-24T17:15:22.193 INFO:teuthology.lock.ops:Start node 'trial194.front.sepia.ceph.com' reimaging 2026-02-24T17:15:22.193 INFO:teuthology.lock.ops:Updating [trial194.front.sepia.ceph.com]: reset os type and version on server 2026-02-24T17:15:22.193 INFO:teuthology.lock.ops:Updating trial194.front.sepia.ceph.com on lock server 2026-02-24T17:15:22.388 DEBUG:teuthology.provision.fog.trial194:Requesting image trial_centos_9.stream (ID 3) 2026-02-24T17:15:22.442 INFO:teuthology.provision.fog.trial194:Scheduling deploy of centos 9.stream 2026-02-24T17:15:23.970 INFO:teuthology.orchestra.console.trial194:Power off 2026-02-24T17:15:23.970 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-24T17:15:24.010 DEBUG:teuthology.orchestra.console.trial194:power off output: Chassis Power Control: Down/Off 2026-02-24T17:15:28.016 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T17:15:28.125 DEBUG:teuthology.orchestra.console.trial194:check power output: Chassis Power is off 2026-02-24T17:15:28.126 INFO:teuthology.orchestra.console.trial194:Power off completed 2026-02-24T17:15:28.226 INFO:teuthology.orchestra.console.trial194:Power on 2026-02-24T17:15:28.227 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-24T17:15:28.267 DEBUG:teuthology.orchestra.console.trial194:power on output: Chassis Power Control: Up/On 2026-02-24T17:15:32.272 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T17:15:32.382 DEBUG:teuthology.orchestra.console.trial194:check power output: Chassis Power is on 2026-02-24T17:15:32.383 INFO:teuthology.orchestra.console.trial194:Power on completed 2026-02-24T17:15:32.483 INFO:teuthology.provision.fog.trial194:Waiting for deploy to finish 2026-02-24T17:17:20.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T17:17:20.336 ERROR:teuthology.orchestra.connection:Error authenticating with trial194.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2026-02-24T17:18:24.338 WARNING:teuthology.provision.fog.trial194:timed out 2026-02-24T17:18:30.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T17:18:33.518 ERROR:teuthology.orchestra.connection:Error authenticating with trial194.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-24T17:18:37.644 ERROR:teuthology.orchestra.connection:Error authenticating with trial194.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-24T17:18:44.759 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-24T17:18:44.760 DEBUG:teuthology.orchestra.run.trial194:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-24T17:18:44.915 INFO:teuthology.provision.fog.trial194:Node is ready 2026-02-24T17:18:44.916 DEBUG:teuthology.orchestra.run.trial194:> hostname 2026-02-24T17:18:44.971 INFO:teuthology.orchestra.run.trial194.stdout:trial194.front.sepia.ceph.com 2026-02-24T17:18:44.972 DEBUG:teuthology.orchestra.run.trial194:> grep trial194.front.sepia.ceph.com /etc/hosts 2026-02-24T17:18:45.028 INFO:teuthology.orchestra.run.trial194.stdout:10.20.193.194 trial194.front.sepia.ceph.com trial194 2026-02-24T17:18:45.028 DEBUG:teuthology.orchestra.run.trial194:> sudo hostname trial194 2026-02-24T17:18:45.099 DEBUG:teuthology.orchestra.run.trial194:> sudo sed -i -e 's/trial194.front.sepia.ceph.com/trial194/g' /etc/hosts 2026-02-24T17:18:45.164 DEBUG:teuthology.orchestra.run.trial194:> sudo sed -i -e 's/10.20.193.194/10.20.193.194/g' /etc/hosts 2026-02-24T17:18:45.228 DEBUG:teuthology.orchestra.run.trial194:> sudo sed -i -e 's/trial194.front.sepia.ceph.com/trial194/g' /etc/hostname 2026-02-24T17:18:45.292 DEBUG:teuthology.orchestra.run.trial194:> sudo hostname trial194 2026-02-24T17:18:45.356 DEBUG:teuthology.orchestra.run.trial194:> cat /etc/os-release 2026-02-24T17:18:45.412 INFO:teuthology.orchestra.run.trial194.stdout:NAME="CentOS Stream" 2026-02-24T17:18:45.412 INFO:teuthology.orchestra.run.trial194.stdout:VERSION="9" 2026-02-24T17:18:45.412 INFO:teuthology.orchestra.run.trial194.stdout:ID="centos" 2026-02-24T17:18:45.412 INFO:teuthology.orchestra.run.trial194.stdout:ID_LIKE="rhel fedora" 2026-02-24T17:18:45.412 INFO:teuthology.orchestra.run.trial194.stdout:VERSION_ID="9" 2026-02-24T17:18:45.412 INFO:teuthology.orchestra.run.trial194.stdout:PLATFORM_ID="platform:el9" 2026-02-24T17:18:45.412 INFO:teuthology.orchestra.run.trial194.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T17:18:45.412 INFO:teuthology.orchestra.run.trial194.stdout:ANSI_COLOR="0;31" 2026-02-24T17:18:45.412 INFO:teuthology.orchestra.run.trial194.stdout:LOGO="fedora-logo-icon" 2026-02-24T17:18:45.412 INFO:teuthology.orchestra.run.trial194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T17:18:45.412 INFO:teuthology.orchestra.run.trial194.stdout:HOME_URL="https://centos.org/" 2026-02-24T17:18:45.412 INFO:teuthology.orchestra.run.trial194.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T17:18:45.412 INFO:teuthology.orchestra.run.trial194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T17:18:45.412 INFO:teuthology.orchestra.run.trial194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T17:18:45.413 INFO:teuthology.provision.fog.trial194:Deploy complete! 2026-02-24T17:18:45.413 DEBUG:teuthology.parallel:result is None 2026-02-24T17:18:45.650 INFO:teuthology.lock.ops:Checking trial194.front.sepia.ceph.com 2026-02-24T17:18:45.650 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-24T17:18:45.715 INFO:teuthology.lock.ops:Updating [trial194.front.sepia.ceph.com]: set os type and version on server 2026-02-24T17:18:45.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial194.front.sepia.ceph.com' 2026-02-24T17:18:45.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T17:18:45.775 DEBUG:teuthology.orchestra.run.trial194:> true 2026-02-24T17:18:45.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial194.front.sepia.ceph.com' 2026-02-24T17:18:45.853 DEBUG:teuthology.orchestra.run.trial194:> uname -m 2026-02-24T17:18:45.909 INFO:teuthology.orchestra.run.trial194.stdout:x86_64 2026-02-24T17:18:45.909 DEBUG:teuthology.orchestra.run.trial194:> cat /etc/os-release 2026-02-24T17:18:45.965 INFO:teuthology.orchestra.run.trial194.stdout:NAME="CentOS Stream" 2026-02-24T17:18:45.965 INFO:teuthology.orchestra.run.trial194.stdout:VERSION="9" 2026-02-24T17:18:45.965 INFO:teuthology.orchestra.run.trial194.stdout:ID="centos" 2026-02-24T17:18:45.965 INFO:teuthology.orchestra.run.trial194.stdout:ID_LIKE="rhel fedora" 2026-02-24T17:18:45.965 INFO:teuthology.orchestra.run.trial194.stdout:VERSION_ID="9" 2026-02-24T17:18:45.965 INFO:teuthology.orchestra.run.trial194.stdout:PLATFORM_ID="platform:el9" 2026-02-24T17:18:45.965 INFO:teuthology.orchestra.run.trial194.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T17:18:45.965 INFO:teuthology.orchestra.run.trial194.stdout:ANSI_COLOR="0;31" 2026-02-24T17:18:45.965 INFO:teuthology.orchestra.run.trial194.stdout:LOGO="fedora-logo-icon" 2026-02-24T17:18:45.965 INFO:teuthology.orchestra.run.trial194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T17:18:45.965 INFO:teuthology.orchestra.run.trial194.stdout:HOME_URL="https://centos.org/" 2026-02-24T17:18:45.965 INFO:teuthology.orchestra.run.trial194.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T17:18:45.965 INFO:teuthology.orchestra.run.trial194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T17:18:45.965 INFO:teuthology.orchestra.run.trial194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T17:18:45.966 INFO:teuthology.lock.ops:Updating trial194.front.sepia.ceph.com on lock server 2026-02-24T17:18:46.052 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T17:18:46.139 INFO:teuthology.dispatcher.supervisor:Running job 68472 2026-02-24T17:18:46.139 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_yuriw@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68472 --name yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial --description rados/singleton/{all/test-noautoscale-flag mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{hybrid} base mem$/{normal-2} onode-segment$/{512K} write$/{v1/{compr$/{no$/{no}} v1}}}} rados supported-random-distro$/{centos_latest}} -- /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68472/orig.config.yaml 2026-02-24T17:18:46.139 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68472 2026-02-24T17:18:46.139 INFO:teuthology.dispatcher.supervisor:Job PID: 1985830 2026-02-24T17:18:46.139 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-24T17:20:46.140 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T17:22:46.243 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T17:24:46.372 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T17:26:46.498 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T17:28:46.620 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T17:28:46.741 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-24T17:28:46.808 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-24T17:28:47.104 INFO:teuthology.orchestra.console.trial194:Power off 2026-02-24T17:28:47.104 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-24T17:28:47.145 DEBUG:teuthology.orchestra.console.trial194:power off output: Chassis Power Control: Down/Off 2026-02-24T17:28:51.146 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T17:28:51.257 DEBUG:teuthology.orchestra.console.trial194:check power output: Chassis Power is on 2026-02-24T17:28:55.258 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T17:28:55.368 DEBUG:teuthology.orchestra.console.trial194:check power output: Chassis Power is off 2026-02-24T17:28:55.369 INFO:teuthology.orchestra.console.trial194:Power off completed 2026-02-24T17:28:55.593 INFO:teuthology.lock.ops:unlocked: trial194.front.sepia.ceph.com