2026-02-25T12:01:23.577 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-25T12:01:23.577 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:01:23.651 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:01:23.790 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ea3afdb72e0>, signals=[15]) 2026-02-25T12:01:23.790 INFO:teuthology.lock.ops:Start node 'trial053.front.sepia.ceph.com' reimaging 2026-02-25T12:01:23.790 INFO:teuthology.lock.ops:Updating [trial053.front.sepia.ceph.com]: reset os type and version on server 2026-02-25T12:01:23.790 INFO:teuthology.lock.ops:Updating trial053.front.sepia.ceph.com on lock server 2026-02-25T12:01:24.007 DEBUG:teuthology.provision.fog.trial053:Requesting image trial_rocky_10.1 (ID 4) 2026-02-25T12:01:24.055 INFO:teuthology.provision.fog.trial053:Scheduling deploy of rocky 10.1 2026-02-25T12:01:25.221 INFO:teuthology.orchestra.console.trial053:Power off 2026-02-25T12:01:25.221 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-25T12:01:25.259 DEBUG:teuthology.orchestra.console.trial053:power off output: Chassis Power Control: Down/Off 2026-02-25T12:01:29.264 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T12:01:29.373 DEBUG:teuthology.orchestra.console.trial053:check power output: Chassis Power is off 2026-02-25T12:01:29.373 INFO:teuthology.orchestra.console.trial053:Power off completed 2026-02-25T12:01:29.473 INFO:teuthology.orchestra.console.trial053:Power on 2026-02-25T12:01:29.473 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-25T12:01:29.512 DEBUG:teuthology.orchestra.console.trial053:power on output: Chassis Power Control: Up/On 2026-02-25T12:01:33.516 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T12:01:33.625 DEBUG:teuthology.orchestra.console.trial053:check power output: Chassis Power is on 2026-02-25T12:01:33.626 INFO:teuthology.orchestra.console.trial053:Power on completed 2026-02-25T12:01:33.726 INFO:teuthology.provision.fog.trial053:Waiting for deploy to finish 2026-02-25T12:03:22.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:03:25.121 WARNING:teuthology.provision.fog.trial053:[Errno None] Unable to connect to port 22 on 10.20.193.53 2026-02-25T12:03:31.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:03:34.208 WARNING:teuthology.provision.fog.trial053:[Errno None] Unable to connect to port 22 on 10.20.193.53 2026-02-25T12:03:40.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:03:43.296 WARNING:teuthology.provision.fog.trial053:[Errno None] Unable to connect to port 22 on 10.20.193.53 2026-02-25T12:03:49.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:03:52.384 WARNING:teuthology.provision.fog.trial053:[Errno None] Unable to connect to port 22 on 10.20.193.53 2026-02-25T12:03:58.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:04:01.472 WARNING:teuthology.provision.fog.trial053:[Errno None] Unable to connect to port 22 on 10.20.193.53 2026-02-25T12:04:07.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:04:43.665 ERROR:teuthology.orchestra.connection:Error authenticating with trial053.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-25T12:04:47.754 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-25T12:04:47.755 DEBUG:teuthology.orchestra.run.trial053:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-25T12:04:47.958 INFO:teuthology.provision.fog.trial053:Node is ready 2026-02-25T12:04:47.958 DEBUG:teuthology.orchestra.run.trial053:> hostname 2026-02-25T12:04:48.020 INFO:teuthology.orchestra.run.trial053.stdout:trial053.front.sepia.ceph.com 2026-02-25T12:04:48.020 DEBUG:teuthology.orchestra.run.trial053:> grep trial053.front.sepia.ceph.com /etc/hosts 2026-02-25T12:04:48.082 INFO:teuthology.orchestra.run.trial053.stdout:10.20.193.53 trial053.front.sepia.ceph.com trial053 2026-02-25T12:04:48.083 DEBUG:teuthology.orchestra.run.trial053:> sudo hostname trial053 2026-02-25T12:04:48.158 DEBUG:teuthology.orchestra.run.trial053:> sudo sed -i -e 's/trial053.front.sepia.ceph.com/trial053/g' /etc/hosts 2026-02-25T12:04:48.228 DEBUG:teuthology.orchestra.run.trial053:> sudo sed -i -e 's/10.20.193.53/10.20.193.53/g' /etc/hosts 2026-02-25T12:04:48.298 DEBUG:teuthology.orchestra.run.trial053:> sudo sed -i -e 's/trial053.front.sepia.ceph.com/trial053/g' /etc/hostname 2026-02-25T12:04:48.369 DEBUG:teuthology.orchestra.run.trial053:> sudo hostname trial053 2026-02-25T12:04:48.438 DEBUG:teuthology.orchestra.run.trial053:> cat /etc/os-release 2026-02-25T12:04:48.500 INFO:teuthology.orchestra.run.trial053.stdout:NAME="Rocky Linux" 2026-02-25T12:04:48.500 INFO:teuthology.orchestra.run.trial053.stdout:VERSION="10.1 (Red Quartz)" 2026-02-25T12:04:48.500 INFO:teuthology.orchestra.run.trial053.stdout:ID="rocky" 2026-02-25T12:04:48.500 INFO:teuthology.orchestra.run.trial053.stdout:ID_LIKE="rhel centos fedora" 2026-02-25T12:04:48.500 INFO:teuthology.orchestra.run.trial053.stdout:VERSION_ID="10.1" 2026-02-25T12:04:48.500 INFO:teuthology.orchestra.run.trial053.stdout:PLATFORM_ID="platform:el10" 2026-02-25T12:04:48.500 INFO:teuthology.orchestra.run.trial053.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-25T12:04:48.501 INFO:teuthology.orchestra.run.trial053.stdout:ANSI_COLOR="0;32" 2026-02-25T12:04:48.501 INFO:teuthology.orchestra.run.trial053.stdout:LOGO="fedora-logo-icon" 2026-02-25T12:04:48.501 INFO:teuthology.orchestra.run.trial053.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-25T12:04:48.501 INFO:teuthology.orchestra.run.trial053.stdout:HOME_URL="https://rockylinux.org/" 2026-02-25T12:04:48.501 INFO:teuthology.orchestra.run.trial053.stdout:VENDOR_NAME="RESF" 2026-02-25T12:04:48.501 INFO:teuthology.orchestra.run.trial053.stdout:VENDOR_URL="https://resf.org/" 2026-02-25T12:04:48.501 INFO:teuthology.orchestra.run.trial053.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-25T12:04:48.501 INFO:teuthology.orchestra.run.trial053.stdout:SUPPORT_END="2035-05-31" 2026-02-25T12:04:48.501 INFO:teuthology.orchestra.run.trial053.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-25T12:04:48.501 INFO:teuthology.orchestra.run.trial053.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-25T12:04:48.501 INFO:teuthology.orchestra.run.trial053.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-25T12:04:48.502 INFO:teuthology.orchestra.run.trial053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-25T12:04:48.502 INFO:teuthology.provision.fog.trial053:Deploy complete! 2026-02-25T12:04:48.504 DEBUG:teuthology.parallel:result is None 2026-02-25T12:04:48.782 INFO:teuthology.lock.ops:Checking trial053.front.sepia.ceph.com 2026-02-25T12:04:48.782 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-25T12:04:48.873 INFO:teuthology.lock.ops:Updating [trial053.front.sepia.ceph.com]: set os type and version on server 2026-02-25T12:04:48.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial053.front.sepia.ceph.com' 2026-02-25T12:04:48.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:04:48.940 DEBUG:teuthology.orchestra.run.trial053:> true 2026-02-25T12:04:49.028 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial053.front.sepia.ceph.com' 2026-02-25T12:04:49.028 DEBUG:teuthology.orchestra.run.trial053:> uname -m 2026-02-25T12:04:49.089 INFO:teuthology.orchestra.run.trial053.stdout:x86_64 2026-02-25T12:04:49.090 DEBUG:teuthology.orchestra.run.trial053:> cat /etc/os-release 2026-02-25T12:04:49.150 INFO:teuthology.orchestra.run.trial053.stdout:NAME="Rocky Linux" 2026-02-25T12:04:49.150 INFO:teuthology.orchestra.run.trial053.stdout:VERSION="10.1 (Red Quartz)" 2026-02-25T12:04:49.150 INFO:teuthology.orchestra.run.trial053.stdout:ID="rocky" 2026-02-25T12:04:49.151 INFO:teuthology.orchestra.run.trial053.stdout:ID_LIKE="rhel centos fedora" 2026-02-25T12:04:49.151 INFO:teuthology.orchestra.run.trial053.stdout:VERSION_ID="10.1" 2026-02-25T12:04:49.151 INFO:teuthology.orchestra.run.trial053.stdout:PLATFORM_ID="platform:el10" 2026-02-25T12:04:49.151 INFO:teuthology.orchestra.run.trial053.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-25T12:04:49.151 INFO:teuthology.orchestra.run.trial053.stdout:ANSI_COLOR="0;32" 2026-02-25T12:04:49.151 INFO:teuthology.orchestra.run.trial053.stdout:LOGO="fedora-logo-icon" 2026-02-25T12:04:49.151 INFO:teuthology.orchestra.run.trial053.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-25T12:04:49.151 INFO:teuthology.orchestra.run.trial053.stdout:HOME_URL="https://rockylinux.org/" 2026-02-25T12:04:49.151 INFO:teuthology.orchestra.run.trial053.stdout:VENDOR_NAME="RESF" 2026-02-25T12:04:49.151 INFO:teuthology.orchestra.run.trial053.stdout:VENDOR_URL="https://resf.org/" 2026-02-25T12:04:49.151 INFO:teuthology.orchestra.run.trial053.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-25T12:04:49.151 INFO:teuthology.orchestra.run.trial053.stdout:SUPPORT_END="2035-05-31" 2026-02-25T12:04:49.152 INFO:teuthology.orchestra.run.trial053.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-25T12:04:49.152 INFO:teuthology.orchestra.run.trial053.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-25T12:04:49.152 INFO:teuthology.orchestra.run.trial053.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-25T12:04:49.152 INFO:teuthology.orchestra.run.trial053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-25T12:04:49.152 INFO:teuthology.lock.ops:Updating trial053.front.sepia.ceph.com on lock server 2026-02-25T12:04:49.260 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:04:49.353 INFO:teuthology.dispatcher.supervisor:Running job 69905 2026-02-25T12:04:49.353 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_nmordech@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/nmordech-2026-02-25_11:36:23-rados-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial/69905 --name nmordech-2026-02-25_11:36:23-rados-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial --description rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rpm_latest}} -- /home/teuthworker/mnt/teuthology/nmordech-2026-02-25_11:36:23-rados-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial/69905/orig.config.yaml 2026-02-25T12:04:49.354 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/nmordech-2026-02-25_11:36:23-rados-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial/69905 2026-02-25T12:04:49.354 INFO:teuthology.dispatcher.supervisor:Job PID: 826068 2026-02-25T12:04:49.354 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-25T12:06:49.453 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:08:49.624 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:10:49.780 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:12:49.875 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:14:50.050 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:16:50.271 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:16:50.364 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-25T12:16:50.425 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-25T12:16:50.728 INFO:teuthology.orchestra.console.trial053:Power off 2026-02-25T12:16:50.728 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-25T12:16:50.767 DEBUG:teuthology.orchestra.console.trial053:power off output: Chassis Power Control: Down/Off 2026-02-25T12:16:54.771 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T12:16:54.880 DEBUG:teuthology.orchestra.console.trial053:check power output: Chassis Power is on 2026-02-25T12:16:58.883 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T12:16:58.994 DEBUG:teuthology.orchestra.console.trial053:check power output: Chassis Power is off 2026-02-25T12:16:58.994 INFO:teuthology.orchestra.console.trial053:Power off completed 2026-02-25T12:16:59.206 INFO:teuthology.lock.ops:unlocked: trial053.front.sepia.ceph.com