2026-02-22T21:02:09.697 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-22T21:02:09.697 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T21:02:09.771 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T21:02:09.907 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7363db98f600>, signals=[15]) 2026-02-22T21:02:09.907 INFO:teuthology.lock.ops:Start node 'trial142.front.sepia.ceph.com' reimaging 2026-02-22T21:02:09.907 INFO:teuthology.lock.ops:Updating [trial142.front.sepia.ceph.com]: reset os type and version on server 2026-02-22T21:02:09.907 INFO:teuthology.lock.ops:Updating trial142.front.sepia.ceph.com on lock server 2026-02-22T21:02:10.085 DEBUG:teuthology.provision.fog.trial142:Requesting image trial_rocky_10.1 (ID 4) 2026-02-22T21:02:10.138 INFO:teuthology.provision.fog.trial142:Scheduling deploy of rocky 10.1 2026-02-22T21:02:11.165 INFO:teuthology.orchestra.console.trial142:Power off 2026-02-22T21:02:11.165 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-22T21:02:11.205 DEBUG:teuthology.orchestra.console.trial142:power off output: Chassis Power Control: Down/Off 2026-02-22T21:02:15.209 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-22T21:02:15.317 DEBUG:teuthology.orchestra.console.trial142:check power output: Chassis Power is off 2026-02-22T21:02:15.317 INFO:teuthology.orchestra.console.trial142:Power off completed 2026-02-22T21:02:15.418 INFO:teuthology.orchestra.console.trial142:Power on 2026-02-22T21:02:15.418 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-22T21:02:15.456 DEBUG:teuthology.orchestra.console.trial142:power on output: Chassis Power Control: Up/On 2026-02-22T21:02:19.459 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-22T21:02:19.569 DEBUG:teuthology.orchestra.console.trial142:check power output: Chassis Power is off 2026-02-22T21:02:23.572 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-22T21:02:23.681 DEBUG:teuthology.orchestra.console.trial142:check power output: Chassis Power is on 2026-02-22T21:02:23.681 INFO:teuthology.orchestra.console.trial142:Power on completed 2026-02-22T21:02:23.782 INFO:teuthology.provision.fog.trial142:Waiting for deploy to finish 2026-02-22T21:04:11.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T21:04:25.728 WARNING:teuthology.provision.fog.trial142:[Errno None] Unable to connect to port 22 on 10.20.193.142 2026-02-22T21:04:31.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T21:04:34.816 WARNING:teuthology.provision.fog.trial142:[Errno None] Unable to connect to port 22 on 10.20.193.142 2026-02-22T21:04:40.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T21:04:43.904 WARNING:teuthology.provision.fog.trial142:[Errno None] Unable to connect to port 22 on 10.20.193.142 2026-02-22T21:04:49.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T21:05:26.028 ERROR:teuthology.orchestra.connection:Error authenticating with trial142.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-22T21:05:30.138 ERROR:teuthology.orchestra.connection:Error authenticating with trial142.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-22T21:05:37.209 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-22T21:05:37.210 DEBUG:teuthology.orchestra.run.trial142:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-22T21:05:37.401 INFO:teuthology.provision.fog.trial142:Node is ready 2026-02-22T21:05:37.401 DEBUG:teuthology.orchestra.run.trial142:> hostname 2026-02-22T21:05:37.459 INFO:teuthology.orchestra.run.trial142.stdout:communicationserrorto10.20.192.1153timedout 2026-02-22T21:05:37.460 DEBUG:teuthology.orchestra.run.trial142:> grep communicationserrorto10.20.192.1153timedout /etc/hosts 2026-02-22T21:05:37.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T21:05:37.519 DEBUG:teuthology.orchestra.run.trial142:> sudo sed -i -e 's/communicationserrorto10.20.192.1153timedout/trial142/g' /etc/hostname 2026-02-22T21:05:37.591 DEBUG:teuthology.orchestra.run.trial142:> sudo hostname trial142 2026-02-22T21:05:37.657 DEBUG:teuthology.orchestra.run.trial142:> cat /etc/os-release 2026-02-22T21:05:37.715 INFO:teuthology.orchestra.run.trial142.stdout:NAME="Rocky Linux" 2026-02-22T21:05:37.715 INFO:teuthology.orchestra.run.trial142.stdout:VERSION="10.1 (Red Quartz)" 2026-02-22T21:05:37.716 INFO:teuthology.orchestra.run.trial142.stdout:ID="rocky" 2026-02-22T21:05:37.716 INFO:teuthology.orchestra.run.trial142.stdout:ID_LIKE="rhel centos fedora" 2026-02-22T21:05:37.716 INFO:teuthology.orchestra.run.trial142.stdout:VERSION_ID="10.1" 2026-02-22T21:05:37.716 INFO:teuthology.orchestra.run.trial142.stdout:PLATFORM_ID="platform:el10" 2026-02-22T21:05:37.716 INFO:teuthology.orchestra.run.trial142.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-22T21:05:37.716 INFO:teuthology.orchestra.run.trial142.stdout:ANSI_COLOR="0;32" 2026-02-22T21:05:37.716 INFO:teuthology.orchestra.run.trial142.stdout:LOGO="fedora-logo-icon" 2026-02-22T21:05:37.716 INFO:teuthology.orchestra.run.trial142.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-22T21:05:37.716 INFO:teuthology.orchestra.run.trial142.stdout:HOME_URL="https://rockylinux.org/" 2026-02-22T21:05:37.717 INFO:teuthology.orchestra.run.trial142.stdout:VENDOR_NAME="RESF" 2026-02-22T21:05:37.717 INFO:teuthology.orchestra.run.trial142.stdout:VENDOR_URL="https://resf.org/" 2026-02-22T21:05:37.717 INFO:teuthology.orchestra.run.trial142.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-22T21:05:37.717 INFO:teuthology.orchestra.run.trial142.stdout:SUPPORT_END="2035-05-31" 2026-02-22T21:05:37.717 INFO:teuthology.orchestra.run.trial142.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-22T21:05:37.717 INFO:teuthology.orchestra.run.trial142.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-22T21:05:37.717 INFO:teuthology.orchestra.run.trial142.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-22T21:05:37.717 INFO:teuthology.orchestra.run.trial142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-22T21:05:37.718 INFO:teuthology.provision.fog.trial142:Deploy complete! 2026-02-22T21:05:37.719 DEBUG:teuthology.parallel:result is None 2026-02-22T21:05:37.980 INFO:teuthology.lock.ops:Checking trial142.front.sepia.ceph.com 2026-02-22T21:05:37.980 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-22T21:05:38.051 INFO:teuthology.lock.ops:Updating [trial142.front.sepia.ceph.com]: set os type and version on server 2026-02-22T21:05:38.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial142.front.sepia.ceph.com' 2026-02-22T21:05:38.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T21:05:38.116 DEBUG:teuthology.orchestra.run.trial142:> true 2026-02-22T21:05:38.194 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial142.front.sepia.ceph.com' 2026-02-22T21:05:38.194 DEBUG:teuthology.orchestra.run.trial142:> uname -m 2026-02-22T21:05:38.252 INFO:teuthology.orchestra.run.trial142.stdout:x86_64 2026-02-22T21:05:38.252 DEBUG:teuthology.orchestra.run.trial142:> cat /etc/os-release 2026-02-22T21:05:38.309 INFO:teuthology.orchestra.run.trial142.stdout:NAME="Rocky Linux" 2026-02-22T21:05:38.309 INFO:teuthology.orchestra.run.trial142.stdout:VERSION="10.1 (Red Quartz)" 2026-02-22T21:05:38.309 INFO:teuthology.orchestra.run.trial142.stdout:ID="rocky" 2026-02-22T21:05:38.309 INFO:teuthology.orchestra.run.trial142.stdout:ID_LIKE="rhel centos fedora" 2026-02-22T21:05:38.309 INFO:teuthology.orchestra.run.trial142.stdout:VERSION_ID="10.1" 2026-02-22T21:05:38.309 INFO:teuthology.orchestra.run.trial142.stdout:PLATFORM_ID="platform:el10" 2026-02-22T21:05:38.309 INFO:teuthology.orchestra.run.trial142.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-22T21:05:38.309 INFO:teuthology.orchestra.run.trial142.stdout:ANSI_COLOR="0;32" 2026-02-22T21:05:38.309 INFO:teuthology.orchestra.run.trial142.stdout:LOGO="fedora-logo-icon" 2026-02-22T21:05:38.310 INFO:teuthology.orchestra.run.trial142.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-22T21:05:38.310 INFO:teuthology.orchestra.run.trial142.stdout:HOME_URL="https://rockylinux.org/" 2026-02-22T21:05:38.310 INFO:teuthology.orchestra.run.trial142.stdout:VENDOR_NAME="RESF" 2026-02-22T21:05:38.310 INFO:teuthology.orchestra.run.trial142.stdout:VENDOR_URL="https://resf.org/" 2026-02-22T21:05:38.310 INFO:teuthology.orchestra.run.trial142.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-22T21:05:38.310 INFO:teuthology.orchestra.run.trial142.stdout:SUPPORT_END="2035-05-31" 2026-02-22T21:05:38.310 INFO:teuthology.orchestra.run.trial142.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-22T21:05:38.310 INFO:teuthology.orchestra.run.trial142.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-22T21:05:38.310 INFO:teuthology.orchestra.run.trial142.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-22T21:05:38.310 INFO:teuthology.orchestra.run.trial142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-22T21:05:38.310 INFO:teuthology.lock.ops:Updating trial142.front.sepia.ceph.com on lock server 2026-02-22T21:05:38.379 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T21:05:38.464 INFO:teuthology.dispatcher.supervisor:Running job 64662 2026-02-22T21:05:38.464 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_nmordech@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64662 --name nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial --description rados/standalone/{supported-random-distro$/{rpm_latest} workloads/mon-stretch} -- /home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64662/orig.config.yaml 2026-02-22T21:05:38.465 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64662 2026-02-22T21:05:38.465 INFO:teuthology.dispatcher.supervisor:Job PID: 124396 2026-02-22T21:05:38.465 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-22T21:07:38.536 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T21:09:38.732 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T21:11:38.902 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T21:13:39.101 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T21:15:39.292 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T21:15:39.383 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-22T21:15:39.450 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-22T21:15:39.803 INFO:teuthology.orchestra.console.trial142:Power off 2026-02-22T21:15:39.803 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-22T21:15:39.843 DEBUG:teuthology.orchestra.console.trial142:power off output: Chassis Power Control: Down/Off 2026-02-22T21:15:43.846 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-22T21:15:43.954 DEBUG:teuthology.orchestra.console.trial142:check power output: Chassis Power is on 2026-02-22T21:15:47.959 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-22T21:15:48.068 DEBUG:teuthology.orchestra.console.trial142:check power output: Chassis Power is off 2026-02-22T21:15:48.068 INFO:teuthology.orchestra.console.trial142:Power off completed 2026-02-22T21:15:48.271 INFO:teuthology.lock.ops:unlocked: trial142.front.sepia.ceph.com