2026-02-20T16:31:50.546 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-20T16:31:50.546 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:31:51.235 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:31:51.383 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7aa9b61aa7b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7aa9b59831a0>, signals=[15])
2026-02-20T16:31:51.383 INFO:teuthology.lock.ops:Start node 'trial168.front.sepia.ceph.com' reimaging
2026-02-20T16:31:51.383 INFO:teuthology.lock.ops:Updating [trial168.front.sepia.ceph.com]: reset os type and version on server
2026-02-20T16:31:51.383 INFO:teuthology.lock.ops:Updating trial168.front.sepia.ceph.com on lock server
2026-02-20T16:31:51.597 DEBUG:teuthology.provision.fog.trial168:Requesting image trial_centos_9.stream (ID 3)
2026-02-20T16:31:51.648 INFO:teuthology.provision.fog.trial168:Scheduling deploy of centos 9.stream
2026-02-20T16:31:52.730 INFO:teuthology.orchestra.console.trial168:Power off
2026-02-20T16:31:52.730 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T16:31:52.768 DEBUG:teuthology.orchestra.console.trial168:power off output: Chassis Power Control: Down/Off
2026-02-20T16:31:56.773 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T16:31:56.882 DEBUG:teuthology.orchestra.console.trial168:check power output: Chassis Power is off
2026-02-20T16:31:56.882 INFO:teuthology.orchestra.console.trial168:Power off completed
2026-02-20T16:31:56.983 INFO:teuthology.orchestra.console.trial168:Power on
2026-02-20T16:31:56.983 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-20T16:31:57.021 DEBUG:teuthology.orchestra.console.trial168:power on output: Chassis Power Control: Up/On
2026-02-20T16:32:01.025 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T16:32:01.137 DEBUG:teuthology.orchestra.console.trial168:check power output: Chassis Power is on
2026-02-20T16:32:01.137 INFO:teuthology.orchestra.console.trial168:Power on completed
2026-02-20T16:32:01.238 INFO:teuthology.provision.fog.trial168:Waiting for deploy to finish
2026-02-20T16:33:48.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T16:33:49.052 ERROR:teuthology.orchestra.connection:Error authenticating with trial168.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-20T16:34:53.055 WARNING:teuthology.provision.fog.trial168:timed out
2026-02-20T16:34:59.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T16:35:06.366 ERROR:teuthology.orchestra.connection:Error authenticating with trial168.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-20T16:35:10.482 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-20T16:35:10.482 DEBUG:teuthology.orchestra.run.trial168:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-20T16:35:15.742 INFO:teuthology.provision.fog.trial168:Node is ready
2026-02-20T16:35:15.742 DEBUG:teuthology.orchestra.run.trial168:> hostname
2026-02-20T16:35:15.760 INFO:teuthology.orchestra.run.trial168.stdout:trial168.front.sepia.ceph.com
2026-02-20T16:35:15.760 DEBUG:teuthology.orchestra.run.trial168:> grep trial168.front.sepia.ceph.com /etc/hosts
2026-02-20T16:35:15.861 INFO:teuthology.orchestra.run.trial168.stdout:10.20.193.168 trial168.front.sepia.ceph.com trial168
2026-02-20T16:35:15.862 DEBUG:teuthology.orchestra.run.trial168:> sudo hostname trial168
2026-02-20T16:35:15.964 DEBUG:teuthology.orchestra.run.trial168:> sudo sed -i -e 's/trial168.front.sepia.ceph.com/trial168/g' /etc/hosts
2026-02-20T16:35:15.990 DEBUG:teuthology.orchestra.run.trial168:> sudo sed -i -e 's/10.20.193.168/10.20.193.168/g' /etc/hosts
2026-02-20T16:35:16.057 DEBUG:teuthology.orchestra.run.trial168:> sudo sed -i -e 's/trial168.front.sepia.ceph.com/trial168/g' /etc/hostname
2026-02-20T16:35:16.123 DEBUG:teuthology.orchestra.run.trial168:> sudo hostname trial168
2026-02-20T16:35:16.189 DEBUG:teuthology.orchestra.run.trial168:> cat /etc/os-release
2026-02-20T16:35:16.245 INFO:teuthology.orchestra.run.trial168.stdout:NAME="CentOS Stream"
2026-02-20T16:35:16.245 INFO:teuthology.orchestra.run.trial168.stdout:VERSION="9"
2026-02-20T16:35:16.245 INFO:teuthology.orchestra.run.trial168.stdout:ID="centos"
2026-02-20T16:35:16.245 INFO:teuthology.orchestra.run.trial168.stdout:ID_LIKE="rhel fedora"
2026-02-20T16:35:16.245 INFO:teuthology.orchestra.run.trial168.stdout:VERSION_ID="9"
2026-02-20T16:35:16.245 INFO:teuthology.orchestra.run.trial168.stdout:PLATFORM_ID="platform:el9"
2026-02-20T16:35:16.246 INFO:teuthology.orchestra.run.trial168.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T16:35:16.246 INFO:teuthology.orchestra.run.trial168.stdout:ANSI_COLOR="0;31"
2026-02-20T16:35:16.246 INFO:teuthology.orchestra.run.trial168.stdout:LOGO="fedora-logo-icon"
2026-02-20T16:35:16.246 INFO:teuthology.orchestra.run.trial168.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T16:35:16.246 INFO:teuthology.orchestra.run.trial168.stdout:HOME_URL="https://centos.org/"
2026-02-20T16:35:16.246 INFO:teuthology.orchestra.run.trial168.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T16:35:16.246 INFO:teuthology.orchestra.run.trial168.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T16:35:16.246 INFO:teuthology.orchestra.run.trial168.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T16:35:16.247 INFO:teuthology.provision.fog.trial168:Deploy complete!
2026-02-20T16:35:16.248 DEBUG:teuthology.parallel:result is None
2026-02-20T16:35:16.531 INFO:teuthology.lock.ops:Checking trial168.front.sepia.ceph.com
2026-02-20T16:35:16.531 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-20T16:35:16.615 INFO:teuthology.lock.ops:Updating [trial168.front.sepia.ceph.com]: set os type and version on server
2026-02-20T16:35:16.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com'
2026-02-20T16:35:16.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T16:35:16.680 DEBUG:teuthology.orchestra.run.trial168:> true
2026-02-20T16:35:16.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com'
2026-02-20T16:35:16.754 DEBUG:teuthology.orchestra.run.trial168:> uname -m
2026-02-20T16:35:16.811 INFO:teuthology.orchestra.run.trial168.stdout:x86_64
2026-02-20T16:35:16.811 DEBUG:teuthology.orchestra.run.trial168:> cat /etc/os-release
2026-02-20T16:35:16.867 INFO:teuthology.orchestra.run.trial168.stdout:NAME="CentOS Stream"
2026-02-20T16:35:16.867 INFO:teuthology.orchestra.run.trial168.stdout:VERSION="9"
2026-02-20T16:35:16.867 INFO:teuthology.orchestra.run.trial168.stdout:ID="centos"
2026-02-20T16:35:16.867 INFO:teuthology.orchestra.run.trial168.stdout:ID_LIKE="rhel fedora"
2026-02-20T16:35:16.867 INFO:teuthology.orchestra.run.trial168.stdout:VERSION_ID="9"
2026-02-20T16:35:16.867 INFO:teuthology.orchestra.run.trial168.stdout:PLATFORM_ID="platform:el9"
2026-02-20T16:35:16.868 INFO:teuthology.orchestra.run.trial168.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T16:35:16.868 INFO:teuthology.orchestra.run.trial168.stdout:ANSI_COLOR="0;31"
2026-02-20T16:35:16.868 INFO:teuthology.orchestra.run.trial168.stdout:LOGO="fedora-logo-icon"
2026-02-20T16:35:16.868 INFO:teuthology.orchestra.run.trial168.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T16:35:16.868 INFO:teuthology.orchestra.run.trial168.stdout:HOME_URL="https://centos.org/"
2026-02-20T16:35:16.868 INFO:teuthology.orchestra.run.trial168.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T16:35:16.868 INFO:teuthology.orchestra.run.trial168.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T16:35:16.868 INFO:teuthology.orchestra.run.trial168.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T16:35:16.869 INFO:teuthology.lock.ops:Updating trial168.front.sepia.ceph.com on lock server
2026-02-20T16:35:16.974 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:35:17.073 INFO:teuthology.dispatcher.supervisor:Running job 60865
2026-02-20T16:35:17.073 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_yuriw@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/yuriw-2026-02-20_16:06:38-rados-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial/60865 --name yuriw-2026-02-20_16:06:38-rados-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial --description rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_latest}} -- /home/teuthworker/mnt/teuthology/yuriw-2026-02-20_16:06:38-rados-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial/60865/orig.config.yaml
2026-02-20T16:35:17.073 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/yuriw-2026-02-20_16:06:38-rados-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial/60865
2026-02-20T16:35:17.073 INFO:teuthology.dispatcher.supervisor:Job PID: 3125563
2026-02-20T16:35:17.073 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-20T16:37:17.074 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:39:17.197 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:41:17.317 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:43:17.440 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:45:17.570 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:45:17.694 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-20T16:45:17.761 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-20T16:45:18.066 INFO:teuthology.orchestra.console.trial168:Power off
2026-02-20T16:45:18.066 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T16:45:18.107 DEBUG:teuthology.orchestra.console.trial168:power off output: Chassis Power Control: Down/Off
2026-02-20T16:45:22.108 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T16:45:22.218 DEBUG:teuthology.orchestra.console.trial168:check power output: Chassis Power is on
2026-02-20T16:45:26.219 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T16:45:26.330 DEBUG:teuthology.orchestra.console.trial168:check power output: Chassis Power is off
2026-02-20T16:45:26.331 INFO:teuthology.orchestra.console.trial168:Power off completed
2026-02-20T16:45:26.539 INFO:teuthology.lock.ops:unlocked: trial168.front.sepia.ceph.com