2026-02-17T11:56:39.134 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-17T11:56:39.134 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T11:56:39.207 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T11:56:39.464 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x722daf590620>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x722daed3ac00>, signals=[15])
2026-02-17T11:56:39.464 INFO:teuthology.lock.ops:Start node 'trial069.front.sepia.ceph.com' reimaging
2026-02-17T11:56:39.464 INFO:teuthology.lock.ops:Updating [trial069.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T11:56:39.464 INFO:teuthology.lock.ops:Updating trial069.front.sepia.ceph.com on lock server
2026-02-17T11:56:39.523 INFO:teuthology.lock.ops:Start node 'trial130.front.sepia.ceph.com' reimaging
2026-02-17T11:56:39.523 INFO:teuthology.lock.ops:Updating [trial130.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T11:56:39.523 INFO:teuthology.lock.ops:Updating trial130.front.sepia.ceph.com on lock server
2026-02-17T11:56:39.582 INFO:teuthology.lock.ops:Start node 'trial189.front.sepia.ceph.com' reimaging
2026-02-17T11:56:39.582 INFO:teuthology.lock.ops:Updating [trial189.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T11:56:39.582 INFO:teuthology.lock.ops:Updating trial189.front.sepia.ceph.com on lock server
2026-02-17T11:56:39.825 DEBUG:teuthology.provision.fog.trial130:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T11:56:39.826 DEBUG:teuthology.provision.fog.trial069:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T11:56:39.879 INFO:teuthology.provision.fog.trial130:Scheduling deploy of centos 9.stream
2026-02-17T11:56:39.881 DEBUG:teuthology.provision.fog.trial189:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T11:56:39.883 INFO:teuthology.provision.fog.trial069:Scheduling deploy of centos 9.stream
2026-02-17T11:56:39.917 INFO:teuthology.provision.fog.trial189:Scheduling deploy of centos 9.stream
2026-02-17T11:56:41.165 INFO:teuthology.orchestra.console.trial130:Power off
2026-02-17T11:56:41.165 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T11:56:41.179 INFO:teuthology.orchestra.console.trial069:Power off
2026-02-17T11:56:41.179 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T11:56:41.189 INFO:teuthology.orchestra.console.trial189:Power off
2026-02-17T11:56:41.189 DEBUG:teuthology.orchestra.console.trial189:pexpect command: ipmitool -H trial189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T11:56:41.205 DEBUG:teuthology.orchestra.console.trial130:power off output: Chassis Power Control: Down/Off
2026-02-17T11:56:41.224 DEBUG:teuthology.orchestra.console.trial069:power off output: Chassis Power Control: Down/Off
2026-02-17T11:56:41.225 DEBUG:teuthology.orchestra.console.trial189:power off output: Chassis Power Control: Down/Off
2026-02-17T11:56:45.210 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T11:56:45.225 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T11:56:45.231 DEBUG:teuthology.orchestra.console.trial189:pexpect command: ipmitool -H trial189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T11:56:45.319 DEBUG:teuthology.orchestra.console.trial130:check power output: Chassis Power is off
2026-02-17T11:56:45.320 INFO:teuthology.orchestra.console.trial130:Power off completed
2026-02-17T11:56:45.334 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is off
2026-02-17T11:56:45.334 INFO:teuthology.orchestra.console.trial069:Power off completed
2026-02-17T11:56:45.338 DEBUG:teuthology.orchestra.console.trial189:check power output: Chassis Power is off
2026-02-17T11:56:45.339 INFO:teuthology.orchestra.console.trial189:Power off completed
2026-02-17T11:56:45.421 INFO:teuthology.orchestra.console.trial130:Power on
2026-02-17T11:56:45.421 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T11:56:45.434 INFO:teuthology.orchestra.console.trial069:Power on
2026-02-17T11:56:45.435 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T11:56:45.445 INFO:teuthology.orchestra.console.trial189:Power on
2026-02-17T11:56:45.445 DEBUG:teuthology.orchestra.console.trial189:pexpect command: ipmitool -H trial189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T11:56:45.461 DEBUG:teuthology.orchestra.console.trial130:power on output: Chassis Power Control: Up/On
2026-02-17T11:56:45.476 DEBUG:teuthology.orchestra.console.trial069:power on output: Chassis Power Control: Up/On
2026-02-17T11:56:45.484 DEBUG:teuthology.orchestra.console.trial189:power on output: Chassis Power Control: Up/On
2026-02-17T11:56:49.466 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T11:56:49.477 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T11:56:49.485 DEBUG:teuthology.orchestra.console.trial189:pexpect command: ipmitool -H trial189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T11:56:49.577 DEBUG:teuthology.orchestra.console.trial130:check power output: Chassis Power is on
2026-02-17T11:56:49.577 INFO:teuthology.orchestra.console.trial130:Power on completed
2026-02-17T11:56:49.586 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is on
2026-02-17T11:56:49.586 INFO:teuthology.orchestra.console.trial069:Power on completed
2026-02-17T11:56:49.595 DEBUG:teuthology.orchestra.console.trial189:check power output: Chassis Power is on
2026-02-17T11:56:49.595 INFO:teuthology.orchestra.console.trial189:Power on completed
2026-02-17T11:56:49.678 INFO:teuthology.provision.fog.trial130:Waiting for deploy to finish
2026-02-17T11:56:49.688 INFO:teuthology.provision.fog.trial069:Waiting for deploy to finish
2026-02-17T11:56:49.696 INFO:teuthology.provision.fog.trial189:Waiting for deploy to finish
2026-02-17T11:58:37.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:58:37.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:58:37.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:58:37.636 ERROR:teuthology.orchestra.connection:Error authenticating with trial189.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-17T11:59:37.471 WARNING:teuthology.provision.fog.trial069:timed out
2026-02-17T11:59:37.521 WARNING:teuthology.provision.fog.trial130:timed out
2026-02-17T11:59:41.643 WARNING:teuthology.provision.fog.trial189:timed out
2026-02-17T11:59:43.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:59:43.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:59:47.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:59:50.860 ERROR:teuthology.orchestra.connection:Error authenticating with trial130.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T11:59:54.946 ERROR:teuthology.orchestra.connection:Error authenticating with trial189.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T11:59:55.034 ERROR:teuthology.orchestra.connection:Error authenticating with trial130.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T11:59:59.058 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T11:59:59.058 DEBUG:teuthology.orchestra.run.trial189:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T12:00:02.144 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T12:00:02.144 DEBUG:teuthology.orchestra.run.trial130:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T12:00:02.304 INFO:teuthology.provision.fog.trial130:Node is ready
2026-02-17T12:00:02.304 DEBUG:teuthology.orchestra.run.trial130:> hostname
2026-02-17T12:00:02.361 INFO:teuthology.orchestra.run.trial130.stdout:trial130.front.sepia.ceph.com
2026-02-17T12:00:02.362 DEBUG:teuthology.orchestra.run.trial130:> grep trial130.front.sepia.ceph.com /etc/hosts
2026-02-17T12:00:02.418 INFO:teuthology.orchestra.run.trial130.stdout:10.20.193.130 trial130.front.sepia.ceph.com trial130
2026-02-17T12:00:02.418 DEBUG:teuthology.orchestra.run.trial130:> sudo hostname trial130
2026-02-17T12:00:02.488 DEBUG:teuthology.orchestra.run.trial130:> sudo sed -i -e 's/trial130.front.sepia.ceph.com/trial130/g' /etc/hosts
2026-02-17T12:00:02.553 DEBUG:teuthology.orchestra.run.trial130:> sudo sed -i -e 's/10.20.193.130/10.20.193.130/g' /etc/hosts
2026-02-17T12:00:02.618 DEBUG:teuthology.orchestra.run.trial130:> sudo sed -i -e 's/trial130.front.sepia.ceph.com/trial130/g' /etc/hostname
2026-02-17T12:00:02.683 DEBUG:teuthology.orchestra.run.trial130:> sudo hostname trial130
2026-02-17T12:00:02.748 DEBUG:teuthology.orchestra.run.trial130:> cat /etc/os-release
2026-02-17T12:00:02.804 INFO:teuthology.orchestra.run.trial130.stdout:NAME="CentOS Stream"
2026-02-17T12:00:02.804 INFO:teuthology.orchestra.run.trial130.stdout:VERSION="9"
2026-02-17T12:00:02.804 INFO:teuthology.orchestra.run.trial130.stdout:ID="centos"
2026-02-17T12:00:02.805 INFO:teuthology.orchestra.run.trial130.stdout:ID_LIKE="rhel fedora"
2026-02-17T12:00:02.805 INFO:teuthology.orchestra.run.trial130.stdout:VERSION_ID="9"
2026-02-17T12:00:02.805 INFO:teuthology.orchestra.run.trial130.stdout:PLATFORM_ID="platform:el9"
2026-02-17T12:00:02.805 INFO:teuthology.orchestra.run.trial130.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T12:00:02.805 INFO:teuthology.orchestra.run.trial130.stdout:ANSI_COLOR="0;31"
2026-02-17T12:00:02.805 INFO:teuthology.orchestra.run.trial130.stdout:LOGO="fedora-logo-icon"
2026-02-17T12:00:02.805 INFO:teuthology.orchestra.run.trial130.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T12:00:02.805 INFO:teuthology.orchestra.run.trial130.stdout:HOME_URL="https://centos.org/"
2026-02-17T12:00:02.806 INFO:teuthology.orchestra.run.trial130.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T12:00:02.806 INFO:teuthology.orchestra.run.trial130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T12:00:02.806 INFO:teuthology.orchestra.run.trial130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T12:00:02.807 INFO:teuthology.provision.fog.trial130:Deploy complete!
2026-02-17T12:00:02.808 DEBUG:teuthology.parallel:result is None
2026-02-17T12:00:04.092 INFO:teuthology.provision.fog.trial189:Node is ready
2026-02-17T12:00:04.092 DEBUG:teuthology.orchestra.run.trial189:> hostname
2026-02-17T12:00:04.112 INFO:teuthology.orchestra.run.trial189.stdout:trial189.front.sepia.ceph.com
2026-02-17T12:00:04.112 DEBUG:teuthology.orchestra.run.trial189:> grep trial189.front.sepia.ceph.com /etc/hosts
2026-02-17T12:00:04.167 INFO:teuthology.orchestra.run.trial189.stdout:10.20.193.189 trial189.front.sepia.ceph.com trial189
2026-02-17T12:00:04.167 DEBUG:teuthology.orchestra.run.trial189:> sudo hostname trial189
2026-02-17T12:00:04.241 DEBUG:teuthology.orchestra.run.trial189:> sudo sed -i -e 's/trial189.front.sepia.ceph.com/trial189/g' /etc/hosts
2026-02-17T12:00:04.305 DEBUG:teuthology.orchestra.run.trial189:> sudo sed -i -e 's/10.20.193.189/10.20.193.189/g' /etc/hosts
2026-02-17T12:00:04.372 DEBUG:teuthology.orchestra.run.trial189:> sudo sed -i -e 's/trial189.front.sepia.ceph.com/trial189/g' /etc/hostname
2026-02-17T12:00:04.439 DEBUG:teuthology.orchestra.run.trial189:> sudo hostname trial189
2026-02-17T12:00:04.505 DEBUG:teuthology.orchestra.run.trial189:> cat /etc/os-release
2026-02-17T12:00:04.562 INFO:teuthology.orchestra.run.trial189.stdout:NAME="CentOS Stream"
2026-02-17T12:00:04.562 INFO:teuthology.orchestra.run.trial189.stdout:VERSION="9"
2026-02-17T12:00:04.562 INFO:teuthology.orchestra.run.trial189.stdout:ID="centos"
2026-02-17T12:00:04.562 INFO:teuthology.orchestra.run.trial189.stdout:ID_LIKE="rhel fedora"
2026-02-17T12:00:04.563 INFO:teuthology.orchestra.run.trial189.stdout:VERSION_ID="9"
2026-02-17T12:00:04.563 INFO:teuthology.orchestra.run.trial189.stdout:PLATFORM_ID="platform:el9"
2026-02-17T12:00:04.563 INFO:teuthology.orchestra.run.trial189.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T12:00:04.563 INFO:teuthology.orchestra.run.trial189.stdout:ANSI_COLOR="0;31"
2026-02-17T12:00:04.563 INFO:teuthology.orchestra.run.trial189.stdout:LOGO="fedora-logo-icon"
2026-02-17T12:00:04.563 INFO:teuthology.orchestra.run.trial189.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T12:00:04.563 INFO:teuthology.orchestra.run.trial189.stdout:HOME_URL="https://centos.org/"
2026-02-17T12:00:04.563 INFO:teuthology.orchestra.run.trial189.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T12:00:04.563 INFO:teuthology.orchestra.run.trial189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T12:00:04.563 INFO:teuthology.orchestra.run.trial189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T12:00:04.564 INFO:teuthology.provision.fog.trial189:Deploy complete!
2026-02-17T12:00:04.565 DEBUG:teuthology.parallel:result is None
2026-02-17T12:00:19.459 ERROR:teuthology.orchestra.connection:Error authenticating with trial069.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T12:00:23.570 ERROR:teuthology.orchestra.connection:Error authenticating with trial069.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T12:00:30.681 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T12:00:30.681 DEBUG:teuthology.orchestra.run.trial069:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T12:00:30.833 INFO:teuthology.provision.fog.trial069:Node is ready
2026-02-17T12:00:30.834 DEBUG:teuthology.orchestra.run.trial069:> hostname
2026-02-17T12:00:30.890 INFO:teuthology.orchestra.run.trial069.stdout:trial069.front.sepia.ceph.com
2026-02-17T12:00:30.891 DEBUG:teuthology.orchestra.run.trial069:> grep trial069.front.sepia.ceph.com /etc/hosts
2026-02-17T12:00:30.947 INFO:teuthology.orchestra.run.trial069.stdout:10.20.193.69 trial069.front.sepia.ceph.com trial069
2026-02-17T12:00:30.947 DEBUG:teuthology.orchestra.run.trial069:> sudo hostname trial069
2026-02-17T12:00:31.016 DEBUG:teuthology.orchestra.run.trial069:> sudo sed -i -e 's/trial069.front.sepia.ceph.com/trial069/g' /etc/hosts
2026-02-17T12:00:31.080 DEBUG:teuthology.orchestra.run.trial069:> sudo sed -i -e 's/10.20.193.69/10.20.193.69/g' /etc/hosts
2026-02-17T12:00:31.145 DEBUG:teuthology.orchestra.run.trial069:> sudo sed -i -e 's/trial069.front.sepia.ceph.com/trial069/g' /etc/hostname
2026-02-17T12:00:31.207 DEBUG:teuthology.orchestra.run.trial069:> sudo hostname trial069
2026-02-17T12:00:31.271 DEBUG:teuthology.orchestra.run.trial069:> cat /etc/os-release
2026-02-17T12:00:31.327 INFO:teuthology.orchestra.run.trial069.stdout:NAME="CentOS Stream"
2026-02-17T12:00:31.327 INFO:teuthology.orchestra.run.trial069.stdout:VERSION="9"
2026-02-17T12:00:31.327 INFO:teuthology.orchestra.run.trial069.stdout:ID="centos"
2026-02-17T12:00:31.327 INFO:teuthology.orchestra.run.trial069.stdout:ID_LIKE="rhel fedora"
2026-02-17T12:00:31.327 INFO:teuthology.orchestra.run.trial069.stdout:VERSION_ID="9"
2026-02-17T12:00:31.327 INFO:teuthology.orchestra.run.trial069.stdout:PLATFORM_ID="platform:el9"
2026-02-17T12:00:31.327 INFO:teuthology.orchestra.run.trial069.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T12:00:31.327 INFO:teuthology.orchestra.run.trial069.stdout:ANSI_COLOR="0;31"
2026-02-17T12:00:31.328 INFO:teuthology.orchestra.run.trial069.stdout:LOGO="fedora-logo-icon"
2026-02-17T12:00:31.328 INFO:teuthology.orchestra.run.trial069.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T12:00:31.328 INFO:teuthology.orchestra.run.trial069.stdout:HOME_URL="https://centos.org/"
2026-02-17T12:00:31.328 INFO:teuthology.orchestra.run.trial069.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T12:00:31.328 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T12:00:31.328 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T12:00:31.328 INFO:teuthology.provision.fog.trial069:Deploy complete!
2026-02-17T12:00:31.329 DEBUG:teuthology.parallel:result is None
2026-02-17T12:00:31.881 INFO:teuthology.lock.ops:Checking trial069.front.sepia.ceph.com
2026-02-17T12:00:31.881 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T12:00:31.986 INFO:teuthology.lock.ops:Checking trial130.front.sepia.ceph.com
2026-02-17T12:00:31.986 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T12:00:32.067 INFO:teuthology.lock.ops:Checking trial189.front.sepia.ceph.com
2026-02-17T12:00:32.067 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T12:00:32.123 INFO:teuthology.lock.ops:Updating [trial069.front.sepia.ceph.com]: set os type and version on server
2026-02-17T12:00:32.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial069.front.sepia.ceph.com'
2026-02-17T12:00:32.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T12:00:32.185 DEBUG:teuthology.orchestra.run.trial069:> true
2026-02-17T12:00:32.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial069.front.sepia.ceph.com'
2026-02-17T12:00:32.258 DEBUG:teuthology.orchestra.run.trial069:> uname -m
2026-02-17T12:00:32.314 INFO:teuthology.orchestra.run.trial069.stdout:x86_64
2026-02-17T12:00:32.315 DEBUG:teuthology.orchestra.run.trial069:> cat /etc/os-release
2026-02-17T12:00:32.370 INFO:teuthology.orchestra.run.trial069.stdout:NAME="CentOS Stream"
2026-02-17T12:00:32.370 INFO:teuthology.orchestra.run.trial069.stdout:VERSION="9"
2026-02-17T12:00:32.370 INFO:teuthology.orchestra.run.trial069.stdout:ID="centos"
2026-02-17T12:00:32.370 INFO:teuthology.orchestra.run.trial069.stdout:ID_LIKE="rhel fedora"
2026-02-17T12:00:32.370 INFO:teuthology.orchestra.run.trial069.stdout:VERSION_ID="9"
2026-02-17T12:00:32.370 INFO:teuthology.orchestra.run.trial069.stdout:PLATFORM_ID="platform:el9"
2026-02-17T12:00:32.370 INFO:teuthology.orchestra.run.trial069.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T12:00:32.370 INFO:teuthology.orchestra.run.trial069.stdout:ANSI_COLOR="0;31"
2026-02-17T12:00:32.370 INFO:teuthology.orchestra.run.trial069.stdout:LOGO="fedora-logo-icon"
2026-02-17T12:00:32.370 INFO:teuthology.orchestra.run.trial069.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T12:00:32.370 INFO:teuthology.orchestra.run.trial069.stdout:HOME_URL="https://centos.org/"
2026-02-17T12:00:32.370 INFO:teuthology.orchestra.run.trial069.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T12:00:32.370 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T12:00:32.370 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T12:00:32.371 INFO:teuthology.lock.ops:Updating trial069.front.sepia.ceph.com on lock server
2026-02-17T12:00:32.440 INFO:teuthology.lock.ops:Updating [trial130.front.sepia.ceph.com]: set os type and version on server
2026-02-17T12:00:32.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial130.front.sepia.ceph.com'
2026-02-17T12:00:32.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T12:00:32.503 DEBUG:teuthology.orchestra.run.trial130:> true
2026-02-17T12:00:32.646 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial130.front.sepia.ceph.com'
2026-02-17T12:00:32.646 DEBUG:teuthology.orchestra.run.trial130:> uname -m
2026-02-17T12:00:32.703 INFO:teuthology.orchestra.run.trial130.stdout:x86_64
2026-02-17T12:00:32.703 DEBUG:teuthology.orchestra.run.trial130:> cat /etc/os-release
2026-02-17T12:00:32.760 INFO:teuthology.orchestra.run.trial130.stdout:NAME="CentOS Stream"
2026-02-17T12:00:32.760 INFO:teuthology.orchestra.run.trial130.stdout:VERSION="9"
2026-02-17T12:00:32.760 INFO:teuthology.orchestra.run.trial130.stdout:ID="centos"
2026-02-17T12:00:32.760 INFO:teuthology.orchestra.run.trial130.stdout:ID_LIKE="rhel fedora"
2026-02-17T12:00:32.760 INFO:teuthology.orchestra.run.trial130.stdout:VERSION_ID="9"
2026-02-17T12:00:32.760 INFO:teuthology.orchestra.run.trial130.stdout:PLATFORM_ID="platform:el9"
2026-02-17T12:00:32.760 INFO:teuthology.orchestra.run.trial130.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T12:00:32.761 INFO:teuthology.orchestra.run.trial130.stdout:ANSI_COLOR="0;31"
2026-02-17T12:00:32.761 INFO:teuthology.orchestra.run.trial130.stdout:LOGO="fedora-logo-icon"
2026-02-17T12:00:32.761 INFO:teuthology.orchestra.run.trial130.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T12:00:32.761 INFO:teuthology.orchestra.run.trial130.stdout:HOME_URL="https://centos.org/"
2026-02-17T12:00:32.761 INFO:teuthology.orchestra.run.trial130.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T12:00:32.761 INFO:teuthology.orchestra.run.trial130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T12:00:32.761 INFO:teuthology.orchestra.run.trial130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T12:00:32.762 INFO:teuthology.lock.ops:Updating trial130.front.sepia.ceph.com on lock server
2026-02-17T12:00:32.865 INFO:teuthology.lock.ops:Updating [trial189.front.sepia.ceph.com]: set os type and version on server
2026-02-17T12:00:32.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial189.front.sepia.ceph.com'
2026-02-17T12:00:32.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T12:00:32.943 DEBUG:teuthology.orchestra.run.trial189:> true
2026-02-17T12:00:33.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial189.front.sepia.ceph.com'
2026-02-17T12:00:33.090 DEBUG:teuthology.orchestra.run.trial189:> uname -m
2026-02-17T12:00:33.147 INFO:teuthology.orchestra.run.trial189.stdout:x86_64
2026-02-17T12:00:33.147 DEBUG:teuthology.orchestra.run.trial189:> cat /etc/os-release
2026-02-17T12:00:33.204 INFO:teuthology.orchestra.run.trial189.stdout:NAME="CentOS Stream"
2026-02-17T12:00:33.204 INFO:teuthology.orchestra.run.trial189.stdout:VERSION="9"
2026-02-17T12:00:33.204 INFO:teuthology.orchestra.run.trial189.stdout:ID="centos"
2026-02-17T12:00:33.204 INFO:teuthology.orchestra.run.trial189.stdout:ID_LIKE="rhel fedora"
2026-02-17T12:00:33.204 INFO:teuthology.orchestra.run.trial189.stdout:VERSION_ID="9"
2026-02-17T12:00:33.204 INFO:teuthology.orchestra.run.trial189.stdout:PLATFORM_ID="platform:el9"
2026-02-17T12:00:33.204 INFO:teuthology.orchestra.run.trial189.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T12:00:33.204 INFO:teuthology.orchestra.run.trial189.stdout:ANSI_COLOR="0;31"
2026-02-17T12:00:33.204 INFO:teuthology.orchestra.run.trial189.stdout:LOGO="fedora-logo-icon"
2026-02-17T12:00:33.204 INFO:teuthology.orchestra.run.trial189.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T12:00:33.204 INFO:teuthology.orchestra.run.trial189.stdout:HOME_URL="https://centos.org/"
2026-02-17T12:00:33.204 INFO:teuthology.orchestra.run.trial189.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T12:00:33.204 INFO:teuthology.orchestra.run.trial189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T12:00:33.204 INFO:teuthology.orchestra.run.trial189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T12:00:33.205 INFO:teuthology.lock.ops:Updating trial189.front.sepia.ceph.com on lock server
2026-02-17T12:00:33.267 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T12:00:33.355 INFO:teuthology.dispatcher.supervisor:Running job 51402
2026-02-17T12:00:33.355 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_skanta@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51402 --name skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51402/orig.config.yaml
2026-02-17T12:00:33.355 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51402
2026-02-17T12:00:33.355 INFO:teuthology.dispatcher.supervisor:Job PID: 359481
2026-02-17T12:00:33.355 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-17T12:02:33.356 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T12:04:33.435 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T12:06:33.553 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T12:08:33.674 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T12:10:33.751 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T12:12:33.877 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T12:14:33.994 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T12:16:34.136 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T12:18:34.228 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T12:20:34.311 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T12:22:34.425 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T12:24:34.545 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T12:26:34.635 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T12:26:34.754 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-17T12:26:34.937 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-17T12:26:35.694 INFO:teuthology.orchestra.console.trial130:Power off
2026-02-17T12:26:35.695 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T12:26:35.703 INFO:teuthology.orchestra.console.trial069:Power off
2026-02-17T12:26:35.703 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T12:26:35.721 INFO:teuthology.orchestra.console.trial189:Power off
2026-02-17T12:26:35.721 DEBUG:teuthology.orchestra.console.trial189:pexpect command: ipmitool -H trial189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T12:26:35.733 DEBUG:teuthology.orchestra.console.trial130:power off output: Chassis Power Control: Down/Off
2026-02-17T12:26:35.749 DEBUG:teuthology.orchestra.console.trial069:power off output: Chassis Power Control: Down/Off
2026-02-17T12:26:35.759 DEBUG:teuthology.orchestra.console.trial189:power off output: Chassis Power Control: Down/Off
2026-02-17T12:26:39.734 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T12:26:39.749 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T12:26:39.759 DEBUG:teuthology.orchestra.console.trial189:pexpect command: ipmitool -H trial189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T12:26:39.845 DEBUG:teuthology.orchestra.console.trial130:check power output: Chassis Power is on
2026-02-17T12:26:39.860 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is on
2026-02-17T12:26:39.867 DEBUG:teuthology.orchestra.console.trial189:check power output: Chassis Power is on
2026-02-17T12:26:43.846 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T12:26:43.861 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T12:26:43.870 DEBUG:teuthology.orchestra.console.trial189:pexpect command: ipmitool -H trial189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T12:26:43.957 DEBUG:teuthology.orchestra.console.trial130:check power output: Chassis Power is off
2026-02-17T12:26:43.957 INFO:teuthology.orchestra.console.trial130:Power off completed
2026-02-17T12:26:43.972 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is off
2026-02-17T12:26:43.972 INFO:teuthology.orchestra.console.trial069:Power off completed
2026-02-17T12:26:43.979 DEBUG:teuthology.orchestra.console.trial189:check power output: Chassis Power is off
2026-02-17T12:26:43.979 INFO:teuthology.orchestra.console.trial189:Power off completed
2026-02-17T12:26:44.249 INFO:teuthology.lock.ops:unlocked: trial130.front.sepia.ceph.com
2026-02-17T12:26:44.258 INFO:teuthology.lock.ops:unlocked: trial069.front.sepia.ceph.com
2026-02-17T12:26:44.262 INFO:teuthology.lock.ops:unlocked: trial189.front.sepia.ceph.com