2026-02-17T03:55:27.061 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-17T03:55:27.061 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T03:55:27.134 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T03:55:27.384 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x79614c9ce5a0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x79614c211620>, signals=[15])
2026-02-17T03:55:27.384 INFO:teuthology.lock.ops:Start node 'trial102.front.sepia.ceph.com' reimaging
2026-02-17T03:55:27.385 INFO:teuthology.lock.ops:Updating [trial102.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T03:55:27.385 INFO:teuthology.lock.ops:Updating trial102.front.sepia.ceph.com on lock server
2026-02-17T03:55:27.441 INFO:teuthology.lock.ops:Start node 'trial121.front.sepia.ceph.com' reimaging
2026-02-17T03:55:27.441 INFO:teuthology.lock.ops:Updating [trial121.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T03:55:27.441 INFO:teuthology.lock.ops:Updating trial121.front.sepia.ceph.com on lock server
2026-02-17T03:55:27.498 INFO:teuthology.lock.ops:Start node 'trial178.front.sepia.ceph.com' reimaging
2026-02-17T03:55:27.498 INFO:teuthology.lock.ops:Updating [trial178.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T03:55:27.498 INFO:teuthology.lock.ops:Updating trial178.front.sepia.ceph.com on lock server
2026-02-17T03:55:27.700 DEBUG:teuthology.provision.fog.trial102:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T03:55:27.701 DEBUG:teuthology.provision.fog.trial121:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T03:55:27.724 INFO:teuthology.provision.fog.trial121:Scheduling deploy of centos 9.stream
2026-02-17T03:55:27.730 DEBUG:teuthology.provision.fog.trial178:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T03:55:27.746 INFO:teuthology.provision.fog.trial102:Scheduling deploy of centos 9.stream
2026-02-17T03:55:27.751 INFO:teuthology.provision.fog.trial178:Scheduling deploy of centos 9.stream
2026-02-17T03:55:30.053 INFO:teuthology.orchestra.console.trial121:Power off
2026-02-17T03:55:30.053 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T03:55:30.156 DEBUG:teuthology.orchestra.console.trial121:power off output: Chassis Power Control: Down/Off
2026-02-17T03:55:30.166 INFO:teuthology.orchestra.console.trial178:Power off
2026-02-17T03:55:30.166 DEBUG:teuthology.orchestra.console.trial178:pexpect command: ipmitool -H trial178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T03:55:30.176 INFO:teuthology.orchestra.console.trial102:Power off
2026-02-17T03:55:30.176 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T03:55:30.203 DEBUG:teuthology.orchestra.console.trial178:power off output: Chassis Power Control: Down/Off
2026-02-17T03:55:30.213 DEBUG:teuthology.orchestra.console.trial102:power off output: Chassis Power Control: Down/Off
2026-02-17T03:55:34.160 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T03:55:34.205 DEBUG:teuthology.orchestra.console.trial178:pexpect command: ipmitool -H trial178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T03:55:34.214 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T03:55:34.269 DEBUG:teuthology.orchestra.console.trial121:check power output: Chassis Power is off
2026-02-17T03:55:34.270 INFO:teuthology.orchestra.console.trial121:Power off completed
2026-02-17T03:55:34.312 DEBUG:teuthology.orchestra.console.trial178:check power output: Chassis Power is off
2026-02-17T03:55:34.312 INFO:teuthology.orchestra.console.trial178:Power off completed
2026-02-17T03:55:34.322 DEBUG:teuthology.orchestra.console.trial102:check power output: Chassis Power is off
2026-02-17T03:55:34.322 INFO:teuthology.orchestra.console.trial102:Power off completed
2026-02-17T03:55:34.371 INFO:teuthology.orchestra.console.trial121:Power on
2026-02-17T03:55:34.371 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T03:55:34.413 INFO:teuthology.orchestra.console.trial178:Power on
2026-02-17T03:55:34.414 DEBUG:teuthology.orchestra.console.trial178:pexpect command: ipmitool -H trial178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T03:55:34.421 DEBUG:teuthology.orchestra.console.trial121:power on output: Chassis Power Control: Up/On
2026-02-17T03:55:34.422 INFO:teuthology.orchestra.console.trial102:Power on
2026-02-17T03:55:34.423 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T03:55:34.452 DEBUG:teuthology.orchestra.console.trial178:power on output: Chassis Power Control: Up/On
2026-02-17T03:55:34.462 DEBUG:teuthology.orchestra.console.trial102:power on output: Chassis Power Control: Up/On
2026-02-17T03:55:38.425 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T03:55:38.454 DEBUG:teuthology.orchestra.console.trial178:pexpect command: ipmitool -H trial178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T03:55:38.463 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T03:55:38.536 DEBUG:teuthology.orchestra.console.trial121:check power output: Chassis Power is on
2026-02-17T03:55:38.536 INFO:teuthology.orchestra.console.trial121:Power on completed
2026-02-17T03:55:38.562 DEBUG:teuthology.orchestra.console.trial178:check power output: Chassis Power is on
2026-02-17T03:55:38.562 INFO:teuthology.orchestra.console.trial178:Power on completed
2026-02-17T03:55:38.572 DEBUG:teuthology.orchestra.console.trial102:check power output: Chassis Power is off
2026-02-17T03:55:38.637 INFO:teuthology.provision.fog.trial121:Waiting for deploy to finish
2026-02-17T03:55:38.663 INFO:teuthology.provision.fog.trial178:Waiting for deploy to finish
2026-02-17T03:55:42.576 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T03:55:42.685 DEBUG:teuthology.orchestra.console.trial102:check power output: Chassis Power is on
2026-02-17T03:55:42.686 INFO:teuthology.orchestra.console.trial102:Power on completed
2026-02-17T03:55:42.786 INFO:teuthology.provision.fog.trial102:Waiting for deploy to finish
2026-02-17T03:58:43.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T03:58:46.271 WARNING:teuthology.provision.fog.trial178:[Errno None] Unable to connect to port 22 on 10.20.193.178
2026-02-17T03:58:52.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T03:58:55.360 WARNING:teuthology.provision.fog.trial178:[Errno None] Unable to connect to port 22 on 10.20.193.178
2026-02-17T03:59:01.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T03:59:04.448 WARNING:teuthology.provision.fog.trial178:[Errno None] Unable to connect to port 22 on 10.20.193.178
2026-02-17T03:59:10.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T03:59:13.536 WARNING:teuthology.provision.fog.trial178:[Errno None] Unable to connect to port 22 on 10.20.193.178
2026-02-17T03:59:13.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T03:59:14.047 ERROR:teuthology.orchestra.connection:Error authenticating with trial121.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-17T03:59:19.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T03:59:22.623 WARNING:teuthology.provision.fog.trial178:[Errno None] Unable to connect to port 22 on 10.20.193.178
2026-02-17T03:59:28.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:00:04.605 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T04:00:04.605 DEBUG:teuthology.orchestra.run.trial178:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T04:00:18.049 WARNING:teuthology.provision.fog.trial121:timed out
2026-02-17T04:00:21.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:00:24.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:00:24.256 WARNING:teuthology.provision.fog.trial102:[Errno None] Unable to connect to port 22 on 10.20.193.102
2026-02-17T04:00:28.292 ERROR:teuthology.orchestra.connection:Error authenticating with trial121.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T04:00:30.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:00:32.439 ERROR:teuthology.orchestra.connection:Error authenticating with trial121.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T04:00:33.344 WARNING:teuthology.provision.fog.trial102:[Errno None] Unable to connect to port 22 on 10.20.193.102
2026-02-17T04:00:39.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:00:39.550 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T04:00:39.550 DEBUG:teuthology.orchestra.run.trial121:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T04:00:39.719 INFO:teuthology.provision.fog.trial121:Node is ready
2026-02-17T04:00:39.719 DEBUG:teuthology.orchestra.run.trial121:> hostname
2026-02-17T04:00:39.775 INFO:teuthology.orchestra.run.trial121.stdout:trial121.front.sepia.ceph.com
2026-02-17T04:00:39.775 DEBUG:teuthology.orchestra.run.trial121:> grep trial121.front.sepia.ceph.com /etc/hosts
2026-02-17T04:00:39.830 INFO:teuthology.orchestra.run.trial121.stdout:10.20.193.121 trial121.front.sepia.ceph.com trial121
2026-02-17T04:00:39.831 DEBUG:teuthology.orchestra.run.trial121:> sudo hostname trial121
2026-02-17T04:00:39.899 DEBUG:teuthology.orchestra.run.trial121:> sudo sed -i -e 's/trial121.front.sepia.ceph.com/trial121/g' /etc/hosts
2026-02-17T04:00:39.964 DEBUG:teuthology.orchestra.run.trial121:> sudo sed -i -e 's/10.20.193.121/10.20.193.121/g' /etc/hosts
2026-02-17T04:00:40.030 DEBUG:teuthology.orchestra.run.trial121:> sudo sed -i -e 's/trial121.front.sepia.ceph.com/trial121/g' /etc/hostname
2026-02-17T04:00:40.095 DEBUG:teuthology.orchestra.run.trial121:> sudo hostname trial121
2026-02-17T04:00:40.158 DEBUG:teuthology.orchestra.run.trial121:> cat /etc/os-release
2026-02-17T04:00:40.214 INFO:teuthology.orchestra.run.trial121.stdout:NAME="CentOS Stream"
2026-02-17T04:00:40.214 INFO:teuthology.orchestra.run.trial121.stdout:VERSION="9"
2026-02-17T04:00:40.214 INFO:teuthology.orchestra.run.trial121.stdout:ID="centos"
2026-02-17T04:00:40.214 INFO:teuthology.orchestra.run.trial121.stdout:ID_LIKE="rhel fedora"
2026-02-17T04:00:40.214 INFO:teuthology.orchestra.run.trial121.stdout:VERSION_ID="9"
2026-02-17T04:00:40.215 INFO:teuthology.orchestra.run.trial121.stdout:PLATFORM_ID="platform:el9"
2026-02-17T04:00:40.215 INFO:teuthology.orchestra.run.trial121.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T04:00:40.215 INFO:teuthology.orchestra.run.trial121.stdout:ANSI_COLOR="0;31"
2026-02-17T04:00:40.215 INFO:teuthology.orchestra.run.trial121.stdout:LOGO="fedora-logo-icon"
2026-02-17T04:00:40.215 INFO:teuthology.orchestra.run.trial121.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T04:00:40.215 INFO:teuthology.orchestra.run.trial121.stdout:HOME_URL="https://centos.org/"
2026-02-17T04:00:40.215 INFO:teuthology.orchestra.run.trial121.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T04:00:40.215 INFO:teuthology.orchestra.run.trial121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T04:00:40.215 INFO:teuthology.orchestra.run.trial121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T04:00:40.216 INFO:teuthology.provision.fog.trial121:Deploy complete!
2026-02-17T04:00:40.217 DEBUG:teuthology.parallel:result is None
2026-02-17T04:00:42.432 WARNING:teuthology.provision.fog.trial102:[Errno None] Unable to connect to port 22 on 10.20.193.102
2026-02-17T04:00:48.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:00:51.520 WARNING:teuthology.provision.fog.trial102:[Errno None] Unable to connect to port 22 on 10.20.193.102
2026-02-17T04:00:57.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:01:33.657 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T04:01:33.657 DEBUG:teuthology.orchestra.run.trial102:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T04:01:38.689 INFO:teuthology.provision.fog.trial102:Node is ready
2026-02-17T04:01:38.689 DEBUG:teuthology.orchestra.run.trial102:> hostname
2026-02-17T04:01:38.705 INFO:teuthology.orchestra.run.trial102.stdout:trial102.front.sepia.ceph.com
2026-02-17T04:01:38.705 DEBUG:teuthology.orchestra.run.trial102:> grep trial102.front.sepia.ceph.com /etc/hosts
2026-02-17T04:01:38.762 INFO:teuthology.orchestra.run.trial102.stdout:10.20.193.102 trial102.front.sepia.ceph.com trial102
2026-02-17T04:01:38.762 DEBUG:teuthology.orchestra.run.trial102:> sudo hostname trial102
2026-02-17T04:01:38.833 DEBUG:teuthology.orchestra.run.trial102:> sudo sed -i -e 's/trial102.front.sepia.ceph.com/trial102/g' /etc/hosts
2026-02-17T04:01:38.897 DEBUG:teuthology.orchestra.run.trial102:> sudo sed -i -e 's/10.20.193.102/10.20.193.102/g' /etc/hosts
2026-02-17T04:01:38.962 DEBUG:teuthology.orchestra.run.trial102:> sudo sed -i -e 's/trial102.front.sepia.ceph.com/trial102/g' /etc/hostname
2026-02-17T04:01:39.027 DEBUG:teuthology.orchestra.run.trial102:> sudo hostname trial102
2026-02-17T04:01:39.091 DEBUG:teuthology.orchestra.run.trial102:> cat /etc/os-release
2026-02-17T04:01:39.147 INFO:teuthology.orchestra.run.trial102.stdout:NAME="CentOS Stream"
2026-02-17T04:01:39.148 INFO:teuthology.orchestra.run.trial102.stdout:VERSION="9"
2026-02-17T04:01:39.148 INFO:teuthology.orchestra.run.trial102.stdout:ID="centos"
2026-02-17T04:01:39.148 INFO:teuthology.orchestra.run.trial102.stdout:ID_LIKE="rhel fedora"
2026-02-17T04:01:39.148 INFO:teuthology.orchestra.run.trial102.stdout:VERSION_ID="9"
2026-02-17T04:01:39.148 INFO:teuthology.orchestra.run.trial102.stdout:PLATFORM_ID="platform:el9"
2026-02-17T04:01:39.148 INFO:teuthology.orchestra.run.trial102.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T04:01:39.148 INFO:teuthology.orchestra.run.trial102.stdout:ANSI_COLOR="0;31"
2026-02-17T04:01:39.148 INFO:teuthology.orchestra.run.trial102.stdout:LOGO="fedora-logo-icon"
2026-02-17T04:01:39.149 INFO:teuthology.orchestra.run.trial102.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T04:01:39.149 INFO:teuthology.orchestra.run.trial102.stdout:HOME_URL="https://centos.org/"
2026-02-17T04:01:39.149 INFO:teuthology.orchestra.run.trial102.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T04:01:39.149 INFO:teuthology.orchestra.run.trial102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T04:01:39.149 INFO:teuthology.orchestra.run.trial102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T04:01:39.149 INFO:teuthology.provision.fog.trial102:Deploy complete!
2026-02-17T04:01:39.150 DEBUG:teuthology.parallel:result is None
2026-02-17T04:10:04.739 ERROR:teuthology:Uncaught exception (Hub)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 745, in recv_stderr
    out = self.in_stderr_buffer.read(nbytes, self.timeout)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/buffered_pipe.py", line 154, in read
    raise PipeTimeout()
paramiko.buffered_pipe.PipeTimeout

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 329, in copy_file_to
    copy_to_log(src, logger, capture=stream, quiet=quiet)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 282, in copy_to_log
    for line in f:
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/file.py", line 109, in __next__
    line = self.readline()
           ^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/file.py", line 275, in readline
    new_data = self._read(n)
               ^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 1374, in _read
    return self.channel.recv_stderr(size)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 747, in recv_stderr
    raise socket.timeout()
TimeoutError
2026-02-17T04:10:04.742 ERROR:teuthology:Uncaught exception (Hub)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 697, in recv
    out = self.in_buffer.read(nbytes, self.timeout)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/buffered_pipe.py", line 154, in read
    raise PipeTimeout()
paramiko.buffered_pipe.PipeTimeout

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 329, in copy_file_to
    copy_to_log(src, logger, capture=stream, quiet=quiet)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 282, in copy_to_log
    for line in f:
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/file.py", line 109, in __next__
    line = self.readline()
           ^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/file.py", line 275, in readline
    new_data = self._read(n)
               ^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 1359, in _read
    return self.channel.recv(size)
           ^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 699, in recv
    raise socket.timeout()
TimeoutError
2026-02-17T18:28:36.363 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2026-02-17T18:28:36.376 DEBUG:teuthology.orchestra.run:got remote process result: None
2026-02-17T18:28:36.378 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Unlocking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 745, in recv_stderr
    out = self.in_stderr_buffer.read(nbytes, self.timeout)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/buffered_pipe.py", line 154, in read
    raise PipeTimeout()
paramiko.buffered_pipe.PipeTimeout

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/dispatcher/supervisor.py", line 233, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/lock/ops.py", line 366, in reimage_machines
    with teuthology.parallel.parallel() as p:
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/provision/__init__.py", line 49, in reimage
    result = obj.create()
             ^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/provision/fog.py", line 91, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/provision/fog.py", line 336, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 148, in wait
    greenlet.get(block=True,timeout=60)
  File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get
  File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise
    raise value.with_traceback(tb)
  File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 329, in copy_file_to
    copy_to_log(src, logger, capture=stream, quiet=quiet)
      ^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 282, in copy_to_log
    for line in f:
      ^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/file.py", line 109, in __next__
    line = self.readline()
    ^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/file.py", line 275, in readline
    new_data = self._read(n)
    ^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 1374, in _read
    return self.channel.recv_stderr(size)
    ^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 747, in recv_stderr
    raise socket.timeout()
    ^^^^^^^^^^^^^^^^^
TimeoutError
2026-02-17T18:28:36.671 WARNING:teuthology.dispatcher.supervisor:Was going to unlock trial102 but it was locked by another job: /home/teuthworker/mnt/teuthology/shwetabhosale-2026-02-17_05:03:47-orch:cephadm-wip-shweta-testing-2026-02-14-0018-distro-default-trial/51591
2026-02-17T18:28:36.671 WARNING:teuthology.dispatcher.supervisor:Was going to unlock trial121 but it was locked by another job: /home/teuthworker/mnt/teuthology/shwetabhosale-2026-02-17_05:03:47-orch:cephadm-wip-shweta-testing-2026-02-14-0018-distro-default-trial/51591
2026-02-17T18:28:36.671 WARNING:teuthology.dispatcher.supervisor:Was going to unlock trial178 but it was locked by another job: /home/teuthworker/mnt/teuthology/shwetabhosale-2026-02-17_05:03:47-orch:cephadm-wip-shweta-testing-2026-02-14-0018-distro-default-trial/51592
2026-02-17T18:28:36.671 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T18:28:37.598 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 745, in recv_stderr
    out = self.in_stderr_buffer.read(nbytes, self.timeout)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/buffered_pipe.py", line 154, in read
    raise PipeTimeout()
paramiko.buffered_pipe.PipeTimeout

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology-supervisor", line 6, in <module>
    sys.exit(main())
             ^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/scripts/supervisor.py", line 40, in main
    sys.exit(teuthology.dispatcher.supervisor.main(parse_args(sys.argv[1:])))
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/dispatcher/supervisor.py", line 62, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/dispatcher/supervisor.py", line 233, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/lock/ops.py", line 366, in reimage_machines
    with teuthology.parallel.parallel() as p:
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/provision/__init__.py", line 49, in reimage
    result = obj.create()
             ^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/provision/fog.py", line 91, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/provision/fog.py", line 336, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 148, in wait
    greenlet.get(block=True,timeout=60)
  File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get
  File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise
    raise value.with_traceback(tb)
  File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 329, in copy_file_to
    copy_to_log(src, logger, capture=stream, quiet=quiet)
      ^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 282, in copy_to_log
    for line in f:
      ^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/file.py", line 109, in __next__
    line = self.readline()
    ^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/file.py", line 275, in readline
    new_data = self._read(n)
    ^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 1374, in _read
    return self.channel.recv_stderr(size)
    ^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 747, in recv_stderr
    raise socket.timeout()
    ^^^^^^^^^^^^^^^^^
TimeoutError