2026-02-12T00:40:20.378 INFO:root:teuthology version: 0.0.1.dev31+g5f66ecfb3
2026-02-12T00:40:20.378 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T00:40:20.450 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T00:40:20.641 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x72db4fd661b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x72db4f583c40>, signals=[15])
2026-02-12T00:40:20.641 INFO:teuthology.lock.ops:Start node 'trial038.front.sepia.ceph.com' reimaging
2026-02-12T00:40:20.641 INFO:teuthology.lock.ops:Updating [trial038.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T00:40:20.641 INFO:teuthology.lock.ops:Updating trial038.front.sepia.ceph.com on lock server
2026-02-12T00:40:20.699 INFO:teuthology.lock.ops:Start node 'trial177.front.sepia.ceph.com' reimaging
2026-02-12T00:40:20.699 INFO:teuthology.lock.ops:Updating [trial177.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T00:40:20.699 INFO:teuthology.lock.ops:Updating trial177.front.sepia.ceph.com on lock server
2026-02-12T00:40:20.927 DEBUG:teuthology.provision.fog.trial038:Requesting image trial_ubuntu_22.04 (ID 1)
2026-02-12T00:40:20.930 DEBUG:teuthology.provision.fog.trial177:Requesting image trial_ubuntu_22.04 (ID 1)
2026-02-12T00:40:20.952 INFO:teuthology.provision.fog.trial177:Scheduling deploy of ubuntu 22.04
2026-02-12T00:40:20.977 INFO:teuthology.provision.fog.trial038:Scheduling deploy of ubuntu 22.04
2026-02-12T00:40:22.040 INFO:teuthology.orchestra.console.trial177:Power off
2026-02-12T00:40:22.040 DEBUG:teuthology.orchestra.console.trial177:pexpect command: ipmitool -H trial177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T00:40:22.050 INFO:teuthology.orchestra.console.trial038:Power off
2026-02-12T00:40:22.050 DEBUG:teuthology.orchestra.console.trial038:pexpect command: ipmitool -H trial038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T00:40:22.077 DEBUG:teuthology.orchestra.console.trial177:power off output: Chassis Power Control: Down/Off
2026-02-12T00:40:22.091 DEBUG:teuthology.orchestra.console.trial038:power off output: Chassis Power Control: Down/Off
2026-02-12T00:40:26.082 DEBUG:teuthology.orchestra.console.trial177:pexpect command: ipmitool -H trial177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T00:40:26.092 DEBUG:teuthology.orchestra.console.trial038:pexpect command: ipmitool -H trial038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T00:40:26.190 DEBUG:teuthology.orchestra.console.trial177:check power output: Chassis Power is off
2026-02-12T00:40:26.191 INFO:teuthology.orchestra.console.trial177:Power off completed
2026-02-12T00:40:26.200 DEBUG:teuthology.orchestra.console.trial038:check power output: Chassis Power is off
2026-02-12T00:40:26.200 INFO:teuthology.orchestra.console.trial038:Power off completed
2026-02-12T00:40:26.291 INFO:teuthology.orchestra.console.trial177:Power on
2026-02-12T00:40:26.292 DEBUG:teuthology.orchestra.console.trial177:pexpect command: ipmitool -H trial177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T00:40:26.301 INFO:teuthology.orchestra.console.trial038:Power on
2026-02-12T00:40:26.301 DEBUG:teuthology.orchestra.console.trial038:pexpect command: ipmitool -H trial038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T00:40:26.330 DEBUG:teuthology.orchestra.console.trial177:power on output: Chassis Power Control: Up/On
2026-02-12T00:40:26.340 DEBUG:teuthology.orchestra.console.trial038:power on output: Chassis Power Control: Up/On
2026-02-12T00:40:30.335 DEBUG:teuthology.orchestra.console.trial177:pexpect command: ipmitool -H trial177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T00:40:30.343 DEBUG:teuthology.orchestra.console.trial038:pexpect command: ipmitool -H trial038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T00:40:30.445 DEBUG:teuthology.orchestra.console.trial177:check power output: Chassis Power is on
2026-02-12T00:40:30.446 INFO:teuthology.orchestra.console.trial177:Power on completed
2026-02-12T00:40:30.452 DEBUG:teuthology.orchestra.console.trial038:check power output: Chassis Power is off
2026-02-12T00:40:30.547 INFO:teuthology.provision.fog.trial177:Waiting for deploy to finish
2026-02-12T00:40:34.456 DEBUG:teuthology.orchestra.console.trial038:pexpect command: ipmitool -H trial038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T00:40:34.566 DEBUG:teuthology.orchestra.console.trial038:check power output: Chassis Power is on
2026-02-12T00:40:34.566 INFO:teuthology.orchestra.console.trial038:Power on completed
2026-02-12T00:40:34.667 INFO:teuthology.provision.fog.trial038:Waiting for deploy to finish
2026-02-12T00:42:17.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T00:42:21.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T00:42:24.797 WARNING:teuthology.provision.fog.trial038:[Errno None] Unable to connect to port 22 on 10.20.193.38
2026-02-12T00:42:30.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T00:42:33.885 WARNING:teuthology.provision.fog.trial038:[Errno None] Unable to connect to port 22 on 10.20.193.38
2026-02-12T00:42:39.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T00:42:42.973 WARNING:teuthology.provision.fog.trial038:[Errno None] Unable to connect to port 22 on 10.20.193.38
2026-02-12T00:42:48.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T00:42:52.061 WARNING:teuthology.provision.fog.trial038:[Errno None] Unable to connect to port 22 on 10.20.193.38
2026-02-12T00:42:58.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T00:43:17.601 WARNING:teuthology.provision.fog.trial177:timed out
2026-02-12T00:43:23.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T00:43:23.737 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T00:43:23.738 DEBUG:teuthology.orchestra.run.trial177:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T00:43:29.138 INFO:teuthology.provision.fog.trial177:Node is ready
2026-02-12T00:43:29.139 DEBUG:teuthology.orchestra.run.trial177:> hostname
2026-02-12T00:43:29.144 INFO:teuthology.orchestra.run.trial177.stdout:trial177.front.sepia.ceph.com
2026-02-12T00:43:29.145 DEBUG:teuthology.orchestra.run.trial177:> grep trial177.front.sepia.ceph.com /etc/hosts
2026-02-12T00:43:29.192 INFO:teuthology.orchestra.run.trial177.stdout:10.20.193.177 trial177.front.sepia.ceph.com trial177
2026-02-12T00:43:29.193 DEBUG:teuthology.orchestra.run.trial177:> sudo hostname trial177
2026-02-12T00:43:29.248 DEBUG:teuthology.orchestra.run.trial177:> sudo sed -i -e 's/trial177.front.sepia.ceph.com/trial177/g' /etc/hosts
2026-02-12T00:43:29.296 DEBUG:teuthology.orchestra.run.trial177:> sudo sed -i -e 's/10.20.193.177/10.20.193.177/g' /etc/hosts
2026-02-12T00:43:29.348 DEBUG:teuthology.orchestra.run.trial177:> sudo sed -i -e 's/trial177.front.sepia.ceph.com/trial177/g' /etc/hostname
2026-02-12T00:43:29.404 DEBUG:teuthology.orchestra.run.trial177:> sudo hostname trial177
2026-02-12T00:43:29.455 DEBUG:teuthology.orchestra.run.trial177:> cat /etc/os-release
2026-02-12T00:43:29.500 INFO:teuthology.orchestra.run.trial177.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-12T00:43:29.500 INFO:teuthology.orchestra.run.trial177.stdout:NAME="Ubuntu"
2026-02-12T00:43:29.500 INFO:teuthology.orchestra.run.trial177.stdout:VERSION_ID="22.04"
2026-02-12T00:43:29.500 INFO:teuthology.orchestra.run.trial177.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-12T00:43:29.500 INFO:teuthology.orchestra.run.trial177.stdout:VERSION_CODENAME=jammy
2026-02-12T00:43:29.500 INFO:teuthology.orchestra.run.trial177.stdout:ID=ubuntu
2026-02-12T00:43:29.500 INFO:teuthology.orchestra.run.trial177.stdout:ID_LIKE=debian
2026-02-12T00:43:29.500 INFO:teuthology.orchestra.run.trial177.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-12T00:43:29.501 INFO:teuthology.orchestra.run.trial177.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-12T00:43:29.501 INFO:teuthology.orchestra.run.trial177.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-12T00:43:29.501 INFO:teuthology.orchestra.run.trial177.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-12T00:43:29.501 INFO:teuthology.orchestra.run.trial177.stdout:UBUNTU_CODENAME=jammy
2026-02-12T00:43:29.502 INFO:teuthology.provision.fog.trial177:Deploy complete!
2026-02-12T00:43:29.502 DEBUG:teuthology.parallel:result is None
2026-02-12T00:43:34.044 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T00:43:34.045 DEBUG:teuthology.orchestra.run.trial038:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T00:53:34.441 ERROR:teuthology:Uncaught exception (Hub)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 745, in recv_stderr
    out = self.in_stderr_buffer.read(nbytes, self.timeout)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/buffered_pipe.py", line 154, in read
    raise PipeTimeout()
paramiko.buffered_pipe.PipeTimeout

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/run.py", line 329, in copy_file_to
    copy_to_log(src, logger, capture=stream, quiet=quiet)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/run.py", line 282, in copy_to_log
    for line in f:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/file.py", line 109, in __next__
    line = self.readline()
           ^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/file.py", line 275, in readline
    new_data = self._read(n)
               ^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 1374, in _read
    return self.channel.recv_stderr(size)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 747, in recv_stderr
    raise socket.timeout()
TimeoutError
2026-02-12T00:53:34.451 ERROR:teuthology:Uncaught exception (Hub)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 697, in recv
    out = self.in_buffer.read(nbytes, self.timeout)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/buffered_pipe.py", line 154, in read
    raise PipeTimeout()
paramiko.buffered_pipe.PipeTimeout

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/run.py", line 329, in copy_file_to
    copy_to_log(src, logger, capture=stream, quiet=quiet)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/run.py", line 282, in copy_to_log
    for line in f:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/file.py", line 109, in __next__
    line = self.readline()
           ^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/file.py", line 275, in readline
    new_data = self._read(n)
               ^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 1359, in _read
    return self.channel.recv(size)
           ^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 699, in recv
    raise socket.timeout()
TimeoutError
2026-02-12T20:37:29.373 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2026-02-12T20:37:53.949 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2026-02-12T20:37:53.950 DEBUG:teuthology.orchestra.run:got remote process result: None
2026-02-12T20:37:53.954 ERROR:teuthology.dispatcher.supervisor:Reimaging error
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 745, in recv_stderr
    out = self.in_stderr_buffer.read(nbytes, self.timeout)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/buffered_pipe.py", line 154, in read
    raise PipeTimeout()
paramiko.buffered_pipe.PipeTimeout

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/dispatcher/supervisor.py", line 239, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/lock/ops.py", line 366, in reimage_machines
    with teuthology.parallel.parallel() as p:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/provision/__init__.py", line 49, in reimage
    result = obj.create()
             ^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/provision/fog.py", line 92, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/provision/fog.py", line 323, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/remote.py", line 575, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/run.py", line 461, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/run.py", line 148, in wait
    greenlet.get(block=True,timeout=60)
  File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get
  File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise
    raise value.with_traceback(tb)
  File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/run.py", line 329, in copy_file_to
    copy_to_log(src, logger, capture=stream, quiet=quiet)
      ^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/run.py", line 282, in copy_to_log
    for line in f:
      ^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/file.py", line 109, in __next__
    line = self.readline()
    ^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/file.py", line 275, in readline
    new_data = self._read(n)
    ^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 1374, in _read
    return self.channel.recv_stderr(size)
    ^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 747, in recv_stderr
    raise socket.timeout()
    ^^^^^^^^^^^^^^^^^
TimeoutError
2026-02-12T20:37:53.961 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T20:37:54.123 WARNING:teuthology.dispatcher.supervisor:Was going to unlock trial038 but it was locked by another job: /home/teuthworker/mnt/teuthology/cbodley-2026-02-12_15:40:18-rgw-wip-73090-tentacle-distro-default-trial/46473
2026-02-12T20:37:54.123 WARNING:teuthology.dispatcher.supervisor:Was going to unlock trial177 but it was locked by another job: /home/teuthworker/mnt/teuthology/cbodley-2026-02-12_15:40:18-rgw-wip-73090-tentacle-distro-default-trial/46453
2026-02-12T20:37:54.123 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T20:37:54.441 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 745, in recv_stderr
    out = self.in_stderr_buffer.read(nbytes, self.timeout)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/buffered_pipe.py", line 154, in read
    raise PipeTimeout()
paramiko.buffered_pipe.PipeTimeout

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/bin/teuthology-supervisor", line 7, in <module>
    sys.exit(main())
             ^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/scripts/supervisor.py", line 40, in main
    sys.exit(teuthology.dispatcher.supervisor.main(parse_args(sys.argv[1:])))
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/dispatcher/supervisor.py", line 62, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/dispatcher/supervisor.py", line 239, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/lock/ops.py", line 366, in reimage_machines
    with teuthology.parallel.parallel() as p:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/provision/__init__.py", line 49, in reimage
    result = obj.create()
             ^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/provision/fog.py", line 92, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/provision/fog.py", line 323, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/remote.py", line 575, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/run.py", line 461, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/run.py", line 148, in wait
    greenlet.get(block=True,timeout=60)
  File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get
  File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise
    raise value.with_traceback(tb)
  File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/run.py", line 329, in copy_file_to
    copy_to_log(src, logger, capture=stream, quiet=quiet)
      ^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/orchestra/run.py", line 282, in copy_to_log
    for line in f:
      ^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/file.py", line 109, in __next__
    line = self.readline()
    ^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/file.py", line 275, in readline
    new_data = self._read(n)
    ^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 1374, in _read
    return self.channel.recv_stderr(size)
    ^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/virtualenv/lib/python3.12/site-packages/paramiko/channel.py", line 747, in recv_stderr
    raise socket.timeout()
    ^^^^^^^^^^^^^^^^^
TimeoutError