2026-02-16T23:44:35.534 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71
2026-02-16T23:44:35.534 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-16T23:44:35.608 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-16T23:44:35.799 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7bba5d7573b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7bba5cf55b20>, signals=[15])
2026-02-16T23:44:35.799 INFO:teuthology.lock.ops:Start node 'trial029.front.sepia.ceph.com' reimaging
2026-02-16T23:44:35.799 INFO:teuthology.lock.ops:Updating [trial029.front.sepia.ceph.com]: reset os type and version on server
2026-02-16T23:44:35.799 INFO:teuthology.lock.ops:Updating trial029.front.sepia.ceph.com on lock server
2026-02-16T23:44:35.856 INFO:teuthology.lock.ops:Start node 'trial129.front.sepia.ceph.com' reimaging
2026-02-16T23:44:35.856 INFO:teuthology.lock.ops:Updating [trial129.front.sepia.ceph.com]: reset os type and version on server
2026-02-16T23:44:35.856 INFO:teuthology.lock.ops:Updating trial129.front.sepia.ceph.com on lock server
2026-02-16T23:44:36.063 DEBUG:teuthology.provision.fog.trial029:Requesting image trial_ubuntu_22.04 (ID 1)
2026-02-16T23:44:36.079 DEBUG:teuthology.provision.fog.trial129:Requesting image trial_ubuntu_22.04 (ID 1)
2026-02-16T23:44:36.119 INFO:teuthology.provision.fog.trial029:Scheduling deploy of ubuntu 22.04
2026-02-16T23:44:36.123 INFO:teuthology.provision.fog.trial129:Scheduling deploy of ubuntu 22.04
2026-02-16T23:44:37.421 INFO:teuthology.orchestra.console.trial029:Power off
2026-02-16T23:44:37.421 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:44:57.516 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:45:01.520 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:45:09.047 INFO:teuthology.orchestra.console.trial129:Power off
2026-02-16T23:45:09.047 DEBUG:teuthology.orchestra.console.trial129:pexpect command: ipmitool -H trial129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:45:09.085 DEBUG:teuthology.orchestra.console.trial129:power off output: Chassis Power Control: Down/Off
2026-02-16T23:45:13.090 DEBUG:teuthology.orchestra.console.trial129:pexpect command: ipmitool -H trial129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-16T23:45:13.199 DEBUG:teuthology.orchestra.console.trial129:check power output: Chassis Power is off
2026-02-16T23:45:13.200 INFO:teuthology.orchestra.console.trial129:Power off completed
2026-02-16T23:45:13.300 INFO:teuthology.orchestra.console.trial129:Power on
2026-02-16T23:45:13.301 DEBUG:teuthology.orchestra.console.trial129:pexpect command: ipmitool -H trial129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-16T23:45:13.340 DEBUG:teuthology.orchestra.console.trial129:power on output: Chassis Power Control: Up/On
2026-02-16T23:45:17.345 DEBUG:teuthology.orchestra.console.trial129:pexpect command: ipmitool -H trial129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-16T23:45:17.453 DEBUG:teuthology.orchestra.console.trial129:check power output: Chassis Power is on
2026-02-16T23:45:17.454 INFO:teuthology.orchestra.console.trial129:Power on completed
2026-02-16T23:45:17.554 INFO:teuthology.provision.fog.trial129:Waiting for deploy to finish
2026-02-16T23:45:21.614 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:45:25.618 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:45:45.712 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:45:49.714 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:46:09.808 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:46:13.812 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:46:33.899 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:46:37.903 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:46:57.998 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:47:02.002 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:47:20.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-16T23:47:22.098 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:47:23.328 WARNING:teuthology.provision.fog.trial129:[Errno None] Unable to connect to port 22 on 10.20.193.129
2026-02-16T23:47:26.102 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:47:29.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-16T23:47:32.416 WARNING:teuthology.provision.fog.trial129:[Errno None] Unable to connect to port 22 on 10.20.193.129
2026-02-16T23:47:38.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-16T23:47:41.504 WARNING:teuthology.provision.fog.trial129:[Errno None] Unable to connect to port 22 on 10.20.193.129
2026-02-16T23:47:46.199 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:47:47.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-16T23:47:50.202 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:47:50.593 WARNING:teuthology.provision.fog.trial129:[Errno None] Unable to connect to port 22 on 10.20.193.129
2026-02-16T23:47:56.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-16T23:48:10.297 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:48:14.300 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:48:32.376 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-16T23:48:32.376 DEBUG:teuthology.orchestra.run.trial129:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-16T23:48:32.767 INFO:teuthology.provision.fog.trial129:Node is ready
2026-02-16T23:48:32.767 DEBUG:teuthology.orchestra.run.trial129:> hostname
2026-02-16T23:48:32.815 INFO:teuthology.orchestra.run.trial129.stdout:trial129.front.sepia.ceph.com
2026-02-16T23:48:32.816 DEBUG:teuthology.orchestra.run.trial129:> grep trial129.front.sepia.ceph.com /etc/hosts
2026-02-16T23:48:32.863 INFO:teuthology.orchestra.run.trial129.stdout:10.20.193.129 trial129.front.sepia.ceph.com trial129
2026-02-16T23:48:32.863 DEBUG:teuthology.orchestra.run.trial129:> sudo hostname trial129
2026-02-16T23:48:32.914 DEBUG:teuthology.orchestra.run.trial129:> sudo sed -i -e 's/trial129.front.sepia.ceph.com/trial129/g' /etc/hosts
2026-02-16T23:48:32.962 DEBUG:teuthology.orchestra.run.trial129:> sudo sed -i -e 's/10.20.193.129/10.20.193.129/g' /etc/hosts
2026-02-16T23:48:33.010 DEBUG:teuthology.orchestra.run.trial129:> sudo sed -i -e 's/trial129.front.sepia.ceph.com/trial129/g' /etc/hostname
2026-02-16T23:48:33.060 DEBUG:teuthology.orchestra.run.trial129:> sudo hostname trial129
2026-02-16T23:48:33.112 DEBUG:teuthology.orchestra.run.trial129:> cat /etc/os-release
2026-02-16T23:48:33.159 INFO:teuthology.orchestra.run.trial129.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-16T23:48:33.159 INFO:teuthology.orchestra.run.trial129.stdout:NAME="Ubuntu"
2026-02-16T23:48:33.159 INFO:teuthology.orchestra.run.trial129.stdout:VERSION_ID="22.04"
2026-02-16T23:48:33.160 INFO:teuthology.orchestra.run.trial129.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-16T23:48:33.160 INFO:teuthology.orchestra.run.trial129.stdout:VERSION_CODENAME=jammy
2026-02-16T23:48:33.160 INFO:teuthology.orchestra.run.trial129.stdout:ID=ubuntu
2026-02-16T23:48:33.160 INFO:teuthology.orchestra.run.trial129.stdout:ID_LIKE=debian
2026-02-16T23:48:33.160 INFO:teuthology.orchestra.run.trial129.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-16T23:48:33.160 INFO:teuthology.orchestra.run.trial129.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-16T23:48:33.160 INFO:teuthology.orchestra.run.trial129.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-16T23:48:33.160 INFO:teuthology.orchestra.run.trial129.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-16T23:48:33.160 INFO:teuthology.orchestra.run.trial129.stdout:UBUNTU_CODENAME=jammy
2026-02-16T23:48:33.161 INFO:teuthology.provision.fog.trial129:Deploy complete!
2026-02-16T23:48:33.162 DEBUG:teuthology.parallel:result is None
2026-02-16T23:48:34.394 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:48:38.396 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:48:58.486 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:49:02.487 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:49:22.582 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:49:26.583 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:49:46.675 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:49:50.677 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:50:10.770 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:50:14.771 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:50:34.865 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:50:34.865 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (15) after waiting for 60 seconds
2026-02-16T23:50:34.966 INFO:teuthology.orchestra.console.trial029:Power on
2026-02-16T23:50:34.966 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-16T23:50:55.061 DEBUG:teuthology.orchestra.console.trial029:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:50:59.063 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-16T23:51:19.152 DEBUG:teuthology.orchestra.console.trial029:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:51:23.153 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-16T23:51:43.244 DEBUG:teuthology.orchestra.console.trial029:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:51:47.245 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-16T23:52:07.334 DEBUG:teuthology.orchestra.console.trial029:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:52:11.335 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-16T23:52:31.425 DEBUG:teuthology.orchestra.console.trial029:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:52:35.426 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-16T23:52:55.525 DEBUG:teuthology.orchestra.console.trial029:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:52:59.526 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-16T23:53:19.617 DEBUG:teuthology.orchestra.console.trial029:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:53:23.618 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-16T23:53:43.710 DEBUG:teuthology.orchestra.console.trial029:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:53:47.711 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-16T23:54:07.802 DEBUG:teuthology.orchestra.console.trial029:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:54:11.802 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-16T23:54:31.895 DEBUG:teuthology.orchestra.console.trial029:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:54:35.897 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-16T23:54:55.993 DEBUG:teuthology.orchestra.console.trial029:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:54:59.994 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-16T23:55:20.085 DEBUG:teuthology.orchestra.console.trial029:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:55:24.085 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-16T23:55:44.175 DEBUG:teuthology.orchestra.console.trial029:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:55:48.176 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-16T23:56:08.268 DEBUG:teuthology.orchestra.console.trial029:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:56:12.268 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-16T23:56:32.360 DEBUG:teuthology.orchestra.console.trial029:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:56:32.360 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (15) after waiting for 60 seconds
2026-02-16T23:56:32.360 DEBUG:teuthology.provision.fog.trial029:Canceling deploy task with ID 5881770
2026-02-16T23:56:32.420 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Unlocking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/dispatcher/supervisor.py", line 233, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/lock/ops.py", line 366, in reimage_machines
    with teuthology.parallel.parallel() as p:
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/provision/__init__.py", line 49, in reimage
    result = obj.create()
             ^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/provision/fog.py", line 86, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/console.py", line 307, in power_on
    return self.set_power("on", timeout=None)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/console.py", line 235, in set_power
    raise RuntimeError(
RuntimeError: Failed to power on trial029 in 60s
2026-02-16T23:56:32.585 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-16T23:56:33.120 INFO:teuthology.orchestra.console.trial029:Power off
2026-02-16T23:56:33.120 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:56:33.140 INFO:teuthology.orchestra.console.trial129:Power off
2026-02-16T23:56:33.140 DEBUG:teuthology.orchestra.console.trial129:pexpect command: ipmitool -H trial129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:56:33.181 DEBUG:teuthology.orchestra.console.trial129:power off output: Chassis Power Control: Down/Off
2026-02-16T23:56:37.185 DEBUG:teuthology.orchestra.console.trial129:pexpect command: ipmitool -H trial129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-16T23:56:37.293 DEBUG:teuthology.orchestra.console.trial129:check power output: Chassis Power is on
2026-02-16T23:56:41.296 DEBUG:teuthology.orchestra.console.trial129:pexpect command: ipmitool -H trial129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-16T23:56:41.405 DEBUG:teuthology.orchestra.console.trial129:check power output: Chassis Power is off
2026-02-16T23:56:41.405 INFO:teuthology.orchestra.console.trial129:Power off completed
2026-02-16T23:56:41.617 INFO:teuthology.lock.ops:unlocked: trial129.front.sepia.ceph.com
2026-02-16T23:56:53.210 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:56:57.211 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:57:17.307 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:57:21.310 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:57:41.406 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:57:45.410 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:58:05.503 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:58:09.508 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:58:29.606 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:58:33.610 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:58:53.704 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:58:57.709 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:59:17.802 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:59:21.807 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-16T23:59:41.901 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-16T23:59:45.906 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T00:00:06.001 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-17T00:00:10.006 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T00:00:30.098 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-17T00:00:34.102 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T00:00:54.199 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-17T00:00:58.203 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T00:01:18.301 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-17T00:01:22.306 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T00:01:42.397 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-17T00:01:46.402 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T00:02:06.522 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-17T00:02:10.526 DEBUG:teuthology.orchestra.console.trial029:pexpect command: ipmitool -H trial029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T00:02:30.622 DEBUG:teuthology.orchestra.console.trial029:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2026-02-17T00:02:30.622 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (15) after waiting for 60 seconds
2026-02-17T00:02:30.923 INFO:teuthology.lock.ops:unlocked: trial029.front.sepia.ceph.com
2026-02-17T00:02:30.925 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T00:02:52.610 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/bin/teuthology-supervisor", line 6, in <module>
    sys.exit(main())
             ^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/scripts/supervisor.py", line 40, in main
    sys.exit(teuthology.dispatcher.supervisor.main(parse_args(sys.argv[1:])))
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/dispatcher/supervisor.py", line 62, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/dispatcher/supervisor.py", line 233, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/lock/ops.py", line 366, in reimage_machines
    with teuthology.parallel.parallel() as p:
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/provision/__init__.py", line 49, in reimage
    result = obj.create()
             ^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/provision/fog.py", line 86, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/console.py", line 307, in power_on
    return self.set_power("on", timeout=None)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/console.py", line 235, in set_power
    raise RuntimeError(
RuntimeError: Failed to power on trial029 in 60s