2026-02-13T02:51:55.452 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae
2026-02-13T02:51:55.452 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:51:55.523 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:51:55.716 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x77ce02e4ca40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x77ce02631da0>, signals=[15])
2026-02-13T02:51:55.716 INFO:teuthology.lock.ops:Start node 'trial111.front.sepia.ceph.com' reimaging
2026-02-13T02:51:55.716 INFO:teuthology.lock.ops:Updating [trial111.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T02:51:55.716 INFO:teuthology.lock.ops:Updating trial111.front.sepia.ceph.com on lock server
2026-02-13T02:51:55.772 INFO:teuthology.lock.ops:Start node 'trial123.front.sepia.ceph.com' reimaging
2026-02-13T02:51:55.772 INFO:teuthology.lock.ops:Updating [trial123.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T02:51:55.772 INFO:teuthology.lock.ops:Updating trial123.front.sepia.ceph.com on lock server
2026-02-13T02:51:55.983 DEBUG:teuthology.provision.fog.trial123:Requesting image trial_rocky_10.1 (ID 4)
2026-02-13T02:51:55.998 DEBUG:teuthology.provision.fog.trial111:Requesting image trial_rocky_10.1 (ID 4)
2026-02-13T02:51:56.007 INFO:teuthology.provision.fog.trial123:Scheduling deploy of rocky 10.1
2026-02-13T02:51:56.051 INFO:teuthology.provision.fog.trial111:Scheduling deploy of rocky 10.1
2026-02-13T02:51:57.380 INFO:teuthology.orchestra.console.trial123:Power off
2026-02-13T02:51:57.380 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T02:51:57.390 INFO:teuthology.orchestra.console.trial111:Power off
2026-02-13T02:51:57.390 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T02:51:57.417 DEBUG:teuthology.orchestra.console.trial123:power off output: Chassis Power Control: Down/Off
2026-02-13T02:51:57.426 DEBUG:teuthology.orchestra.console.trial111:power off output: Chassis Power Control: Down/Off
2026-02-13T02:52:01.422 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:52:01.429 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:52:01.531 DEBUG:teuthology.orchestra.console.trial123:check power output: Chassis Power is off
2026-02-13T02:52:01.531 INFO:teuthology.orchestra.console.trial123:Power off completed
2026-02-13T02:52:01.538 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is off
2026-02-13T02:52:01.538 INFO:teuthology.orchestra.console.trial111:Power off completed
2026-02-13T02:52:01.633 INFO:teuthology.orchestra.console.trial123:Power on
2026-02-13T02:52:01.633 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T02:52:01.641 INFO:teuthology.orchestra.console.trial111:Power on
2026-02-13T02:52:01.641 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T02:52:01.673 DEBUG:teuthology.orchestra.console.trial123:power on output: Chassis Power Control: Up/On
2026-02-13T02:52:01.681 DEBUG:teuthology.orchestra.console.trial111:power on output: Chassis Power Control: Up/On
2026-02-13T02:52:05.678 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:52:05.684 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:52:05.787 DEBUG:teuthology.orchestra.console.trial123:check power output: Chassis Power is on
2026-02-13T02:52:05.788 INFO:teuthology.orchestra.console.trial123:Power on completed
2026-02-13T02:52:05.791 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is on
2026-02-13T02:52:05.791 INFO:teuthology.orchestra.console.trial111:Power on completed
2026-02-13T02:52:05.889 INFO:teuthology.provision.fog.trial123:Waiting for deploy to finish
2026-02-13T02:52:05.893 INFO:teuthology.provision.fog.trial111:Waiting for deploy to finish
2026-02-13T02:53:53.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:53:53.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:54:07.709 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111
2026-02-13T02:54:07.709 WARNING:teuthology.provision.fog.trial123:[Errno None] Unable to connect to port 22 on 10.20.193.123
2026-02-13T02:54:13.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:54:13.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:54:16.797 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111
2026-02-13T02:54:16.797 WARNING:teuthology.provision.fog.trial123:[Errno None] Unable to connect to port 22 on 10.20.193.123
2026-02-13T02:54:22.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:54:22.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:54:25.885 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111
2026-02-13T02:54:25.885 WARNING:teuthology.provision.fog.trial123:[Errno None] Unable to connect to port 22 on 10.20.193.123
2026-02-13T02:54:31.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:54:31.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:55:08.109 ERROR:teuthology.orchestra.connection:Error authenticating with trial123.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T02:55:08.111 ERROR:teuthology.orchestra.connection:Error authenticating with trial111.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T02:55:12.225 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T02:55:12.225 DEBUG:teuthology.orchestra.run.trial123:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T02:55:12.226 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T02:55:12.226 DEBUG:teuthology.orchestra.run.trial111:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T02:55:12.589 INFO:teuthology.provision.fog.trial123:Node is ready
2026-02-13T02:55:12.590 DEBUG:teuthology.orchestra.run.trial123:> hostname
2026-02-13T02:55:12.647 INFO:teuthology.orchestra.run.trial123.stdout:trial123.front.sepia.ceph.com
2026-02-13T02:55:12.647 DEBUG:teuthology.orchestra.run.trial123:> grep trial123.front.sepia.ceph.com /etc/hosts
2026-02-13T02:55:12.705 INFO:teuthology.orchestra.run.trial123.stdout:10.20.193.123 trial123.front.sepia.ceph.com trial123
2026-02-13T02:55:12.706 DEBUG:teuthology.orchestra.run.trial123:> sudo hostname trial123
2026-02-13T02:55:12.777 DEBUG:teuthology.orchestra.run.trial123:> sudo sed -i -e 's/trial123.front.sepia.ceph.com/trial123/g' /etc/hosts
2026-02-13T02:55:12.844 DEBUG:teuthology.orchestra.run.trial123:> sudo sed -i -e 's/10.20.193.123/10.20.193.123/g' /etc/hosts
2026-02-13T02:55:12.927 DEBUG:teuthology.orchestra.run.trial123:> sudo sed -i -e 's/trial123.front.sepia.ceph.com/trial123/g' /etc/hostname
2026-02-13T02:55:12.995 DEBUG:teuthology.orchestra.run.trial123:> sudo hostname trial123
2026-02-13T02:55:13.062 DEBUG:teuthology.orchestra.run.trial123:> cat /etc/os-release
2026-02-13T02:55:13.119 INFO:teuthology.orchestra.run.trial123.stdout:NAME="Rocky Linux"
2026-02-13T02:55:13.119 INFO:teuthology.orchestra.run.trial123.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T02:55:13.119 INFO:teuthology.orchestra.run.trial123.stdout:ID="rocky"
2026-02-13T02:55:13.119 INFO:teuthology.orchestra.run.trial123.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T02:55:13.119 INFO:teuthology.orchestra.run.trial123.stdout:VERSION_ID="10.1"
2026-02-13T02:55:13.119 INFO:teuthology.orchestra.run.trial123.stdout:PLATFORM_ID="platform:el10"
2026-02-13T02:55:13.120 INFO:teuthology.orchestra.run.trial123.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T02:55:13.120 INFO:teuthology.orchestra.run.trial123.stdout:ANSI_COLOR="0;32"
2026-02-13T02:55:13.120 INFO:teuthology.orchestra.run.trial123.stdout:LOGO="fedora-logo-icon"
2026-02-13T02:55:13.120 INFO:teuthology.orchestra.run.trial123.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T02:55:13.120 INFO:teuthology.orchestra.run.trial123.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T02:55:13.120 INFO:teuthology.orchestra.run.trial123.stdout:VENDOR_NAME="RESF"
2026-02-13T02:55:13.120 INFO:teuthology.orchestra.run.trial123.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T02:55:13.120 INFO:teuthology.orchestra.run.trial123.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T02:55:13.120 INFO:teuthology.orchestra.run.trial123.stdout:SUPPORT_END="2035-05-31"
2026-02-13T02:55:13.120 INFO:teuthology.orchestra.run.trial123.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T02:55:13.120 INFO:teuthology.orchestra.run.trial123.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:55:13.120 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T02:55:13.121 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:55:13.121 INFO:teuthology.provision.fog.trial123:Deploy complete!
2026-02-13T02:55:13.122 DEBUG:teuthology.parallel:result is None
2026-02-13T02:55:17.133 INFO:teuthology.provision.fog.trial111:Node is ready
2026-02-13T02:55:17.133 DEBUG:teuthology.orchestra.run.trial111:> hostname
2026-02-13T02:55:17.151 INFO:teuthology.orchestra.run.trial111.stdout:trial111.front.sepia.ceph.com
2026-02-13T02:55:17.151 DEBUG:teuthology.orchestra.run.trial111:> grep trial111.front.sepia.ceph.com /etc/hosts
2026-02-13T02:55:17.209 INFO:teuthology.orchestra.run.trial111.stdout:10.20.193.111 trial111.front.sepia.ceph.com trial111
2026-02-13T02:55:17.209 DEBUG:teuthology.orchestra.run.trial111:> sudo hostname trial111
2026-02-13T02:55:17.282 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i -e 's/trial111.front.sepia.ceph.com/trial111/g' /etc/hosts
2026-02-13T02:55:17.349 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i -e 's/10.20.193.111/10.20.193.111/g' /etc/hosts
2026-02-13T02:55:17.414 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i -e 's/trial111.front.sepia.ceph.com/trial111/g' /etc/hostname
2026-02-13T02:55:17.481 DEBUG:teuthology.orchestra.run.trial111:> sudo hostname trial111
2026-02-13T02:55:17.547 DEBUG:teuthology.orchestra.run.trial111:> cat /etc/os-release
2026-02-13T02:55:17.605 INFO:teuthology.orchestra.run.trial111.stdout:NAME="Rocky Linux"
2026-02-13T02:55:17.605 INFO:teuthology.orchestra.run.trial111.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T02:55:17.605 INFO:teuthology.orchestra.run.trial111.stdout:ID="rocky"
2026-02-13T02:55:17.605 INFO:teuthology.orchestra.run.trial111.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T02:55:17.605 INFO:teuthology.orchestra.run.trial111.stdout:VERSION_ID="10.1"
2026-02-13T02:55:17.605 INFO:teuthology.orchestra.run.trial111.stdout:PLATFORM_ID="platform:el10"
2026-02-13T02:55:17.605 INFO:teuthology.orchestra.run.trial111.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T02:55:17.606 INFO:teuthology.orchestra.run.trial111.stdout:ANSI_COLOR="0;32"
2026-02-13T02:55:17.606 INFO:teuthology.orchestra.run.trial111.stdout:LOGO="fedora-logo-icon"
2026-02-13T02:55:17.606 INFO:teuthology.orchestra.run.trial111.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T02:55:17.606 INFO:teuthology.orchestra.run.trial111.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T02:55:17.606 INFO:teuthology.orchestra.run.trial111.stdout:VENDOR_NAME="RESF"
2026-02-13T02:55:17.606 INFO:teuthology.orchestra.run.trial111.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T02:55:17.606 INFO:teuthology.orchestra.run.trial111.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T02:55:17.606 INFO:teuthology.orchestra.run.trial111.stdout:SUPPORT_END="2035-05-31"
2026-02-13T02:55:17.606 INFO:teuthology.orchestra.run.trial111.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T02:55:17.606 INFO:teuthology.orchestra.run.trial111.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:55:17.606 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T02:55:17.606 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:55:17.607 INFO:teuthology.provision.fog.trial111:Deploy complete!
2026-02-13T02:55:17.608 DEBUG:teuthology.parallel:result is None
2026-02-13T02:55:18.000 INFO:teuthology.lock.ops:Checking trial111.front.sepia.ceph.com
2026-02-13T02:55:18.000 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T02:55:18.105 INFO:teuthology.lock.ops:Checking trial123.front.sepia.ceph.com
2026-02-13T02:55:18.105 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T02:55:18.168 INFO:teuthology.lock.ops:Updating [trial111.front.sepia.ceph.com]: set os type and version on server
2026-02-13T02:55:18.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com'
2026-02-13T02:55:18.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:55:18.230 DEBUG:teuthology.orchestra.run.trial111:> true
2026-02-13T02:55:18.302 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com'
2026-02-13T02:55:18.302 DEBUG:teuthology.orchestra.run.trial111:> uname -m
2026-02-13T02:55:18.360 INFO:teuthology.orchestra.run.trial111.stdout:x86_64
2026-02-13T02:55:18.360 DEBUG:teuthology.orchestra.run.trial111:> cat /etc/os-release
2026-02-13T02:55:18.417 INFO:teuthology.orchestra.run.trial111.stdout:NAME="Rocky Linux"
2026-02-13T02:55:18.418 INFO:teuthology.orchestra.run.trial111.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T02:55:18.418 INFO:teuthology.orchestra.run.trial111.stdout:ID="rocky"
2026-02-13T02:55:18.418 INFO:teuthology.orchestra.run.trial111.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T02:55:18.418 INFO:teuthology.orchestra.run.trial111.stdout:VERSION_ID="10.1"
2026-02-13T02:55:18.418 INFO:teuthology.orchestra.run.trial111.stdout:PLATFORM_ID="platform:el10"
2026-02-13T02:55:18.418 INFO:teuthology.orchestra.run.trial111.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T02:55:18.418 INFO:teuthology.orchestra.run.trial111.stdout:ANSI_COLOR="0;32"
2026-02-13T02:55:18.418 INFO:teuthology.orchestra.run.trial111.stdout:LOGO="fedora-logo-icon"
2026-02-13T02:55:18.418 INFO:teuthology.orchestra.run.trial111.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T02:55:18.418 INFO:teuthology.orchestra.run.trial111.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T02:55:18.419 INFO:teuthology.orchestra.run.trial111.stdout:VENDOR_NAME="RESF"
2026-02-13T02:55:18.419 INFO:teuthology.orchestra.run.trial111.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T02:55:18.419 INFO:teuthology.orchestra.run.trial111.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T02:55:18.419 INFO:teuthology.orchestra.run.trial111.stdout:SUPPORT_END="2035-05-31"
2026-02-13T02:55:18.419 INFO:teuthology.orchestra.run.trial111.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T02:55:18.419 INFO:teuthology.orchestra.run.trial111.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:55:18.419 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T02:55:18.419 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:55:18.420 INFO:teuthology.lock.ops:Updating trial111.front.sepia.ceph.com on lock server
2026-02-13T02:55:18.522 INFO:teuthology.lock.ops:Updating [trial123.front.sepia.ceph.com]: set os type and version on server
2026-02-13T02:55:18.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com'
2026-02-13T02:55:18.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:55:18.592 DEBUG:teuthology.orchestra.run.trial123:> true
2026-02-13T02:55:18.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com'
2026-02-13T02:55:18.681 DEBUG:teuthology.orchestra.run.trial123:> uname -m
2026-02-13T02:55:18.740 INFO:teuthology.orchestra.run.trial123.stdout:x86_64
2026-02-13T02:55:18.740 DEBUG:teuthology.orchestra.run.trial123:> cat /etc/os-release
2026-02-13T02:55:18.797 INFO:teuthology.orchestra.run.trial123.stdout:NAME="Rocky Linux"
2026-02-13T02:55:18.797 INFO:teuthology.orchestra.run.trial123.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T02:55:18.798 INFO:teuthology.orchestra.run.trial123.stdout:ID="rocky"
2026-02-13T02:55:18.798 INFO:teuthology.orchestra.run.trial123.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T02:55:18.798 INFO:teuthology.orchestra.run.trial123.stdout:VERSION_ID="10.1"
2026-02-13T02:55:18.798 INFO:teuthology.orchestra.run.trial123.stdout:PLATFORM_ID="platform:el10"
2026-02-13T02:55:18.798 INFO:teuthology.orchestra.run.trial123.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T02:55:18.798 INFO:teuthology.orchestra.run.trial123.stdout:ANSI_COLOR="0;32"
2026-02-13T02:55:18.798 INFO:teuthology.orchestra.run.trial123.stdout:LOGO="fedora-logo-icon"
2026-02-13T02:55:18.798 INFO:teuthology.orchestra.run.trial123.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T02:55:18.798 INFO:teuthology.orchestra.run.trial123.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T02:55:18.798 INFO:teuthology.orchestra.run.trial123.stdout:VENDOR_NAME="RESF"
2026-02-13T02:55:18.798 INFO:teuthology.orchestra.run.trial123.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T02:55:18.798 INFO:teuthology.orchestra.run.trial123.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T02:55:18.799 INFO:teuthology.orchestra.run.trial123.stdout:SUPPORT_END="2035-05-31"
2026-02-13T02:55:18.799 INFO:teuthology.orchestra.run.trial123.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T02:55:18.799 INFO:teuthology.orchestra.run.trial123.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:55:18.799 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T02:55:18.799 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:55:18.799 INFO:teuthology.lock.ops:Updating trial123.front.sepia.ceph.com on lock server
2026-02-13T02:55:18.902 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:55:19.000 INFO:teuthology.dispatcher.supervisor:Running job 48048
2026-02-13T02:55:19.000 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48048 --name pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/pool-perm} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48048/orig.config.yaml
2026-02-13T02:55:19.000 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48048
2026-02-13T02:55:19.000 INFO:teuthology.dispatcher.supervisor:Job PID: 1359930
2026-02-13T02:55:19.000 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-13T02:57:19.101 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:59:19.307 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T03:01:19.458 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T03:03:19.603 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T03:03:19.691 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-13T03:03:19.808 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-13T03:03:20.327 INFO:teuthology.orchestra.console.trial111:Power off
2026-02-13T03:03:20.328 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T03:03:20.339 INFO:teuthology.orchestra.console.trial123:Power off
2026-02-13T03:03:20.339 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T03:03:20.375 DEBUG:teuthology.orchestra.console.trial111:power off output: Chassis Power Control: Down/Off
2026-02-13T03:03:20.380 DEBUG:teuthology.orchestra.console.trial123:power off output: Chassis Power Control: Down/Off
2026-02-13T03:03:24.380 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:03:24.387 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:03:24.488 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is on
2026-02-13T03:03:24.494 DEBUG:teuthology.orchestra.console.trial123:check power output: Chassis Power is on
2026-02-13T03:03:28.494 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:03:28.501 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:03:28.604 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is off
2026-02-13T03:03:28.604 INFO:teuthology.orchestra.console.trial111:Power off completed
2026-02-13T03:03:28.611 DEBUG:teuthology.orchestra.console.trial123:check power output: Chassis Power is off
2026-02-13T03:03:28.611 INFO:teuthology.orchestra.console.trial123:Power off completed
2026-02-13T03:03:28.848 INFO:teuthology.lock.ops:unlocked: trial111.front.sepia.ceph.com
2026-02-13T03:03:28.860 INFO:teuthology.lock.ops:unlocked: trial123.front.sepia.ceph.com