2026-02-13T04:51:11.206 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae
2026-02-13T04:51:11.206 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T04:51:11.279 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T04:51:11.473 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x78ba86beca40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x78ba8641ac00>, signals=[15])
2026-02-13T04:51:11.473 INFO:teuthology.lock.ops:Start node 'trial081.front.sepia.ceph.com' reimaging
2026-02-13T04:51:11.473 INFO:teuthology.lock.ops:Updating [trial081.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T04:51:11.473 INFO:teuthology.lock.ops:Updating trial081.front.sepia.ceph.com on lock server
2026-02-13T04:51:11.531 INFO:teuthology.lock.ops:Start node 'trial131.front.sepia.ceph.com' reimaging
2026-02-13T04:51:11.532 INFO:teuthology.lock.ops:Updating [trial131.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T04:51:11.532 INFO:teuthology.lock.ops:Updating trial131.front.sepia.ceph.com on lock server
2026-02-13T04:51:11.763 DEBUG:teuthology.provision.fog.trial081:Requesting image trial_rocky_10.1 (ID 4)
2026-02-13T04:51:11.770 DEBUG:teuthology.provision.fog.trial131:Requesting image trial_rocky_10.1 (ID 4)
2026-02-13T04:51:11.815 INFO:teuthology.provision.fog.trial081:Scheduling deploy of rocky 10.1
2026-02-13T04:51:11.822 INFO:teuthology.provision.fog.trial131:Scheduling deploy of rocky 10.1
2026-02-13T04:51:12.812 INFO:teuthology.orchestra.console.trial081:Power off
2026-02-13T04:51:12.813 DEBUG:teuthology.orchestra.console.trial081:pexpect command: ipmitool -H trial081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T04:51:12.832 INFO:teuthology.orchestra.console.trial131:Power off
2026-02-13T04:51:12.832 DEBUG:teuthology.orchestra.console.trial131:pexpect command: ipmitool -H trial131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T04:51:12.849 DEBUG:teuthology.orchestra.console.trial081:power off output: Chassis Power Control: Down/Off
2026-02-13T04:51:12.867 DEBUG:teuthology.orchestra.console.trial131:power off output: Chassis Power Control: Down/Off
2026-02-13T04:51:16.854 DEBUG:teuthology.orchestra.console.trial081:pexpect command: ipmitool -H trial081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T04:51:16.868 DEBUG:teuthology.orchestra.console.trial131:pexpect command: ipmitool -H trial131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T04:51:16.963 DEBUG:teuthology.orchestra.console.trial081:check power output: Chassis Power is off
2026-02-13T04:51:16.964 INFO:teuthology.orchestra.console.trial081:Power off completed
2026-02-13T04:51:16.975 DEBUG:teuthology.orchestra.console.trial131:check power output: Chassis Power is off
2026-02-13T04:51:16.976 INFO:teuthology.orchestra.console.trial131:Power off completed
2026-02-13T04:51:17.065 INFO:teuthology.orchestra.console.trial081:Power on
2026-02-13T04:51:17.065 DEBUG:teuthology.orchestra.console.trial081:pexpect command: ipmitool -H trial081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T04:51:17.077 INFO:teuthology.orchestra.console.trial131:Power on
2026-02-13T04:51:17.077 DEBUG:teuthology.orchestra.console.trial131:pexpect command: ipmitool -H trial131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T04:51:17.104 DEBUG:teuthology.orchestra.console.trial081:power on output: Chassis Power Control: Up/On
2026-02-13T04:51:17.116 DEBUG:teuthology.orchestra.console.trial131:power on output: Chassis Power Control: Up/On
2026-02-13T04:51:21.110 DEBUG:teuthology.orchestra.console.trial081:pexpect command: ipmitool -H trial081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T04:51:21.118 DEBUG:teuthology.orchestra.console.trial131:pexpect command: ipmitool -H trial131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T04:51:21.219 DEBUG:teuthology.orchestra.console.trial081:check power output: Chassis Power is on
2026-02-13T04:51:21.219 INFO:teuthology.orchestra.console.trial081:Power on completed
2026-02-13T04:51:21.227 DEBUG:teuthology.orchestra.console.trial131:check power output: Chassis Power is on
2026-02-13T04:51:21.227 INFO:teuthology.orchestra.console.trial131:Power on completed
2026-02-13T04:51:21.320 INFO:teuthology.provision.fog.trial081:Waiting for deploy to finish
2026-02-13T04:51:21.328 INFO:teuthology.provision.fog.trial131:Waiting for deploy to finish
2026-02-13T04:53:08.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:53:08.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:53:11.645 WARNING:teuthology.provision.fog.trial081:[Errno None] Unable to connect to port 22 on 10.20.193.81
2026-02-13T04:53:17.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:53:20.733 WARNING:teuthology.provision.fog.trial081:[Errno None] Unable to connect to port 22 on 10.20.193.81
2026-02-13T04:53:22.845 WARNING:teuthology.provision.fog.trial131:[Errno None] Unable to connect to port 22 on 10.20.193.131
2026-02-13T04:53:26.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:53:28.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:53:29.821 WARNING:teuthology.provision.fog.trial081:[Errno None] Unable to connect to port 22 on 10.20.193.81
2026-02-13T04:53:31.933 WARNING:teuthology.provision.fog.trial131:[Errno None] Unable to connect to port 22 on 10.20.193.131
2026-02-13T04:53:35.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:53:37.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:53:38.909 WARNING:teuthology.provision.fog.trial081:[Errno None] Unable to connect to port 22 on 10.20.193.81
2026-02-13T04:53:41.021 WARNING:teuthology.provision.fog.trial131:[Errno None] Unable to connect to port 22 on 10.20.193.131
2026-02-13T04:53:44.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:53:47.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:54:20.739 ERROR:teuthology.orchestra.connection:Error authenticating with trial081.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T04:54:23.270 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T04:54:23.270 DEBUG:teuthology.orchestra.run.trial131:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T04:54:24.848 ERROR:teuthology.orchestra.connection:Error authenticating with trial081.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T04:54:28.244 INFO:teuthology.provision.fog.trial131:Node is ready
2026-02-13T04:54:28.245 DEBUG:teuthology.orchestra.run.trial131:> hostname
2026-02-13T04:54:28.263 INFO:teuthology.orchestra.run.trial131.stdout:trial131.front.sepia.ceph.com
2026-02-13T04:54:28.263 DEBUG:teuthology.orchestra.run.trial131:> grep trial131.front.sepia.ceph.com /etc/hosts
2026-02-13T04:54:28.320 INFO:teuthology.orchestra.run.trial131.stdout:10.20.193.131 trial131.front.sepia.ceph.com trial131
2026-02-13T04:54:28.321 DEBUG:teuthology.orchestra.run.trial131:> sudo hostname trial131
2026-02-13T04:54:28.395 DEBUG:teuthology.orchestra.run.trial131:> sudo sed -i -e 's/trial131.front.sepia.ceph.com/trial131/g' /etc/hosts
2026-02-13T04:54:28.461 DEBUG:teuthology.orchestra.run.trial131:> sudo sed -i -e 's/10.20.193.131/10.20.193.131/g' /etc/hosts
2026-02-13T04:54:28.529 DEBUG:teuthology.orchestra.run.trial131:> sudo sed -i -e 's/trial131.front.sepia.ceph.com/trial131/g' /etc/hostname
2026-02-13T04:54:28.596 DEBUG:teuthology.orchestra.run.trial131:> sudo hostname trial131
2026-02-13T04:54:28.662 DEBUG:teuthology.orchestra.run.trial131:> cat /etc/os-release
2026-02-13T04:54:28.719 INFO:teuthology.orchestra.run.trial131.stdout:NAME="Rocky Linux"
2026-02-13T04:54:28.719 INFO:teuthology.orchestra.run.trial131.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T04:54:28.719 INFO:teuthology.orchestra.run.trial131.stdout:ID="rocky"
2026-02-13T04:54:28.719 INFO:teuthology.orchestra.run.trial131.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T04:54:28.719 INFO:teuthology.orchestra.run.trial131.stdout:VERSION_ID="10.1"
2026-02-13T04:54:28.719 INFO:teuthology.orchestra.run.trial131.stdout:PLATFORM_ID="platform:el10"
2026-02-13T04:54:28.720 INFO:teuthology.orchestra.run.trial131.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T04:54:28.720 INFO:teuthology.orchestra.run.trial131.stdout:ANSI_COLOR="0;32"
2026-02-13T04:54:28.720 INFO:teuthology.orchestra.run.trial131.stdout:LOGO="fedora-logo-icon"
2026-02-13T04:54:28.720 INFO:teuthology.orchestra.run.trial131.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T04:54:28.720 INFO:teuthology.orchestra.run.trial131.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T04:54:28.720 INFO:teuthology.orchestra.run.trial131.stdout:VENDOR_NAME="RESF"
2026-02-13T04:54:28.720 INFO:teuthology.orchestra.run.trial131.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T04:54:28.720 INFO:teuthology.orchestra.run.trial131.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T04:54:28.720 INFO:teuthology.orchestra.run.trial131.stdout:SUPPORT_END="2035-05-31"
2026-02-13T04:54:28.720 INFO:teuthology.orchestra.run.trial131.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T04:54:28.720 INFO:teuthology.orchestra.run.trial131.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:54:28.721 INFO:teuthology.orchestra.run.trial131.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T04:54:28.721 INFO:teuthology.orchestra.run.trial131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:54:28.721 INFO:teuthology.provision.fog.trial131:Deploy complete!
2026-02-13T04:54:28.722 DEBUG:teuthology.parallel:result is None
2026-02-13T04:54:31.927 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T04:54:31.927 DEBUG:teuthology.orchestra.run.trial081:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T04:54:32.118 INFO:teuthology.provision.fog.trial081:Node is ready
2026-02-13T04:54:32.118 DEBUG:teuthology.orchestra.run.trial081:> hostname
2026-02-13T04:54:32.175 INFO:teuthology.orchestra.run.trial081.stdout:trial081.front.sepia.ceph.com
2026-02-13T04:54:32.176 DEBUG:teuthology.orchestra.run.trial081:> grep trial081.front.sepia.ceph.com /etc/hosts
2026-02-13T04:54:32.233 INFO:teuthology.orchestra.run.trial081.stdout:10.20.193.81 trial081.front.sepia.ceph.com trial081
2026-02-13T04:54:32.233 DEBUG:teuthology.orchestra.run.trial081:> sudo hostname trial081
2026-02-13T04:54:32.307 DEBUG:teuthology.orchestra.run.trial081:> sudo sed -i -e 's/trial081.front.sepia.ceph.com/trial081/g' /etc/hosts
2026-02-13T04:54:32.374 DEBUG:teuthology.orchestra.run.trial081:> sudo sed -i -e 's/10.20.193.81/10.20.193.81/g' /etc/hosts
2026-02-13T04:54:32.441 DEBUG:teuthology.orchestra.run.trial081:> sudo sed -i -e 's/trial081.front.sepia.ceph.com/trial081/g' /etc/hostname
2026-02-13T04:54:32.508 DEBUG:teuthology.orchestra.run.trial081:> sudo hostname trial081
2026-02-13T04:54:32.574 DEBUG:teuthology.orchestra.run.trial081:> cat /etc/os-release
2026-02-13T04:54:32.631 INFO:teuthology.orchestra.run.trial081.stdout:NAME="Rocky Linux"
2026-02-13T04:54:32.631 INFO:teuthology.orchestra.run.trial081.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T04:54:32.631 INFO:teuthology.orchestra.run.trial081.stdout:ID="rocky"
2026-02-13T04:54:32.632 INFO:teuthology.orchestra.run.trial081.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T04:54:32.632 INFO:teuthology.orchestra.run.trial081.stdout:VERSION_ID="10.1"
2026-02-13T04:54:32.632 INFO:teuthology.orchestra.run.trial081.stdout:PLATFORM_ID="platform:el10"
2026-02-13T04:54:32.632 INFO:teuthology.orchestra.run.trial081.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T04:54:32.632 INFO:teuthology.orchestra.run.trial081.stdout:ANSI_COLOR="0;32"
2026-02-13T04:54:32.632 INFO:teuthology.orchestra.run.trial081.stdout:LOGO="fedora-logo-icon"
2026-02-13T04:54:32.632 INFO:teuthology.orchestra.run.trial081.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T04:54:32.632 INFO:teuthology.orchestra.run.trial081.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T04:54:32.632 INFO:teuthology.orchestra.run.trial081.stdout:VENDOR_NAME="RESF"
2026-02-13T04:54:32.632 INFO:teuthology.orchestra.run.trial081.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T04:54:32.632 INFO:teuthology.orchestra.run.trial081.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T04:54:32.632 INFO:teuthology.orchestra.run.trial081.stdout:SUPPORT_END="2035-05-31"
2026-02-13T04:54:32.633 INFO:teuthology.orchestra.run.trial081.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T04:54:32.633 INFO:teuthology.orchestra.run.trial081.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:54:32.633 INFO:teuthology.orchestra.run.trial081.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T04:54:32.633 INFO:teuthology.orchestra.run.trial081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:54:32.633 INFO:teuthology.provision.fog.trial081:Deploy complete!
2026-02-13T04:54:32.634 DEBUG:teuthology.parallel:result is None
2026-02-13T04:54:33.030 INFO:teuthology.lock.ops:Checking trial081.front.sepia.ceph.com
2026-02-13T04:54:33.030 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T04:54:33.129 INFO:teuthology.lock.ops:Checking trial131.front.sepia.ceph.com
2026-02-13T04:54:33.129 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T04:54:33.191 INFO:teuthology.lock.ops:Updating [trial081.front.sepia.ceph.com]: set os type and version on server
2026-02-13T04:54:33.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial081.front.sepia.ceph.com'
2026-02-13T04:54:33.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:54:33.251 DEBUG:teuthology.orchestra.run.trial081:> true
2026-02-13T04:54:33.326 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial081.front.sepia.ceph.com'
2026-02-13T04:54:33.327 DEBUG:teuthology.orchestra.run.trial081:> uname -m
2026-02-13T04:54:33.384 INFO:teuthology.orchestra.run.trial081.stdout:x86_64
2026-02-13T04:54:33.384 DEBUG:teuthology.orchestra.run.trial081:> cat /etc/os-release
2026-02-13T04:54:33.442 INFO:teuthology.orchestra.run.trial081.stdout:NAME="Rocky Linux"
2026-02-13T04:54:33.442 INFO:teuthology.orchestra.run.trial081.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T04:54:33.442 INFO:teuthology.orchestra.run.trial081.stdout:ID="rocky"
2026-02-13T04:54:33.442 INFO:teuthology.orchestra.run.trial081.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T04:54:33.442 INFO:teuthology.orchestra.run.trial081.stdout:VERSION_ID="10.1"
2026-02-13T04:54:33.443 INFO:teuthology.orchestra.run.trial081.stdout:PLATFORM_ID="platform:el10"
2026-02-13T04:54:33.443 INFO:teuthology.orchestra.run.trial081.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T04:54:33.443 INFO:teuthology.orchestra.run.trial081.stdout:ANSI_COLOR="0;32"
2026-02-13T04:54:33.443 INFO:teuthology.orchestra.run.trial081.stdout:LOGO="fedora-logo-icon"
2026-02-13T04:54:33.443 INFO:teuthology.orchestra.run.trial081.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T04:54:33.443 INFO:teuthology.orchestra.run.trial081.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T04:54:33.443 INFO:teuthology.orchestra.run.trial081.stdout:VENDOR_NAME="RESF"
2026-02-13T04:54:33.443 INFO:teuthology.orchestra.run.trial081.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T04:54:33.443 INFO:teuthology.orchestra.run.trial081.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T04:54:33.443 INFO:teuthology.orchestra.run.trial081.stdout:SUPPORT_END="2035-05-31"
2026-02-13T04:54:33.443 INFO:teuthology.orchestra.run.trial081.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T04:54:33.444 INFO:teuthology.orchestra.run.trial081.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:54:33.444 INFO:teuthology.orchestra.run.trial081.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T04:54:33.444 INFO:teuthology.orchestra.run.trial081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:54:33.444 INFO:teuthology.lock.ops:Updating trial081.front.sepia.ceph.com on lock server
2026-02-13T04:54:33.548 INFO:teuthology.lock.ops:Updating [trial131.front.sepia.ceph.com]: set os type and version on server
2026-02-13T04:54:33.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com'
2026-02-13T04:54:33.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:54:33.616 DEBUG:teuthology.orchestra.run.trial131:> true
2026-02-13T04:54:33.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com'
2026-02-13T04:54:33.695 DEBUG:teuthology.orchestra.run.trial131:> uname -m
2026-02-13T04:54:33.752 INFO:teuthology.orchestra.run.trial131.stdout:x86_64
2026-02-13T04:54:33.752 DEBUG:teuthology.orchestra.run.trial131:> cat /etc/os-release
2026-02-13T04:54:33.810 INFO:teuthology.orchestra.run.trial131.stdout:NAME="Rocky Linux"
2026-02-13T04:54:33.810 INFO:teuthology.orchestra.run.trial131.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T04:54:33.811 INFO:teuthology.orchestra.run.trial131.stdout:ID="rocky"
2026-02-13T04:54:33.811 INFO:teuthology.orchestra.run.trial131.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T04:54:33.811 INFO:teuthology.orchestra.run.trial131.stdout:VERSION_ID="10.1"
2026-02-13T04:54:33.811 INFO:teuthology.orchestra.run.trial131.stdout:PLATFORM_ID="platform:el10"
2026-02-13T04:54:33.811 INFO:teuthology.orchestra.run.trial131.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T04:54:33.811 INFO:teuthology.orchestra.run.trial131.stdout:ANSI_COLOR="0;32"
2026-02-13T04:54:33.811 INFO:teuthology.orchestra.run.trial131.stdout:LOGO="fedora-logo-icon"
2026-02-13T04:54:33.811 INFO:teuthology.orchestra.run.trial131.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T04:54:33.811 INFO:teuthology.orchestra.run.trial131.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T04:54:33.811 INFO:teuthology.orchestra.run.trial131.stdout:VENDOR_NAME="RESF"
2026-02-13T04:54:33.811 INFO:teuthology.orchestra.run.trial131.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T04:54:33.812 INFO:teuthology.orchestra.run.trial131.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T04:54:33.812 INFO:teuthology.orchestra.run.trial131.stdout:SUPPORT_END="2035-05-31"
2026-02-13T04:54:33.812 INFO:teuthology.orchestra.run.trial131.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T04:54:33.812 INFO:teuthology.orchestra.run.trial131.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:54:33.812 INFO:teuthology.orchestra.run.trial131.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T04:54:33.812 INFO:teuthology.orchestra.run.trial131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:54:33.813 INFO:teuthology.lock.ops:Updating trial131.front.sepia.ceph.com on lock server
2026-02-13T04:54:33.917 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T04:54:34.016 INFO:teuthology.dispatcher.supervisor:Running job 48186
2026-02-13T04:54:34.016 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48186 --name pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} kclient-overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health} tasks/kernel_cfuse_workunits_untarbuild_blogbench} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48186/orig.config.yaml
2026-02-13T04:54:34.016 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48186
2026-02-13T04:54:34.016 INFO:teuthology.dispatcher.supervisor:Job PID: 1586542
2026-02-13T04:54:34.016 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-13T04:56:34.043 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T04:58:34.228 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:00:34.417 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:02:34.618 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:04:34.774 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:06:34.940 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:08:35.149 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:10:35.357 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:12:35.549 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:14:35.754 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:16:35.877 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:18:35.977 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:20:36.203 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:22:36.307 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:24:36.515 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:26:36.710 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:28:36.895 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:30:37.089 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:32:37.281 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:34:37.468 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:36:37.655 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:38:37.839 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:40:38.042 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:42:38.252 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:44:38.458 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:46:38.690 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:48:38.853 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:50:39.058 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:52:39.194 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:54:39.360 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:56:39.555 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:58:39.764 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:00:39.882 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:02:40.102 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:04:40.308 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:06:40.460 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:08:40.581 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:10:40.768 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:12:40.950 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:14:41.143 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:16:41.337 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:18:41.511 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:20:41.687 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:22:41.869 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:24:42.041 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:26:42.243 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:28:42.437 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:30:42.589 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:32:42.791 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:34:42.973 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:36:43.181 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:38:43.357 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:40:43.539 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:42:43.681 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:44:43.869 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:46:44.045 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:48:44.239 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:50:44.459 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:52:44.615 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:54:44.831 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:56:45.041 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T06:58:45.253 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:00:45.441 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:02:45.649 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:04:45.862 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:06:46.010 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:08:46.209 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:10:46.384 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:12:46.553 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:14:46.709 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:16:46.917 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:18:47.104 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:20:47.263 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:22:47.389 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:24:47.565 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:26:47.746 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:28:47.848 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:30:47.973 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:32:48.146 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:34:48.343 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:36:48.541 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:38:48.720 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:40:48.909 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:42:49.111 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:44:49.279 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:46:49.472 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:48:49.596 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:50:49.779 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:52:49.913 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:54:50.113 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:56:50.310 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T07:58:50.482 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T08:00:50.611 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T08:02:50.722 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T08:04:50.834 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T08:06:50.996 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T08:08:51.165 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T08:10:51.373 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T08:10:51.469 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-13T08:10:51.586 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-13T08:10:52.078 INFO:teuthology.orchestra.console.trial081:Power off
2026-02-13T08:10:52.078 DEBUG:teuthology.orchestra.console.trial081:pexpect command: ipmitool -H trial081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T08:10:52.096 INFO:teuthology.orchestra.console.trial131:Power off
2026-02-13T08:10:52.097 DEBUG:teuthology.orchestra.console.trial131:pexpect command: ipmitool -H trial131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T08:10:52.115 DEBUG:teuthology.orchestra.console.trial081:power off output: Chassis Power Control: Down/Off
2026-02-13T08:10:52.134 DEBUG:teuthology.orchestra.console.trial131:power off output: Chassis Power Control: Down/Off
2026-02-13T08:10:56.121 DEBUG:teuthology.orchestra.console.trial081:pexpect command: ipmitool -H trial081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T08:10:56.134 DEBUG:teuthology.orchestra.console.trial131:pexpect command: ipmitool -H trial131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T08:10:56.228 DEBUG:teuthology.orchestra.console.trial081:check power output: Chassis Power is on
2026-02-13T08:10:56.241 DEBUG:teuthology.orchestra.console.trial131:check power output: Chassis Power is on
2026-02-13T08:11:00.234 DEBUG:teuthology.orchestra.console.trial081:pexpect command: ipmitool -H trial081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T08:11:00.242 DEBUG:teuthology.orchestra.console.trial131:pexpect command: ipmitool -H trial131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T08:11:00.344 DEBUG:teuthology.orchestra.console.trial081:check power output: Chassis Power is off
2026-02-13T08:11:00.344 INFO:teuthology.orchestra.console.trial081:Power off completed
2026-02-13T08:11:00.351 DEBUG:teuthology.orchestra.console.trial131:check power output: Chassis Power is off
2026-02-13T08:11:00.351 INFO:teuthology.orchestra.console.trial131:Power off completed
2026-02-13T08:11:00.593 INFO:teuthology.lock.ops:unlocked: trial081.front.sepia.ceph.com
2026-02-13T08:11:00.615 INFO:teuthology.lock.ops:unlocked: trial131.front.sepia.ceph.com