2026-02-13T02:43:24.605 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae
2026-02-13T02:43:24.606 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:43:24.678 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:43:24.929 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x715a7dc5eb40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x715a7d54c860>, signals=[15])
2026-02-13T02:43:24.929 INFO:teuthology.lock.ops:Start node 'trial070.front.sepia.ceph.com' reimaging
2026-02-13T02:43:24.929 INFO:teuthology.lock.ops:Updating [trial070.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T02:43:24.929 INFO:teuthology.lock.ops:Updating trial070.front.sepia.ceph.com on lock server
2026-02-13T02:43:24.986 INFO:teuthology.lock.ops:Start node 'trial082.front.sepia.ceph.com' reimaging
2026-02-13T02:43:24.986 INFO:teuthology.lock.ops:Updating [trial082.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T02:43:24.987 INFO:teuthology.lock.ops:Updating trial082.front.sepia.ceph.com on lock server
2026-02-13T02:43:25.045 INFO:teuthology.lock.ops:Start node 'trial192.front.sepia.ceph.com' reimaging
2026-02-13T02:43:25.045 INFO:teuthology.lock.ops:Updating [trial192.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T02:43:25.045 INFO:teuthology.lock.ops:Updating trial192.front.sepia.ceph.com on lock server
2026-02-13T02:43:25.277 DEBUG:teuthology.provision.fog.trial070:Requesting image trial_rocky_10.1 (ID 4)
2026-02-13T02:43:25.278 DEBUG:teuthology.provision.fog.trial082:Requesting image trial_rocky_10.1 (ID 4)
2026-02-13T02:43:25.320 INFO:teuthology.provision.fog.trial070:Scheduling deploy of rocky 10.1
2026-02-13T02:43:25.328 DEBUG:teuthology.provision.fog.trial192:Requesting image trial_rocky_10.1 (ID 4)
2026-02-13T02:43:25.331 INFO:teuthology.provision.fog.trial082:Scheduling deploy of rocky 10.1
2026-02-13T02:43:25.376 INFO:teuthology.provision.fog.trial192:Scheduling deploy of rocky 10.1
2026-02-13T02:43:26.576 INFO:teuthology.orchestra.console.trial070:Power off
2026-02-13T02:43:26.576 DEBUG:teuthology.orchestra.console.trial070:pexpect command: ipmitool -H trial070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T02:43:26.587 INFO:teuthology.orchestra.console.trial192:Power off
2026-02-13T02:43:26.587 DEBUG:teuthology.orchestra.console.trial192:pexpect command: ipmitool -H trial192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T02:43:26.597 INFO:teuthology.orchestra.console.trial082:Power off
2026-02-13T02:43:26.597 DEBUG:teuthology.orchestra.console.trial082:pexpect command: ipmitool -H trial082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T02:43:26.615 DEBUG:teuthology.orchestra.console.trial070:power off output: Chassis Power Control: Down/Off
2026-02-13T02:43:26.623 DEBUG:teuthology.orchestra.console.trial192:power off output: Chassis Power Control: Down/Off
2026-02-13T02:43:26.636 DEBUG:teuthology.orchestra.console.trial082:power off output: Chassis Power Control: Down/Off
2026-02-13T02:43:30.618 DEBUG:teuthology.orchestra.console.trial070:pexpect command: ipmitool -H trial070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:43:30.624 DEBUG:teuthology.orchestra.console.trial192:pexpect command: ipmitool -H trial192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:43:30.636 DEBUG:teuthology.orchestra.console.trial082:pexpect command: ipmitool -H trial082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:43:30.726 DEBUG:teuthology.orchestra.console.trial070:check power output: Chassis Power is off
2026-02-13T02:43:30.727 INFO:teuthology.orchestra.console.trial070:Power off completed
2026-02-13T02:43:30.730 DEBUG:teuthology.orchestra.console.trial192:check power output: Chassis Power is off
2026-02-13T02:43:30.730 INFO:teuthology.orchestra.console.trial192:Power off completed
2026-02-13T02:43:30.743 DEBUG:teuthology.orchestra.console.trial082:check power output: Chassis Power is off
2026-02-13T02:43:30.743 INFO:teuthology.orchestra.console.trial082:Power off completed
2026-02-13T02:43:30.828 INFO:teuthology.orchestra.console.trial070:Power on
2026-02-13T02:43:30.828 DEBUG:teuthology.orchestra.console.trial070:pexpect command: ipmitool -H trial070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T02:43:30.836 INFO:teuthology.orchestra.console.trial192:Power on
2026-02-13T02:43:30.836 DEBUG:teuthology.orchestra.console.trial192:pexpect command: ipmitool -H trial192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T02:43:30.844 INFO:teuthology.orchestra.console.trial082:Power on
2026-02-13T02:43:30.845 DEBUG:teuthology.orchestra.console.trial082:pexpect command: ipmitool -H trial082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T02:43:30.868 DEBUG:teuthology.orchestra.console.trial070:power on output: Chassis Power Control: Up/On
2026-02-13T02:43:30.874 DEBUG:teuthology.orchestra.console.trial192:power on output: Chassis Power Control: Up/On
2026-02-13T02:43:30.883 DEBUG:teuthology.orchestra.console.trial082:power on output: Chassis Power Control: Up/On
2026-02-13T02:43:34.872 DEBUG:teuthology.orchestra.console.trial070:pexpect command: ipmitool -H trial070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:43:34.880 DEBUG:teuthology.orchestra.console.trial192:pexpect command: ipmitool -H trial192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:43:34.887 DEBUG:teuthology.orchestra.console.trial082:pexpect command: ipmitool -H trial082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:43:34.982 DEBUG:teuthology.orchestra.console.trial070:check power output: Chassis Power is on
2026-02-13T02:43:34.983 INFO:teuthology.orchestra.console.trial070:Power on completed
2026-02-13T02:43:34.989 DEBUG:teuthology.orchestra.console.trial192:check power output: Chassis Power is on
2026-02-13T02:43:34.989 INFO:teuthology.orchestra.console.trial192:Power on completed
2026-02-13T02:43:34.997 DEBUG:teuthology.orchestra.console.trial082:check power output: Chassis Power is on
2026-02-13T02:43:34.997 INFO:teuthology.orchestra.console.trial082:Power on completed
2026-02-13T02:43:35.084 INFO:teuthology.provision.fog.trial070:Waiting for deploy to finish
2026-02-13T02:43:35.090 INFO:teuthology.provision.fog.trial192:Waiting for deploy to finish
2026-02-13T02:43:35.098 INFO:teuthology.provision.fog.trial082:Waiting for deploy to finish
2026-02-13T02:45:22.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:45:22.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:45:22.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:45:36.733 WARNING:teuthology.provision.fog.trial192:[Errno None] Unable to connect to port 22 on 10.20.193.192
2026-02-13T02:45:36.861 WARNING:teuthology.provision.fog.trial082:[Errno None] Unable to connect to port 22 on 10.20.193.82
2026-02-13T02:45:36.862 WARNING:teuthology.provision.fog.trial070:[Errno None] Unable to connect to port 22 on 10.20.193.70
2026-02-13T02:45:42.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:45:42.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:45:42.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:45:45.821 WARNING:teuthology.provision.fog.trial192:[Errno None] Unable to connect to port 22 on 10.20.193.192
2026-02-13T02:45:45.949 WARNING:teuthology.provision.fog.trial082:[Errno None] Unable to connect to port 22 on 10.20.193.82
2026-02-13T02:45:45.949 WARNING:teuthology.provision.fog.trial070:[Errno None] Unable to connect to port 22 on 10.20.193.70
2026-02-13T02:45:51.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:45:51.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:45:51.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:45:54.909 WARNING:teuthology.provision.fog.trial192:[Errno None] Unable to connect to port 22 on 10.20.193.192
2026-02-13T02:45:55.037 WARNING:teuthology.provision.fog.trial082:[Errno None] Unable to connect to port 22 on 10.20.193.82
2026-02-13T02:45:55.037 WARNING:teuthology.provision.fog.trial070:[Errno None] Unable to connect to port 22 on 10.20.193.70
2026-02-13T02:46:00.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:46:01.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:46:01.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:46:04.125 WARNING:teuthology.provision.fog.trial082:[Errno None] Unable to connect to port 22 on 10.20.193.82
2026-02-13T02:46:10.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:46:13.213 WARNING:teuthology.provision.fog.trial082:[Errno None] Unable to connect to port 22 on 10.20.193.82
2026-02-13T02:46:19.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:46:22.301 WARNING:teuthology.provision.fog.trial082:[Errno None] Unable to connect to port 22 on 10.20.193.82
2026-02-13T02:46:28.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:46:37.130 ERROR:teuthology.orchestra.connection:Error authenticating with trial192.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T02:46:37.131 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T02:46:37.132 DEBUG:teuthology.orchestra.run.trial070:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T02:46:41.209 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T02:46:41.209 DEBUG:teuthology.orchestra.run.trial192:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T02:46:42.058 INFO:teuthology.provision.fog.trial070:Node is ready
2026-02-13T02:46:42.058 DEBUG:teuthology.orchestra.run.trial070:> hostname
2026-02-13T02:46:42.074 INFO:teuthology.orchestra.run.trial070.stdout:trial070.front.sepia.ceph.com
2026-02-13T02:46:42.075 DEBUG:teuthology.orchestra.run.trial070:> grep trial070.front.sepia.ceph.com /etc/hosts
2026-02-13T02:46:42.132 INFO:teuthology.orchestra.run.trial070.stdout:10.20.193.70 trial070.front.sepia.ceph.com trial070
2026-02-13T02:46:42.132 DEBUG:teuthology.orchestra.run.trial070:> sudo hostname trial070
2026-02-13T02:46:42.210 DEBUG:teuthology.orchestra.run.trial070:> sudo sed -i -e 's/trial070.front.sepia.ceph.com/trial070/g' /etc/hosts
2026-02-13T02:46:42.279 DEBUG:teuthology.orchestra.run.trial070:> sudo sed -i -e 's/10.20.193.70/10.20.193.70/g' /etc/hosts
2026-02-13T02:46:42.346 DEBUG:teuthology.orchestra.run.trial070:> sudo sed -i -e 's/trial070.front.sepia.ceph.com/trial070/g' /etc/hostname
2026-02-13T02:46:42.412 DEBUG:teuthology.orchestra.run.trial070:> sudo hostname trial070
2026-02-13T02:46:42.478 DEBUG:teuthology.orchestra.run.trial070:> cat /etc/os-release
2026-02-13T02:46:42.535 INFO:teuthology.orchestra.run.trial070.stdout:NAME="Rocky Linux"
2026-02-13T02:46:42.535 INFO:teuthology.orchestra.run.trial070.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T02:46:42.535 INFO:teuthology.orchestra.run.trial070.stdout:ID="rocky"
2026-02-13T02:46:42.536 INFO:teuthology.orchestra.run.trial070.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T02:46:42.536 INFO:teuthology.orchestra.run.trial070.stdout:VERSION_ID="10.1"
2026-02-13T02:46:42.536 INFO:teuthology.orchestra.run.trial070.stdout:PLATFORM_ID="platform:el10"
2026-02-13T02:46:42.536 INFO:teuthology.orchestra.run.trial070.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T02:46:42.536 INFO:teuthology.orchestra.run.trial070.stdout:ANSI_COLOR="0;32"
2026-02-13T02:46:42.536 INFO:teuthology.orchestra.run.trial070.stdout:LOGO="fedora-logo-icon"
2026-02-13T02:46:42.536 INFO:teuthology.orchestra.run.trial070.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T02:46:42.536 INFO:teuthology.orchestra.run.trial070.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T02:46:42.536 INFO:teuthology.orchestra.run.trial070.stdout:VENDOR_NAME="RESF"
2026-02-13T02:46:42.536 INFO:teuthology.orchestra.run.trial070.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T02:46:42.536 INFO:teuthology.orchestra.run.trial070.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T02:46:42.536 INFO:teuthology.orchestra.run.trial070.stdout:SUPPORT_END="2035-05-31"
2026-02-13T02:46:42.537 INFO:teuthology.orchestra.run.trial070.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T02:46:42.537 INFO:teuthology.orchestra.run.trial070.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:46:42.537 INFO:teuthology.orchestra.run.trial070.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T02:46:42.537 INFO:teuthology.orchestra.run.trial070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:46:42.538 INFO:teuthology.provision.fog.trial070:Deploy complete!
2026-02-13T02:46:42.539 DEBUG:teuthology.parallel:result is None
2026-02-13T02:46:46.386 INFO:teuthology.provision.fog.trial192:Node is ready
2026-02-13T02:46:46.387 DEBUG:teuthology.orchestra.run.trial192:> hostname
2026-02-13T02:46:46.443 INFO:teuthology.orchestra.run.trial192.stdout:trial192.front.sepia.ceph.com
2026-02-13T02:46:46.444 DEBUG:teuthology.orchestra.run.trial192:> grep trial192.front.sepia.ceph.com /etc/hosts
2026-02-13T02:46:46.502 INFO:teuthology.orchestra.run.trial192.stdout:10.20.193.192 trial192.front.sepia.ceph.com trial192
2026-02-13T02:46:46.502 DEBUG:teuthology.orchestra.run.trial192:> sudo hostname trial192
2026-02-13T02:46:46.576 DEBUG:teuthology.orchestra.run.trial192:> sudo sed -i -e 's/trial192.front.sepia.ceph.com/trial192/g' /etc/hosts
2026-02-13T02:46:46.643 DEBUG:teuthology.orchestra.run.trial192:> sudo sed -i -e 's/10.20.193.192/10.20.193.192/g' /etc/hosts
2026-02-13T02:46:46.710 DEBUG:teuthology.orchestra.run.trial192:> sudo sed -i -e 's/trial192.front.sepia.ceph.com/trial192/g' /etc/hostname
2026-02-13T02:46:46.776 DEBUG:teuthology.orchestra.run.trial192:> sudo hostname trial192
2026-02-13T02:46:46.844 DEBUG:teuthology.orchestra.run.trial192:> cat /etc/os-release
2026-02-13T02:46:46.901 INFO:teuthology.orchestra.run.trial192.stdout:NAME="Rocky Linux"
2026-02-13T02:46:46.901 INFO:teuthology.orchestra.run.trial192.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T02:46:46.901 INFO:teuthology.orchestra.run.trial192.stdout:ID="rocky"
2026-02-13T02:46:46.901 INFO:teuthology.orchestra.run.trial192.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T02:46:46.901 INFO:teuthology.orchestra.run.trial192.stdout:VERSION_ID="10.1"
2026-02-13T02:46:46.901 INFO:teuthology.orchestra.run.trial192.stdout:PLATFORM_ID="platform:el10"
2026-02-13T02:46:46.901 INFO:teuthology.orchestra.run.trial192.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T02:46:46.901 INFO:teuthology.orchestra.run.trial192.stdout:ANSI_COLOR="0;32"
2026-02-13T02:46:46.901 INFO:teuthology.orchestra.run.trial192.stdout:LOGO="fedora-logo-icon"
2026-02-13T02:46:46.901 INFO:teuthology.orchestra.run.trial192.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T02:46:46.901 INFO:teuthology.orchestra.run.trial192.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T02:46:46.901 INFO:teuthology.orchestra.run.trial192.stdout:VENDOR_NAME="RESF"
2026-02-13T02:46:46.901 INFO:teuthology.orchestra.run.trial192.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T02:46:46.901 INFO:teuthology.orchestra.run.trial192.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T02:46:46.901 INFO:teuthology.orchestra.run.trial192.stdout:SUPPORT_END="2035-05-31"
2026-02-13T02:46:46.901 INFO:teuthology.orchestra.run.trial192.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T02:46:46.901 INFO:teuthology.orchestra.run.trial192.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:46:46.901 INFO:teuthology.orchestra.run.trial192.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T02:46:46.901 INFO:teuthology.orchestra.run.trial192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:46:46.901 INFO:teuthology.provision.fog.trial192:Deploy complete!
2026-02-13T02:46:46.901 DEBUG:teuthology.parallel:result is None
2026-02-13T02:47:04.220 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T02:47:04.220 DEBUG:teuthology.orchestra.run.trial082:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T02:47:09.033 INFO:teuthology.provision.fog.trial082:Node is ready
2026-02-13T02:47:09.033 DEBUG:teuthology.orchestra.run.trial082:> hostname
2026-02-13T02:47:09.049 INFO:teuthology.orchestra.run.trial082.stdout:trial082.front.sepia.ceph.com
2026-02-13T02:47:09.049 DEBUG:teuthology.orchestra.run.trial082:> grep trial082.front.sepia.ceph.com /etc/hosts
2026-02-13T02:47:09.105 INFO:teuthology.orchestra.run.trial082.stdout:10.20.193.82 trial082.front.sepia.ceph.com trial082
2026-02-13T02:47:09.105 DEBUG:teuthology.orchestra.run.trial082:> sudo hostname trial082
2026-02-13T02:47:09.174 DEBUG:teuthology.orchestra.run.trial082:> sudo sed -i -e 's/trial082.front.sepia.ceph.com/trial082/g' /etc/hosts
2026-02-13T02:47:09.238 DEBUG:teuthology.orchestra.run.trial082:> sudo sed -i -e 's/10.20.193.82/10.20.193.82/g' /etc/hosts
2026-02-13T02:47:09.303 DEBUG:teuthology.orchestra.run.trial082:> sudo sed -i -e 's/trial082.front.sepia.ceph.com/trial082/g' /etc/hostname
2026-02-13T02:47:09.370 DEBUG:teuthology.orchestra.run.trial082:> sudo hostname trial082
2026-02-13T02:47:09.440 DEBUG:teuthology.orchestra.run.trial082:> cat /etc/os-release
2026-02-13T02:47:09.495 INFO:teuthology.orchestra.run.trial082.stdout:NAME="Rocky Linux"
2026-02-13T02:47:09.495 INFO:teuthology.orchestra.run.trial082.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T02:47:09.495 INFO:teuthology.orchestra.run.trial082.stdout:ID="rocky"
2026-02-13T02:47:09.495 INFO:teuthology.orchestra.run.trial082.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T02:47:09.495 INFO:teuthology.orchestra.run.trial082.stdout:VERSION_ID="10.1"
2026-02-13T02:47:09.496 INFO:teuthology.orchestra.run.trial082.stdout:PLATFORM_ID="platform:el10"
2026-02-13T02:47:09.496 INFO:teuthology.orchestra.run.trial082.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T02:47:09.496 INFO:teuthology.orchestra.run.trial082.stdout:ANSI_COLOR="0;32"
2026-02-13T02:47:09.496 INFO:teuthology.orchestra.run.trial082.stdout:LOGO="fedora-logo-icon"
2026-02-13T02:47:09.496 INFO:teuthology.orchestra.run.trial082.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T02:47:09.496 INFO:teuthology.orchestra.run.trial082.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T02:47:09.496 INFO:teuthology.orchestra.run.trial082.stdout:VENDOR_NAME="RESF"
2026-02-13T02:47:09.496 INFO:teuthology.orchestra.run.trial082.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T02:47:09.496 INFO:teuthology.orchestra.run.trial082.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T02:47:09.496 INFO:teuthology.orchestra.run.trial082.stdout:SUPPORT_END="2035-05-31"
2026-02-13T02:47:09.496 INFO:teuthology.orchestra.run.trial082.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T02:47:09.496 INFO:teuthology.orchestra.run.trial082.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:47:09.497 INFO:teuthology.orchestra.run.trial082.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T02:47:09.497 INFO:teuthology.orchestra.run.trial082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:47:09.497 INFO:teuthology.provision.fog.trial082:Deploy complete!
2026-02-13T02:47:09.498 DEBUG:teuthology.parallel:result is None
2026-02-13T02:47:10.015 INFO:teuthology.lock.ops:Checking trial070.front.sepia.ceph.com
2026-02-13T02:47:10.015 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T02:47:10.123 INFO:teuthology.lock.ops:Checking trial082.front.sepia.ceph.com
2026-02-13T02:47:10.123 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T02:47:10.181 INFO:teuthology.lock.ops:Checking trial192.front.sepia.ceph.com
2026-02-13T02:47:10.181 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T02:47:10.240 INFO:teuthology.lock.ops:Updating [trial070.front.sepia.ceph.com]: set os type and version on server
2026-02-13T02:47:10.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com'
2026-02-13T02:47:10.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:47:10.302 DEBUG:teuthology.orchestra.run.trial070:> true
2026-02-13T02:47:10.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com'
2026-02-13T02:47:10.482 DEBUG:teuthology.orchestra.run.trial070:> uname -m
2026-02-13T02:47:10.540 INFO:teuthology.orchestra.run.trial070.stdout:x86_64
2026-02-13T02:47:10.541 DEBUG:teuthology.orchestra.run.trial070:> cat /etc/os-release
2026-02-13T02:47:10.598 INFO:teuthology.orchestra.run.trial070.stdout:NAME="Rocky Linux"
2026-02-13T02:47:10.598 INFO:teuthology.orchestra.run.trial070.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T02:47:10.598 INFO:teuthology.orchestra.run.trial070.stdout:ID="rocky"
2026-02-13T02:47:10.598 INFO:teuthology.orchestra.run.trial070.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T02:47:10.598 INFO:teuthology.orchestra.run.trial070.stdout:VERSION_ID="10.1"
2026-02-13T02:47:10.599 INFO:teuthology.orchestra.run.trial070.stdout:PLATFORM_ID="platform:el10"
2026-02-13T02:47:10.599 INFO:teuthology.orchestra.run.trial070.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T02:47:10.599 INFO:teuthology.orchestra.run.trial070.stdout:ANSI_COLOR="0;32"
2026-02-13T02:47:10.599 INFO:teuthology.orchestra.run.trial070.stdout:LOGO="fedora-logo-icon"
2026-02-13T02:47:10.599 INFO:teuthology.orchestra.run.trial070.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T02:47:10.599 INFO:teuthology.orchestra.run.trial070.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T02:47:10.599 INFO:teuthology.orchestra.run.trial070.stdout:VENDOR_NAME="RESF"
2026-02-13T02:47:10.599 INFO:teuthology.orchestra.run.trial070.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T02:47:10.599 INFO:teuthology.orchestra.run.trial070.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T02:47:10.599 INFO:teuthology.orchestra.run.trial070.stdout:SUPPORT_END="2035-05-31"
2026-02-13T02:47:10.599 INFO:teuthology.orchestra.run.trial070.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T02:47:10.600 INFO:teuthology.orchestra.run.trial070.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:47:10.600 INFO:teuthology.orchestra.run.trial070.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T02:47:10.600 INFO:teuthology.orchestra.run.trial070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:47:10.600 INFO:teuthology.lock.ops:Updating trial070.front.sepia.ceph.com on lock server
2026-02-13T02:47:10.706 INFO:teuthology.lock.ops:Updating [trial082.front.sepia.ceph.com]: set os type and version on server
2026-02-13T02:47:10.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com'
2026-02-13T02:47:10.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:47:10.774 DEBUG:teuthology.orchestra.run.trial082:> true
2026-02-13T02:47:10.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com'
2026-02-13T02:47:10.849 DEBUG:teuthology.orchestra.run.trial082:> uname -m
2026-02-13T02:47:10.903 INFO:teuthology.orchestra.run.trial082.stdout:x86_64
2026-02-13T02:47:10.904 DEBUG:teuthology.orchestra.run.trial082:> cat /etc/os-release
2026-02-13T02:47:10.958 INFO:teuthology.orchestra.run.trial082.stdout:NAME="Rocky Linux"
2026-02-13T02:47:10.958 INFO:teuthology.orchestra.run.trial082.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T02:47:10.958 INFO:teuthology.orchestra.run.trial082.stdout:ID="rocky"
2026-02-13T02:47:10.958 INFO:teuthology.orchestra.run.trial082.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T02:47:10.958 INFO:teuthology.orchestra.run.trial082.stdout:VERSION_ID="10.1"
2026-02-13T02:47:10.958 INFO:teuthology.orchestra.run.trial082.stdout:PLATFORM_ID="platform:el10"
2026-02-13T02:47:10.958 INFO:teuthology.orchestra.run.trial082.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T02:47:10.958 INFO:teuthology.orchestra.run.trial082.stdout:ANSI_COLOR="0;32"
2026-02-13T02:47:10.958 INFO:teuthology.orchestra.run.trial082.stdout:LOGO="fedora-logo-icon"
2026-02-13T02:47:10.959 INFO:teuthology.orchestra.run.trial082.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T02:47:10.959 INFO:teuthology.orchestra.run.trial082.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T02:47:10.959 INFO:teuthology.orchestra.run.trial082.stdout:VENDOR_NAME="RESF"
2026-02-13T02:47:10.959 INFO:teuthology.orchestra.run.trial082.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T02:47:10.959 INFO:teuthology.orchestra.run.trial082.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T02:47:10.959 INFO:teuthology.orchestra.run.trial082.stdout:SUPPORT_END="2035-05-31"
2026-02-13T02:47:10.959 INFO:teuthology.orchestra.run.trial082.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T02:47:10.959 INFO:teuthology.orchestra.run.trial082.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:47:10.959 INFO:teuthology.orchestra.run.trial082.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T02:47:10.959 INFO:teuthology.orchestra.run.trial082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:47:10.960 INFO:teuthology.lock.ops:Updating trial082.front.sepia.ceph.com on lock server
2026-02-13T02:47:11.064 INFO:teuthology.lock.ops:Updating [trial192.front.sepia.ceph.com]: set os type and version on server
2026-02-13T02:47:11.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial192.front.sepia.ceph.com'
2026-02-13T02:47:11.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:47:11.135 DEBUG:teuthology.orchestra.run.trial192:> true
2026-02-13T02:47:11.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial192.front.sepia.ceph.com'
2026-02-13T02:47:11.221 DEBUG:teuthology.orchestra.run.trial192:> uname -m
2026-02-13T02:47:11.278 INFO:teuthology.orchestra.run.trial192.stdout:x86_64
2026-02-13T02:47:11.278 DEBUG:teuthology.orchestra.run.trial192:> cat /etc/os-release
2026-02-13T02:47:11.335 INFO:teuthology.orchestra.run.trial192.stdout:NAME="Rocky Linux"
2026-02-13T02:47:11.335 INFO:teuthology.orchestra.run.trial192.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T02:47:11.335 INFO:teuthology.orchestra.run.trial192.stdout:ID="rocky"
2026-02-13T02:47:11.335 INFO:teuthology.orchestra.run.trial192.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T02:47:11.335 INFO:teuthology.orchestra.run.trial192.stdout:VERSION_ID="10.1"
2026-02-13T02:47:11.335 INFO:teuthology.orchestra.run.trial192.stdout:PLATFORM_ID="platform:el10"
2026-02-13T02:47:11.336 INFO:teuthology.orchestra.run.trial192.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T02:47:11.336 INFO:teuthology.orchestra.run.trial192.stdout:ANSI_COLOR="0;32"
2026-02-13T02:47:11.336 INFO:teuthology.orchestra.run.trial192.stdout:LOGO="fedora-logo-icon"
2026-02-13T02:47:11.336 INFO:teuthology.orchestra.run.trial192.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T02:47:11.336 INFO:teuthology.orchestra.run.trial192.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T02:47:11.336 INFO:teuthology.orchestra.run.trial192.stdout:VENDOR_NAME="RESF"
2026-02-13T02:47:11.336 INFO:teuthology.orchestra.run.trial192.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T02:47:11.336 INFO:teuthology.orchestra.run.trial192.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T02:47:11.336 INFO:teuthology.orchestra.run.trial192.stdout:SUPPORT_END="2035-05-31"
2026-02-13T02:47:11.336 INFO:teuthology.orchestra.run.trial192.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T02:47:11.336 INFO:teuthology.orchestra.run.trial192.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:47:11.336 INFO:teuthology.orchestra.run.trial192.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T02:47:11.337 INFO:teuthology.orchestra.run.trial192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:47:11.337 INFO:teuthology.lock.ops:Updating trial192.front.sepia.ceph.com on lock server
2026-02-13T02:47:11.441 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:47:11.544 INFO:teuthology.dispatcher.supervisor:Running job 48035
2026-02-13T02:47:11.544 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48035 --name pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/blogbench}} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48035/orig.config.yaml
2026-02-13T02:47:11.544 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48035
2026-02-13T02:47:11.544 INFO:teuthology.dispatcher.supervisor:Job PID: 1344449
2026-02-13T02:47:11.544 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-13T02:49:11.633 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:51:11.794 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:53:11.945 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:55:12.134 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:57:12.337 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:59:12.530 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T03:01:12.745 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T03:01:12.836 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-13T03:01:13.013 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-13T03:01:13.697 INFO:teuthology.orchestra.console.trial070:Power off
2026-02-13T03:01:13.697 DEBUG:teuthology.orchestra.console.trial070:pexpect command: ipmitool -H trial070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T03:01:13.753 DEBUG:teuthology.orchestra.console.trial070:power off output: Chassis Power Control: Down/Off
2026-02-13T03:01:13.763 INFO:teuthology.orchestra.console.trial192:Power off
2026-02-13T03:01:13.763 DEBUG:teuthology.orchestra.console.trial192:pexpect command: ipmitool -H trial192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T03:01:13.773 INFO:teuthology.orchestra.console.trial082:Power off
2026-02-13T03:01:13.773 DEBUG:teuthology.orchestra.console.trial082:pexpect command: ipmitool -H trial082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T03:01:13.804 DEBUG:teuthology.orchestra.console.trial192:power off output: Chassis Power Control: Down/Off
2026-02-13T03:01:13.814 DEBUG:teuthology.orchestra.console.trial082:power off output: Chassis Power Control: Down/Off
2026-02-13T03:01:17.758 DEBUG:teuthology.orchestra.console.trial070:pexpect command: ipmitool -H trial070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:01:17.804 DEBUG:teuthology.orchestra.console.trial192:pexpect command: ipmitool -H trial192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:01:17.815 DEBUG:teuthology.orchestra.console.trial082:pexpect command: ipmitool -H trial082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:01:17.867 DEBUG:teuthology.orchestra.console.trial070:check power output: Chassis Power is on
2026-02-13T03:01:17.915 DEBUG:teuthology.orchestra.console.trial192:check power output: Chassis Power is on
2026-02-13T03:01:17.923 DEBUG:teuthology.orchestra.console.trial082:check power output: Chassis Power is on
2026-02-13T03:01:21.873 DEBUG:teuthology.orchestra.console.trial070:pexpect command: ipmitool -H trial070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:01:21.915 DEBUG:teuthology.orchestra.console.trial192:pexpect command: ipmitool -H trial192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:01:21.924 DEBUG:teuthology.orchestra.console.trial082:pexpect command: ipmitool -H trial082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:01:21.983 DEBUG:teuthology.orchestra.console.trial070:check power output: Chassis Power is off
2026-02-13T03:01:21.984 INFO:teuthology.orchestra.console.trial070:Power off completed
2026-02-13T03:01:22.024 DEBUG:teuthology.orchestra.console.trial192:check power output: Chassis Power is off
2026-02-13T03:01:22.024 INFO:teuthology.orchestra.console.trial192:Power off completed
2026-02-13T03:01:22.034 DEBUG:teuthology.orchestra.console.trial082:check power output: Chassis Power is off
2026-02-13T03:01:22.034 INFO:teuthology.orchestra.console.trial082:Power off completed
2026-02-13T03:01:22.285 INFO:teuthology.lock.ops:unlocked: trial070.front.sepia.ceph.com
2026-02-13T03:01:22.295 INFO:teuthology.lock.ops:unlocked: trial192.front.sepia.ceph.com
2026-02-13T03:01:22.298 INFO:teuthology.lock.ops:unlocked: trial082.front.sepia.ceph.com