2026-02-13T02:00:25.488 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae
2026-02-13T02:00:25.488 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:00:25.567 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:00:25.759 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7463e31b6330>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7463e29fb2e0>, signals=[15])
2026-02-13T02:00:25.759 INFO:teuthology.lock.ops:Start node 'trial077.front.sepia.ceph.com' reimaging
2026-02-13T02:00:25.759 INFO:teuthology.lock.ops:Updating [trial077.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T02:00:25.759 INFO:teuthology.lock.ops:Updating trial077.front.sepia.ceph.com on lock server
2026-02-13T02:00:25.815 INFO:teuthology.lock.ops:Start node 'trial093.front.sepia.ceph.com' reimaging
2026-02-13T02:00:25.816 INFO:teuthology.lock.ops:Updating [trial093.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T02:00:25.816 INFO:teuthology.lock.ops:Updating trial093.front.sepia.ceph.com on lock server
2026-02-13T02:00:26.040 DEBUG:teuthology.provision.fog.trial077:Requesting image trial_rocky_10.1 (ID 4)
2026-02-13T02:00:26.054 DEBUG:teuthology.provision.fog.trial093:Requesting image trial_rocky_10.1 (ID 4)
2026-02-13T02:00:26.093 INFO:teuthology.provision.fog.trial077:Scheduling deploy of rocky 10.1
2026-02-13T02:00:26.106 INFO:teuthology.provision.fog.trial093:Scheduling deploy of rocky 10.1
2026-02-13T02:00:27.319 INFO:teuthology.orchestra.console.trial093:Power off
2026-02-13T02:00:27.319 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T02:00:27.328 INFO:teuthology.orchestra.console.trial077:Power off
2026-02-13T02:00:27.328 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T02:00:27.356 DEBUG:teuthology.orchestra.console.trial093:power off output: Chassis Power Control: Down/Off
2026-02-13T02:00:27.365 DEBUG:teuthology.orchestra.console.trial077:power off output: Chassis Power Control: Down/Off
2026-02-13T02:00:31.361 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:00:31.368 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:00:31.471 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is off
2026-02-13T02:00:31.471 INFO:teuthology.orchestra.console.trial093:Power off completed
2026-02-13T02:00:31.477 DEBUG:teuthology.orchestra.console.trial077:check power output: Chassis Power is off
2026-02-13T02:00:31.477 INFO:teuthology.orchestra.console.trial077:Power off completed
2026-02-13T02:00:31.572 INFO:teuthology.orchestra.console.trial093:Power on
2026-02-13T02:00:31.573 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T02:00:31.582 INFO:teuthology.orchestra.console.trial077:Power on
2026-02-13T02:00:31.582 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T02:00:31.612 DEBUG:teuthology.orchestra.console.trial093:power on output: Chassis Power Control: Up/On
2026-02-13T02:00:31.620 DEBUG:teuthology.orchestra.console.trial077:power on output: Chassis Power Control: Up/On
2026-02-13T02:00:35.616 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:00:35.624 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:00:35.727 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is on
2026-02-13T02:00:35.728 INFO:teuthology.orchestra.console.trial093:Power on completed
2026-02-13T02:00:35.733 DEBUG:teuthology.orchestra.console.trial077:check power output: Chassis Power is on
2026-02-13T02:00:35.733 INFO:teuthology.orchestra.console.trial077:Power on completed
2026-02-13T02:00:35.829 INFO:teuthology.provision.fog.trial093:Waiting for deploy to finish
2026-02-13T02:00:35.835 INFO:teuthology.provision.fog.trial077:Waiting for deploy to finish
2026-02-13T02:02:23.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:02:23.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:02:37.661 WARNING:teuthology.provision.fog.trial077:[Errno None] Unable to connect to port 22 on 10.20.193.77
2026-02-13T02:02:37.661 WARNING:teuthology.provision.fog.trial093:[Errno None] Unable to connect to port 22 on 10.20.193.93
2026-02-13T02:02:43.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:02:43.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:02:46.749 WARNING:teuthology.provision.fog.trial077:[Errno None] Unable to connect to port 22 on 10.20.193.77
2026-02-13T02:02:46.749 WARNING:teuthology.provision.fog.trial093:[Errno None] Unable to connect to port 22 on 10.20.193.93
2026-02-13T02:02:52.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:02:52.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:02:55.838 WARNING:teuthology.provision.fog.trial077:[Errno None] Unable to connect to port 22 on 10.20.193.77
2026-02-13T02:02:55.838 WARNING:teuthology.provision.fog.trial093:[Errno None] Unable to connect to port 22 on 10.20.193.93
2026-02-13T02:03:01.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:03:01.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:03:37.673 ERROR:teuthology.orchestra.connection:Error authenticating with trial093.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T02:03:37.691 ERROR:teuthology.orchestra.connection:Error authenticating with trial077.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T02:03:41.809 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T02:03:41.809 DEBUG:teuthology.orchestra.run.trial093:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T02:03:41.821 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T02:03:41.821 DEBUG:teuthology.orchestra.run.trial077:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T02:03:41.931 INFO:teuthology.provision.fog.trial093:Node is ready
2026-02-13T02:03:41.931 DEBUG:teuthology.orchestra.run.trial093:> hostname
2026-02-13T02:03:41.988 INFO:teuthology.orchestra.run.trial093.stdout:trial093.front.sepia.ceph.com
2026-02-13T02:03:41.988 DEBUG:teuthology.orchestra.run.trial093:> grep trial093.front.sepia.ceph.com /etc/hosts
2026-02-13T02:03:42.046 INFO:teuthology.orchestra.run.trial093.stdout:10.20.193.93 trial093.front.sepia.ceph.com trial093
2026-02-13T02:03:42.046 DEBUG:teuthology.orchestra.run.trial093:> sudo hostname trial093
2026-02-13T02:03:42.120 DEBUG:teuthology.orchestra.run.trial093:> sudo sed -i -e 's/trial093.front.sepia.ceph.com/trial093/g' /etc/hosts
2026-02-13T02:03:42.189 DEBUG:teuthology.orchestra.run.trial093:> sudo sed -i -e 's/10.20.193.93/10.20.193.93/g' /etc/hosts
2026-02-13T02:03:42.258 DEBUG:teuthology.orchestra.run.trial093:> sudo sed -i -e 's/trial093.front.sepia.ceph.com/trial093/g' /etc/hostname
2026-02-13T02:03:42.326 DEBUG:teuthology.orchestra.run.trial093:> sudo hostname trial093
2026-02-13T02:03:42.392 DEBUG:teuthology.orchestra.run.trial093:> cat /etc/os-release
2026-02-13T02:03:42.450 INFO:teuthology.orchestra.run.trial093.stdout:NAME="Rocky Linux"
2026-02-13T02:03:42.450 INFO:teuthology.orchestra.run.trial093.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T02:03:42.451 INFO:teuthology.orchestra.run.trial093.stdout:ID="rocky"
2026-02-13T02:03:42.451 INFO:teuthology.orchestra.run.trial093.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T02:03:42.451 INFO:teuthology.orchestra.run.trial093.stdout:VERSION_ID="10.1"
2026-02-13T02:03:42.451 INFO:teuthology.orchestra.run.trial093.stdout:PLATFORM_ID="platform:el10"
2026-02-13T02:03:42.451 INFO:teuthology.orchestra.run.trial093.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T02:03:42.451 INFO:teuthology.orchestra.run.trial093.stdout:ANSI_COLOR="0;32"
2026-02-13T02:03:42.451 INFO:teuthology.orchestra.run.trial093.stdout:LOGO="fedora-logo-icon"
2026-02-13T02:03:42.451 INFO:teuthology.orchestra.run.trial093.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T02:03:42.451 INFO:teuthology.orchestra.run.trial093.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T02:03:42.451 INFO:teuthology.orchestra.run.trial093.stdout:VENDOR_NAME="RESF"
2026-02-13T02:03:42.452 INFO:teuthology.orchestra.run.trial093.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T02:03:42.452 INFO:teuthology.orchestra.run.trial093.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T02:03:42.452 INFO:teuthology.orchestra.run.trial093.stdout:SUPPORT_END="2035-05-31"
2026-02-13T02:03:42.452 INFO:teuthology.orchestra.run.trial093.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T02:03:42.452 INFO:teuthology.orchestra.run.trial093.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:03:42.452 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T02:03:42.452 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:03:42.453 INFO:teuthology.provision.fog.trial093:Deploy complete!
2026-02-13T02:03:42.453 DEBUG:teuthology.parallel:result is None
2026-02-13T02:03:47.018 INFO:teuthology.provision.fog.trial077:Node is ready
2026-02-13T02:03:47.018 DEBUG:teuthology.orchestra.run.trial077:> hostname
2026-02-13T02:03:47.036 INFO:teuthology.orchestra.run.trial077.stdout:trial077.front.sepia.ceph.com
2026-02-13T02:03:47.036 DEBUG:teuthology.orchestra.run.trial077:> grep trial077.front.sepia.ceph.com /etc/hosts
2026-02-13T02:03:47.093 INFO:teuthology.orchestra.run.trial077.stdout:10.20.193.77 trial077.front.sepia.ceph.com trial077
2026-02-13T02:03:47.094 DEBUG:teuthology.orchestra.run.trial077:> sudo hostname trial077
2026-02-13T02:03:47.166 DEBUG:teuthology.orchestra.run.trial077:> sudo sed -i -e 's/trial077.front.sepia.ceph.com/trial077/g' /etc/hosts
2026-02-13T02:03:47.234 DEBUG:teuthology.orchestra.run.trial077:> sudo sed -i -e 's/10.20.193.77/10.20.193.77/g' /etc/hosts
2026-02-13T02:03:47.302 DEBUG:teuthology.orchestra.run.trial077:> sudo sed -i -e 's/trial077.front.sepia.ceph.com/trial077/g' /etc/hostname
2026-02-13T02:03:47.369 DEBUG:teuthology.orchestra.run.trial077:> sudo hostname trial077
2026-02-13T02:03:47.435 DEBUG:teuthology.orchestra.run.trial077:> cat /etc/os-release
2026-02-13T02:03:47.492 INFO:teuthology.orchestra.run.trial077.stdout:NAME="Rocky Linux"
2026-02-13T02:03:47.492 INFO:teuthology.orchestra.run.trial077.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T02:03:47.492 INFO:teuthology.orchestra.run.trial077.stdout:ID="rocky"
2026-02-13T02:03:47.492 INFO:teuthology.orchestra.run.trial077.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T02:03:47.493 INFO:teuthology.orchestra.run.trial077.stdout:VERSION_ID="10.1"
2026-02-13T02:03:47.493 INFO:teuthology.orchestra.run.trial077.stdout:PLATFORM_ID="platform:el10"
2026-02-13T02:03:47.493 INFO:teuthology.orchestra.run.trial077.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T02:03:47.493 INFO:teuthology.orchestra.run.trial077.stdout:ANSI_COLOR="0;32"
2026-02-13T02:03:47.493 INFO:teuthology.orchestra.run.trial077.stdout:LOGO="fedora-logo-icon"
2026-02-13T02:03:47.493 INFO:teuthology.orchestra.run.trial077.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T02:03:47.493 INFO:teuthology.orchestra.run.trial077.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T02:03:47.493 INFO:teuthology.orchestra.run.trial077.stdout:VENDOR_NAME="RESF"
2026-02-13T02:03:47.493 INFO:teuthology.orchestra.run.trial077.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T02:03:47.493 INFO:teuthology.orchestra.run.trial077.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T02:03:47.493 INFO:teuthology.orchestra.run.trial077.stdout:SUPPORT_END="2035-05-31"
2026-02-13T02:03:47.494 INFO:teuthology.orchestra.run.trial077.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T02:03:47.494 INFO:teuthology.orchestra.run.trial077.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:03:47.494 INFO:teuthology.orchestra.run.trial077.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T02:03:47.494 INFO:teuthology.orchestra.run.trial077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:03:47.494 INFO:teuthology.provision.fog.trial077:Deploy complete!
2026-02-13T02:03:47.494 DEBUG:teuthology.parallel:result is None
2026-02-13T02:03:47.912 INFO:teuthology.lock.ops:Checking trial077.front.sepia.ceph.com
2026-02-13T02:03:47.913 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T02:03:48.019 INFO:teuthology.lock.ops:Checking trial093.front.sepia.ceph.com
2026-02-13T02:03:48.019 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T02:03:48.083 INFO:teuthology.lock.ops:Updating [trial077.front.sepia.ceph.com]: set os type and version on server
2026-02-13T02:03:48.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial077.front.sepia.ceph.com'
2026-02-13T02:03:48.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:03:48.144 DEBUG:teuthology.orchestra.run.trial077:> true
2026-02-13T02:03:48.219 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial077.front.sepia.ceph.com'
2026-02-13T02:03:48.219 DEBUG:teuthology.orchestra.run.trial077:> uname -m
2026-02-13T02:03:48.276 INFO:teuthology.orchestra.run.trial077.stdout:x86_64
2026-02-13T02:03:48.276 DEBUG:teuthology.orchestra.run.trial077:> cat /etc/os-release
2026-02-13T02:03:48.333 INFO:teuthology.orchestra.run.trial077.stdout:NAME="Rocky Linux"
2026-02-13T02:03:48.334 INFO:teuthology.orchestra.run.trial077.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T02:03:48.334 INFO:teuthology.orchestra.run.trial077.stdout:ID="rocky"
2026-02-13T02:03:48.334 INFO:teuthology.orchestra.run.trial077.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T02:03:48.334 INFO:teuthology.orchestra.run.trial077.stdout:VERSION_ID="10.1"
2026-02-13T02:03:48.334 INFO:teuthology.orchestra.run.trial077.stdout:PLATFORM_ID="platform:el10"
2026-02-13T02:03:48.334 INFO:teuthology.orchestra.run.trial077.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T02:03:48.334 INFO:teuthology.orchestra.run.trial077.stdout:ANSI_COLOR="0;32"
2026-02-13T02:03:48.334 INFO:teuthology.orchestra.run.trial077.stdout:LOGO="fedora-logo-icon"
2026-02-13T02:03:48.334 INFO:teuthology.orchestra.run.trial077.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T02:03:48.334 INFO:teuthology.orchestra.run.trial077.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T02:03:48.334 INFO:teuthology.orchestra.run.trial077.stdout:VENDOR_NAME="RESF"
2026-02-13T02:03:48.334 INFO:teuthology.orchestra.run.trial077.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T02:03:48.335 INFO:teuthology.orchestra.run.trial077.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T02:03:48.335 INFO:teuthology.orchestra.run.trial077.stdout:SUPPORT_END="2035-05-31"
2026-02-13T02:03:48.335 INFO:teuthology.orchestra.run.trial077.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T02:03:48.335 INFO:teuthology.orchestra.run.trial077.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:03:48.335 INFO:teuthology.orchestra.run.trial077.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T02:03:48.335 INFO:teuthology.orchestra.run.trial077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:03:48.335 INFO:teuthology.lock.ops:Updating trial077.front.sepia.ceph.com on lock server
2026-02-13T02:03:48.437 INFO:teuthology.lock.ops:Updating [trial093.front.sepia.ceph.com]: set os type and version on server
2026-02-13T02:03:48.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial093.front.sepia.ceph.com'
2026-02-13T02:03:48.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:03:48.506 DEBUG:teuthology.orchestra.run.trial093:> true
2026-02-13T02:03:48.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial093.front.sepia.ceph.com'
2026-02-13T02:03:48.578 DEBUG:teuthology.orchestra.run.trial093:> uname -m
2026-02-13T02:03:48.635 INFO:teuthology.orchestra.run.trial093.stdout:x86_64
2026-02-13T02:03:48.635 DEBUG:teuthology.orchestra.run.trial093:> cat /etc/os-release
2026-02-13T02:03:48.694 INFO:teuthology.orchestra.run.trial093.stdout:NAME="Rocky Linux"
2026-02-13T02:03:48.694 INFO:teuthology.orchestra.run.trial093.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T02:03:48.694 INFO:teuthology.orchestra.run.trial093.stdout:ID="rocky"
2026-02-13T02:03:48.694 INFO:teuthology.orchestra.run.trial093.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T02:03:48.694 INFO:teuthology.orchestra.run.trial093.stdout:VERSION_ID="10.1"
2026-02-13T02:03:48.694 INFO:teuthology.orchestra.run.trial093.stdout:PLATFORM_ID="platform:el10"
2026-02-13T02:03:48.694 INFO:teuthology.orchestra.run.trial093.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T02:03:48.694 INFO:teuthology.orchestra.run.trial093.stdout:ANSI_COLOR="0;32"
2026-02-13T02:03:48.695 INFO:teuthology.orchestra.run.trial093.stdout:LOGO="fedora-logo-icon"
2026-02-13T02:03:48.695 INFO:teuthology.orchestra.run.trial093.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T02:03:48.695 INFO:teuthology.orchestra.run.trial093.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T02:03:48.695 INFO:teuthology.orchestra.run.trial093.stdout:VENDOR_NAME="RESF"
2026-02-13T02:03:48.695 INFO:teuthology.orchestra.run.trial093.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T02:03:48.695 INFO:teuthology.orchestra.run.trial093.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T02:03:48.695 INFO:teuthology.orchestra.run.trial093.stdout:SUPPORT_END="2035-05-31"
2026-02-13T02:03:48.695 INFO:teuthology.orchestra.run.trial093.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T02:03:48.695 INFO:teuthology.orchestra.run.trial093.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:03:48.695 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T02:03:48.695 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:03:48.696 INFO:teuthology.lock.ops:Updating trial093.front.sepia.ceph.com on lock server
2026-02-13T02:03:48.799 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:03:48.902 INFO:teuthology.dispatcher.supervisor:Running job 47960
2026-02-13T02:03:48.902 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47960 --name pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/iozone}} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47960/orig.config.yaml
2026-02-13T02:03:48.903 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47960
2026-02-13T02:03:48.903 INFO:teuthology.dispatcher.supervisor:Job PID: 1222514
2026-02-13T02:03:48.903 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-13T02:05:48.916 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:07:49.097 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:09:49.294 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:11:49.515 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:11:49.616 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-13T02:11:49.746 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-13T02:11:50.256 INFO:teuthology.orchestra.console.trial093:Power off
2026-02-13T02:11:50.256 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T02:11:50.265 INFO:teuthology.orchestra.console.trial077:Power off
2026-02-13T02:11:50.265 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T02:11:50.296 DEBUG:teuthology.orchestra.console.trial093:power off output: Chassis Power Control: Down/Off
2026-02-13T02:11:50.304 DEBUG:teuthology.orchestra.console.trial077:power off output: Chassis Power Control: Down/Off
2026-02-13T02:11:54.301 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:11:54.308 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:11:54.410 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is on
2026-02-13T02:11:54.416 DEBUG:teuthology.orchestra.console.trial077:check power output: Chassis Power is on
2026-02-13T02:11:58.415 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:11:58.422 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:11:58.524 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is off
2026-02-13T02:11:58.525 INFO:teuthology.orchestra.console.trial093:Power off completed
2026-02-13T02:11:58.532 DEBUG:teuthology.orchestra.console.trial077:check power output: Chassis Power is off
2026-02-13T02:11:58.532 INFO:teuthology.orchestra.console.trial077:Power off completed
2026-02-13T02:11:58.767 INFO:teuthology.lock.ops:unlocked: trial093.front.sepia.ceph.com
2026-02-13T02:11:58.780 INFO:teuthology.lock.ops:unlocked: trial077.front.sepia.ceph.com