2026-02-12T21:49:36.238 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473
2026-02-12T21:49:36.238 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T21:49:36.312 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T21:49:36.507 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x778a5fbe5880>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x778a5f182f20>, signals=[15])
2026-02-12T21:49:36.507 INFO:teuthology.lock.ops:Start node 'trial004.front.sepia.ceph.com' reimaging
2026-02-12T21:49:36.507 INFO:teuthology.lock.ops:Updating [trial004.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T21:49:36.508 INFO:teuthology.lock.ops:Updating trial004.front.sepia.ceph.com on lock server
2026-02-12T21:49:36.564 INFO:teuthology.lock.ops:Start node 'trial176.front.sepia.ceph.com' reimaging
2026-02-12T21:49:36.564 INFO:teuthology.lock.ops:Updating [trial176.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T21:49:36.564 INFO:teuthology.lock.ops:Updating trial176.front.sepia.ceph.com on lock server
2026-02-12T21:49:36.797 DEBUG:teuthology.provision.fog.trial004:Requesting image trial_rocky_10.1 (ID 4)
2026-02-12T21:49:36.810 DEBUG:teuthology.provision.fog.trial176:Requesting image trial_rocky_10.1 (ID 4)
2026-02-12T21:49:36.850 INFO:teuthology.provision.fog.trial004:Scheduling deploy of rocky 10.1
2026-02-12T21:49:36.864 INFO:teuthology.provision.fog.trial176:Scheduling deploy of rocky 10.1
2026-02-12T21:49:37.918 INFO:teuthology.orchestra.console.trial004:Power off
2026-02-12T21:49:37.918 DEBUG:teuthology.orchestra.console.trial004:pexpect command: ipmitool -H trial004.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T21:49:37.937 INFO:teuthology.orchestra.console.trial176:Power off
2026-02-12T21:49:37.937 DEBUG:teuthology.orchestra.console.trial176:pexpect command: ipmitool -H trial176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T21:49:37.957 DEBUG:teuthology.orchestra.console.trial004:power off output: Chassis Power Control: Down/Off
2026-02-12T21:49:37.975 DEBUG:teuthology.orchestra.console.trial176:power off output: Chassis Power Control: Down/Off
2026-02-12T21:49:41.962 DEBUG:teuthology.orchestra.console.trial004:pexpect command: ipmitool -H trial004.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T21:49:41.976 DEBUG:teuthology.orchestra.console.trial176:pexpect command: ipmitool -H trial176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T21:49:42.071 DEBUG:teuthology.orchestra.console.trial004:check power output: Chassis Power is off
2026-02-12T21:49:42.071 INFO:teuthology.orchestra.console.trial004:Power off completed
2026-02-12T21:49:42.083 DEBUG:teuthology.orchestra.console.trial176:check power output: Chassis Power is off
2026-02-12T21:49:42.083 INFO:teuthology.orchestra.console.trial176:Power off completed
2026-02-12T21:49:42.172 INFO:teuthology.orchestra.console.trial004:Power on
2026-02-12T21:49:42.173 DEBUG:teuthology.orchestra.console.trial004:pexpect command: ipmitool -H trial004.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T21:49:42.184 INFO:teuthology.orchestra.console.trial176:Power on
2026-02-12T21:49:42.184 DEBUG:teuthology.orchestra.console.trial176:pexpect command: ipmitool -H trial176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T21:49:42.212 DEBUG:teuthology.orchestra.console.trial004:power on output: Chassis Power Control: Up/On
2026-02-12T21:49:42.223 DEBUG:teuthology.orchestra.console.trial176:power on output: Chassis Power Control: Up/On
2026-02-12T21:49:46.218 DEBUG:teuthology.orchestra.console.trial004:pexpect command: ipmitool -H trial004.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T21:49:46.227 DEBUG:teuthology.orchestra.console.trial176:pexpect command: ipmitool -H trial176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T21:49:46.329 DEBUG:teuthology.orchestra.console.trial004:check power output: Chassis Power is on
2026-02-12T21:49:46.329 INFO:teuthology.orchestra.console.trial004:Power on completed
2026-02-12T21:49:46.336 DEBUG:teuthology.orchestra.console.trial176:check power output: Chassis Power is on
2026-02-12T21:49:46.336 INFO:teuthology.orchestra.console.trial176:Power on completed
2026-02-12T21:49:46.430 INFO:teuthology.provision.fog.trial004:Waiting for deploy to finish
2026-02-12T21:49:46.437 INFO:teuthology.provision.fog.trial176:Waiting for deploy to finish
2026-02-12T21:51:33.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:51:36.989 WARNING:teuthology.provision.fog.trial176:[Errno None] Unable to connect to port 22 on 10.20.193.176
2026-02-12T21:51:42.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:51:46.077 WARNING:teuthology.provision.fog.trial176:[Errno None] Unable to connect to port 22 on 10.20.193.176
2026-02-12T21:51:52.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:51:55.165 WARNING:teuthology.provision.fog.trial176:[Errno None] Unable to connect to port 22 on 10.20.193.176
2026-02-12T21:52:01.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:52:04.253 WARNING:teuthology.provision.fog.trial176:[Errno None] Unable to connect to port 22 on 10.20.193.176
2026-02-12T21:52:04.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:52:07.517 WARNING:teuthology.provision.fog.trial004:[Errno None] Unable to connect to port 22 on 10.20.193.4
2026-02-12T21:52:10.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:52:13.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:52:16.605 WARNING:teuthology.provision.fog.trial004:[Errno None] Unable to connect to port 22 on 10.20.193.4
2026-02-12T21:52:22.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:52:25.693 WARNING:teuthology.provision.fog.trial004:[Errno None] Unable to connect to port 22 on 10.20.193.4
2026-02-12T21:52:31.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:52:34.781 WARNING:teuthology.provision.fog.trial004:[Errno None] Unable to connect to port 22 on 10.20.193.4
2026-02-12T21:52:40.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:52:46.376 ERROR:teuthology.orchestra.connection:Error authenticating with trial176.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-12T21:52:50.485 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T21:52:50.485 DEBUG:teuthology.orchestra.run.trial176:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T21:52:55.685 INFO:teuthology.provision.fog.trial176:Node is ready
2026-02-12T21:52:55.686 DEBUG:teuthology.orchestra.run.trial176:> hostname
2026-02-12T21:52:55.743 INFO:teuthology.orchestra.run.trial176.stdout:trial176.front.sepia.ceph.com
2026-02-12T21:52:55.743 DEBUG:teuthology.orchestra.run.trial176:> grep trial176.front.sepia.ceph.com /etc/hosts
2026-02-12T21:52:55.801 INFO:teuthology.orchestra.run.trial176.stdout:10.20.193.176 trial176.front.sepia.ceph.com trial176
2026-02-12T21:52:55.801 DEBUG:teuthology.orchestra.run.trial176:> sudo hostname trial176
2026-02-12T21:52:55.874 DEBUG:teuthology.orchestra.run.trial176:> sudo sed -i -e 's/trial176.front.sepia.ceph.com/trial176/g' /etc/hosts
2026-02-12T21:52:55.941 DEBUG:teuthology.orchestra.run.trial176:> sudo sed -i -e 's/10.20.193.176/10.20.193.176/g' /etc/hosts
2026-02-12T21:52:56.008 DEBUG:teuthology.orchestra.run.trial176:> sudo sed -i -e 's/trial176.front.sepia.ceph.com/trial176/g' /etc/hostname
2026-02-12T21:52:56.077 DEBUG:teuthology.orchestra.run.trial176:> sudo hostname trial176
2026-02-12T21:52:56.143 DEBUG:teuthology.orchestra.run.trial176:> cat /etc/os-release
2026-02-12T21:52:56.201 INFO:teuthology.orchestra.run.trial176.stdout:NAME="Rocky Linux"
2026-02-12T21:52:56.201 INFO:teuthology.orchestra.run.trial176.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T21:52:56.201 INFO:teuthology.orchestra.run.trial176.stdout:ID="rocky"
2026-02-12T21:52:56.201 INFO:teuthology.orchestra.run.trial176.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T21:52:56.201 INFO:teuthology.orchestra.run.trial176.stdout:VERSION_ID="10.1"
2026-02-12T21:52:56.201 INFO:teuthology.orchestra.run.trial176.stdout:PLATFORM_ID="platform:el10"
2026-02-12T21:52:56.201 INFO:teuthology.orchestra.run.trial176.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T21:52:56.202 INFO:teuthology.orchestra.run.trial176.stdout:ANSI_COLOR="0;32"
2026-02-12T21:52:56.202 INFO:teuthology.orchestra.run.trial176.stdout:LOGO="fedora-logo-icon"
2026-02-12T21:52:56.202 INFO:teuthology.orchestra.run.trial176.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T21:52:56.202 INFO:teuthology.orchestra.run.trial176.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T21:52:56.202 INFO:teuthology.orchestra.run.trial176.stdout:VENDOR_NAME="RESF"
2026-02-12T21:52:56.202 INFO:teuthology.orchestra.run.trial176.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T21:52:56.202 INFO:teuthology.orchestra.run.trial176.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T21:52:56.202 INFO:teuthology.orchestra.run.trial176.stdout:SUPPORT_END="2035-05-31"
2026-02-12T21:52:56.202 INFO:teuthology.orchestra.run.trial176.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T21:52:56.202 INFO:teuthology.orchestra.run.trial176.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T21:52:56.202 INFO:teuthology.orchestra.run.trial176.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T21:52:56.202 INFO:teuthology.orchestra.run.trial176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T21:52:56.203 INFO:teuthology.provision.fog.trial176:Deploy complete!
2026-02-12T21:52:56.204 DEBUG:teuthology.parallel:result is None
2026-02-12T21:53:16.579 ERROR:teuthology.orchestra.connection:Error authenticating with trial004.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-12T21:53:20.692 ERROR:teuthology.orchestra.connection:Error authenticating with trial004.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-12T21:53:27.804 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T21:53:27.804 DEBUG:teuthology.orchestra.run.trial004:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T21:53:27.984 INFO:teuthology.provision.fog.trial004:Node is ready
2026-02-12T21:53:27.984 DEBUG:teuthology.orchestra.run.trial004:> hostname
2026-02-12T21:53:28.041 INFO:teuthology.orchestra.run.trial004.stdout:trial004.front.sepia.ceph.com
2026-02-12T21:53:28.042 DEBUG:teuthology.orchestra.run.trial004:> grep trial004.front.sepia.ceph.com /etc/hosts
2026-02-12T21:53:28.099 INFO:teuthology.orchestra.run.trial004.stdout:10.20.193.4 trial004.front.sepia.ceph.com trial004
2026-02-12T21:53:28.100 DEBUG:teuthology.orchestra.run.trial004:> sudo hostname trial004
2026-02-12T21:53:28.172 DEBUG:teuthology.orchestra.run.trial004:> sudo sed -i -e 's/trial004.front.sepia.ceph.com/trial004/g' /etc/hosts
2026-02-12T21:53:28.240 DEBUG:teuthology.orchestra.run.trial004:> sudo sed -i -e 's/10.20.193.4/10.20.193.4/g' /etc/hosts
2026-02-12T21:53:28.308 DEBUG:teuthology.orchestra.run.trial004:> sudo sed -i -e 's/trial004.front.sepia.ceph.com/trial004/g' /etc/hostname
2026-02-12T21:53:28.373 DEBUG:teuthology.orchestra.run.trial004:> sudo hostname trial004
2026-02-12T21:53:28.440 DEBUG:teuthology.orchestra.run.trial004:> cat /etc/os-release
2026-02-12T21:53:28.496 INFO:teuthology.orchestra.run.trial004.stdout:NAME="Rocky Linux"
2026-02-12T21:53:28.497 INFO:teuthology.orchestra.run.trial004.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T21:53:28.497 INFO:teuthology.orchestra.run.trial004.stdout:ID="rocky"
2026-02-12T21:53:28.497 INFO:teuthology.orchestra.run.trial004.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T21:53:28.497 INFO:teuthology.orchestra.run.trial004.stdout:VERSION_ID="10.1"
2026-02-12T21:53:28.497 INFO:teuthology.orchestra.run.trial004.stdout:PLATFORM_ID="platform:el10"
2026-02-12T21:53:28.497 INFO:teuthology.orchestra.run.trial004.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T21:53:28.497 INFO:teuthology.orchestra.run.trial004.stdout:ANSI_COLOR="0;32"
2026-02-12T21:53:28.497 INFO:teuthology.orchestra.run.trial004.stdout:LOGO="fedora-logo-icon"
2026-02-12T21:53:28.497 INFO:teuthology.orchestra.run.trial004.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T21:53:28.497 INFO:teuthology.orchestra.run.trial004.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T21:53:28.497 INFO:teuthology.orchestra.run.trial004.stdout:VENDOR_NAME="RESF"
2026-02-12T21:53:28.498 INFO:teuthology.orchestra.run.trial004.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T21:53:28.498 INFO:teuthology.orchestra.run.trial004.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T21:53:28.498 INFO:teuthology.orchestra.run.trial004.stdout:SUPPORT_END="2035-05-31"
2026-02-12T21:53:28.498 INFO:teuthology.orchestra.run.trial004.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T21:53:28.498 INFO:teuthology.orchestra.run.trial004.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T21:53:28.498 INFO:teuthology.orchestra.run.trial004.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T21:53:28.498 INFO:teuthology.orchestra.run.trial004.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T21:53:28.498 INFO:teuthology.provision.fog.trial004:Deploy complete!
2026-02-12T21:53:28.499 DEBUG:teuthology.parallel:result is None
2026-02-12T21:53:28.892 INFO:teuthology.lock.ops:Checking trial004.front.sepia.ceph.com
2026-02-12T21:53:28.892 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T21:53:28.989 INFO:teuthology.lock.ops:Checking trial176.front.sepia.ceph.com
2026-02-12T21:53:28.989 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T21:53:29.051 INFO:teuthology.lock.ops:Updating [trial004.front.sepia.ceph.com]: set os type and version on server
2026-02-12T21:53:29.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial004.front.sepia.ceph.com'
2026-02-12T21:53:29.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:53:29.113 DEBUG:teuthology.orchestra.run.trial004:> true
2026-02-12T21:53:29.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial004.front.sepia.ceph.com'
2026-02-12T21:53:29.186 DEBUG:teuthology.orchestra.run.trial004:> uname -m
2026-02-12T21:53:29.243 INFO:teuthology.orchestra.run.trial004.stdout:x86_64
2026-02-12T21:53:29.244 DEBUG:teuthology.orchestra.run.trial004:> cat /etc/os-release
2026-02-12T21:53:29.301 INFO:teuthology.orchestra.run.trial004.stdout:NAME="Rocky Linux"
2026-02-12T21:53:29.301 INFO:teuthology.orchestra.run.trial004.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T21:53:29.301 INFO:teuthology.orchestra.run.trial004.stdout:ID="rocky"
2026-02-12T21:53:29.301 INFO:teuthology.orchestra.run.trial004.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T21:53:29.301 INFO:teuthology.orchestra.run.trial004.stdout:VERSION_ID="10.1"
2026-02-12T21:53:29.301 INFO:teuthology.orchestra.run.trial004.stdout:PLATFORM_ID="platform:el10"
2026-02-12T21:53:29.302 INFO:teuthology.orchestra.run.trial004.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T21:53:29.302 INFO:teuthology.orchestra.run.trial004.stdout:ANSI_COLOR="0;32"
2026-02-12T21:53:29.302 INFO:teuthology.orchestra.run.trial004.stdout:LOGO="fedora-logo-icon"
2026-02-12T21:53:29.302 INFO:teuthology.orchestra.run.trial004.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T21:53:29.302 INFO:teuthology.orchestra.run.trial004.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T21:53:29.302 INFO:teuthology.orchestra.run.trial004.stdout:VENDOR_NAME="RESF"
2026-02-12T21:53:29.302 INFO:teuthology.orchestra.run.trial004.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T21:53:29.302 INFO:teuthology.orchestra.run.trial004.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T21:53:29.302 INFO:teuthology.orchestra.run.trial004.stdout:SUPPORT_END="2035-05-31"
2026-02-12T21:53:29.302 INFO:teuthology.orchestra.run.trial004.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T21:53:29.302 INFO:teuthology.orchestra.run.trial004.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T21:53:29.302 INFO:teuthology.orchestra.run.trial004.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T21:53:29.303 INFO:teuthology.orchestra.run.trial004.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T21:53:29.303 INFO:teuthology.lock.ops:Updating trial004.front.sepia.ceph.com on lock server
2026-02-12T21:53:29.405 INFO:teuthology.lock.ops:Updating [trial176.front.sepia.ceph.com]: set os type and version on server
2026-02-12T21:53:29.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial176.front.sepia.ceph.com'
2026-02-12T21:53:29.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:53:29.478 DEBUG:teuthology.orchestra.run.trial176:> true
2026-02-12T21:53:29.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial176.front.sepia.ceph.com'
2026-02-12T21:53:29.565 DEBUG:teuthology.orchestra.run.trial176:> uname -m
2026-02-12T21:53:29.621 INFO:teuthology.orchestra.run.trial176.stdout:x86_64
2026-02-12T21:53:29.622 DEBUG:teuthology.orchestra.run.trial176:> cat /etc/os-release
2026-02-12T21:53:29.678 INFO:teuthology.orchestra.run.trial176.stdout:NAME="Rocky Linux"
2026-02-12T21:53:29.678 INFO:teuthology.orchestra.run.trial176.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T21:53:29.678 INFO:teuthology.orchestra.run.trial176.stdout:ID="rocky"
2026-02-12T21:53:29.678 INFO:teuthology.orchestra.run.trial176.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T21:53:29.678 INFO:teuthology.orchestra.run.trial176.stdout:VERSION_ID="10.1"
2026-02-12T21:53:29.678 INFO:teuthology.orchestra.run.trial176.stdout:PLATFORM_ID="platform:el10"
2026-02-12T21:53:29.678 INFO:teuthology.orchestra.run.trial176.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T21:53:29.678 INFO:teuthology.orchestra.run.trial176.stdout:ANSI_COLOR="0;32"
2026-02-12T21:53:29.678 INFO:teuthology.orchestra.run.trial176.stdout:LOGO="fedora-logo-icon"
2026-02-12T21:53:29.678 INFO:teuthology.orchestra.run.trial176.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T21:53:29.678 INFO:teuthology.orchestra.run.trial176.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T21:53:29.678 INFO:teuthology.orchestra.run.trial176.stdout:VENDOR_NAME="RESF"
2026-02-12T21:53:29.678 INFO:teuthology.orchestra.run.trial176.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T21:53:29.678 INFO:teuthology.orchestra.run.trial176.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T21:53:29.678 INFO:teuthology.orchestra.run.trial176.stdout:SUPPORT_END="2035-05-31"
2026-02-12T21:53:29.678 INFO:teuthology.orchestra.run.trial176.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T21:53:29.678 INFO:teuthology.orchestra.run.trial176.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T21:53:29.679 INFO:teuthology.orchestra.run.trial176.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T21:53:29.679 INFO:teuthology.orchestra.run.trial176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T21:53:29.679 INFO:teuthology.lock.ops:Updating trial176.front.sepia.ceph.com on lock server
2026-02-12T21:53:29.746 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T21:53:29.836 INFO:teuthology.dispatcher.supervisor:Running job 47080
2026-02-12T21:53:29.836 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47080 --name pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health} tasks/failover} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47080/orig.config.yaml
2026-02-12T21:53:29.837 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47080
2026-02-12T21:53:29.837 INFO:teuthology.dispatcher.supervisor:Job PID: 815197
2026-02-12T21:53:29.837 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T21:55:29.937 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T21:57:30.132 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T21:59:30.303 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:01:30.498 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:01:30.585 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-12T22:01:30.700 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T22:01:31.192 INFO:teuthology.orchestra.console.trial004:Power off
2026-02-12T22:01:31.192 DEBUG:teuthology.orchestra.console.trial004:pexpect command: ipmitool -H trial004.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T22:01:31.211 INFO:teuthology.orchestra.console.trial176:Power off
2026-02-12T22:01:31.212 DEBUG:teuthology.orchestra.console.trial176:pexpect command: ipmitool -H trial176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T22:01:31.230 DEBUG:teuthology.orchestra.console.trial004:power off output: Chassis Power Control: Down/Off
2026-02-12T22:01:31.249 DEBUG:teuthology.orchestra.console.trial176:power off output: Chassis Power Control: Down/Off
2026-02-12T22:01:35.235 DEBUG:teuthology.orchestra.console.trial004:pexpect command: ipmitool -H trial004.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:01:35.250 DEBUG:teuthology.orchestra.console.trial176:pexpect command: ipmitool -H trial176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:01:35.343 DEBUG:teuthology.orchestra.console.trial004:check power output: Chassis Power is on
2026-02-12T22:01:35.358 DEBUG:teuthology.orchestra.console.trial176:check power output: Chassis Power is on
2026-02-12T22:01:39.348 DEBUG:teuthology.orchestra.console.trial004:pexpect command: ipmitool -H trial004.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:01:39.359 DEBUG:teuthology.orchestra.console.trial176:pexpect command: ipmitool -H trial176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:01:39.458 DEBUG:teuthology.orchestra.console.trial004:check power output: Chassis Power is off
2026-02-12T22:01:39.459 INFO:teuthology.orchestra.console.trial004:Power off completed
2026-02-12T22:01:39.468 DEBUG:teuthology.orchestra.console.trial176:check power output: Chassis Power is off
2026-02-12T22:01:39.468 INFO:teuthology.orchestra.console.trial176:Power off completed
2026-02-12T22:01:39.707 INFO:teuthology.lock.ops:unlocked: trial004.front.sepia.ceph.com
2026-02-12T22:01:39.720 INFO:teuthology.lock.ops:unlocked: trial176.front.sepia.ceph.com