2026-02-12T22:27:06.899 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473
2026-02-12T22:27:06.899 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:27:06.970 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:27:07.158 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x78fb9cd7af90>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x78fb9c578c20>, signals=[15])
2026-02-12T22:27:07.158 INFO:teuthology.lock.ops:Start node 'trial091.front.sepia.ceph.com' reimaging
2026-02-12T22:27:07.158 INFO:teuthology.lock.ops:Updating [trial091.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T22:27:07.158 INFO:teuthology.lock.ops:Updating trial091.front.sepia.ceph.com on lock server
2026-02-12T22:27:07.214 INFO:teuthology.lock.ops:Start node 'trial145.front.sepia.ceph.com' reimaging
2026-02-12T22:27:07.214 INFO:teuthology.lock.ops:Updating [trial145.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T22:27:07.214 INFO:teuthology.lock.ops:Updating trial145.front.sepia.ceph.com on lock server
2026-02-12T22:27:07.417 DEBUG:teuthology.provision.fog.trial091:Requesting image trial_rocky_10.1 (ID 4)
2026-02-12T22:27:07.425 DEBUG:teuthology.provision.fog.trial145:Requesting image trial_rocky_10.1 (ID 4)
2026-02-12T22:27:07.469 INFO:teuthology.provision.fog.trial091:Scheduling deploy of rocky 10.1
2026-02-12T22:27:07.473 INFO:teuthology.provision.fog.trial145:Scheduling deploy of rocky 10.1
2026-02-12T22:27:08.513 INFO:teuthology.orchestra.console.trial091:Power off
2026-02-12T22:27:08.513 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T22:27:08.531 INFO:teuthology.orchestra.console.trial145:Power off
2026-02-12T22:27:08.532 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T22:27:08.557 DEBUG:teuthology.orchestra.console.trial091:power off output: Chassis Power Control: Down/Off
2026-02-12T22:27:08.568 DEBUG:teuthology.orchestra.console.trial145:power off output: Chassis Power Control: Down/Off
2026-02-12T22:27:12.562 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:27:12.569 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:27:12.671 DEBUG:teuthology.orchestra.console.trial091:check power output: Chassis Power is off
2026-02-12T22:27:12.679 INFO:teuthology.orchestra.console.trial091:Power off completed
2026-02-12T22:27:12.681 DEBUG:teuthology.orchestra.console.trial145:check power output: Chassis Power is off
2026-02-12T22:27:12.681 INFO:teuthology.orchestra.console.trial145:Power off completed
2026-02-12T22:27:12.780 INFO:teuthology.orchestra.console.trial091:Power on
2026-02-12T22:27:12.780 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T22:27:12.789 INFO:teuthology.orchestra.console.trial145:Power on
2026-02-12T22:27:12.789 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T22:27:12.819 DEBUG:teuthology.orchestra.console.trial091:power on output: Chassis Power Control: Up/On
2026-02-12T22:27:12.827 DEBUG:teuthology.orchestra.console.trial145:power on output: Chassis Power Control: Up/On
2026-02-12T22:27:16.824 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:27:16.833 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:27:16.934 DEBUG:teuthology.orchestra.console.trial091:check power output: Chassis Power is on
2026-02-12T22:27:16.935 INFO:teuthology.orchestra.console.trial091:Power on completed
2026-02-12T22:27:16.942 DEBUG:teuthology.orchestra.console.trial145:check power output: Chassis Power is on
2026-02-12T22:27:16.942 INFO:teuthology.orchestra.console.trial145:Power on completed
2026-02-12T22:27:17.036 INFO:teuthology.provision.fog.trial091:Waiting for deploy to finish
2026-02-12T22:27:17.043 INFO:teuthology.provision.fog.trial145:Waiting for deploy to finish
2026-02-12T22:29:04.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:29:04.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:29:07.293 WARNING:teuthology.provision.fog.trial091:[Errno None] Unable to connect to port 22 on 10.20.193.91
2026-02-12T22:29:07.293 WARNING:teuthology.provision.fog.trial145:[Errno None] Unable to connect to port 22 on 10.20.193.145
2026-02-12T22:29:13.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:29:13.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:29:16.381 WARNING:teuthology.provision.fog.trial091:[Errno None] Unable to connect to port 22 on 10.20.193.91
2026-02-12T22:29:16.381 WARNING:teuthology.provision.fog.trial145:[Errno None] Unable to connect to port 22 on 10.20.193.145
2026-02-12T22:29:22.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:29:22.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:29:25.469 WARNING:teuthology.provision.fog.trial091:[Errno None] Unable to connect to port 22 on 10.20.193.91
2026-02-12T22:29:25.469 WARNING:teuthology.provision.fog.trial145:[Errno None] Unable to connect to port 22 on 10.20.193.145
2026-02-12T22:29:31.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:29:31.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:29:34.557 WARNING:teuthology.provision.fog.trial091:[Errno None] Unable to connect to port 22 on 10.20.193.91
2026-02-12T22:29:34.557 WARNING:teuthology.provision.fog.trial145:[Errno None] Unable to connect to port 22 on 10.20.193.145
2026-02-12T22:29:40.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:29:40.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:30:16.634 ERROR:teuthology.orchestra.connection:Error authenticating with trial091.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-12T22:30:17.057 ERROR:teuthology.orchestra.connection:Error authenticating with trial145.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-12T22:30:20.734 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T22:30:20.734 DEBUG:teuthology.orchestra.run.trial091:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T22:30:20.930 INFO:teuthology.provision.fog.trial091:Node is ready
2026-02-12T22:30:20.930 DEBUG:teuthology.orchestra.run.trial091:> hostname
2026-02-12T22:30:20.987 INFO:teuthology.orchestra.run.trial091.stdout:trial091.front.sepia.ceph.com
2026-02-12T22:30:20.988 DEBUG:teuthology.orchestra.run.trial091:> grep trial091.front.sepia.ceph.com /etc/hosts
2026-02-12T22:30:21.045 INFO:teuthology.orchestra.run.trial091.stdout:10.20.193.91 trial091.front.sepia.ceph.com trial091
2026-02-12T22:30:21.045 DEBUG:teuthology.orchestra.run.trial091:> sudo hostname trial091
2026-02-12T22:30:21.167 ERROR:teuthology.orchestra.connection:Error authenticating with trial145.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-12T22:30:21.188 DEBUG:teuthology.orchestra.run.trial091:> sudo sed -i -e 's/trial091.front.sepia.ceph.com/trial091/g' /etc/hosts
2026-02-12T22:30:21.255 DEBUG:teuthology.orchestra.run.trial091:> sudo sed -i -e 's/10.20.193.91/10.20.193.91/g' /etc/hosts
2026-02-12T22:30:21.321 DEBUG:teuthology.orchestra.run.trial091:> sudo sed -i -e 's/trial091.front.sepia.ceph.com/trial091/g' /etc/hostname
2026-02-12T22:30:21.389 DEBUG:teuthology.orchestra.run.trial091:> sudo hostname trial091
2026-02-12T22:30:21.455 DEBUG:teuthology.orchestra.run.trial091:> cat /etc/os-release
2026-02-12T22:30:21.513 INFO:teuthology.orchestra.run.trial091.stdout:NAME="Rocky Linux"
2026-02-12T22:30:21.513 INFO:teuthology.orchestra.run.trial091.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T22:30:21.513 INFO:teuthology.orchestra.run.trial091.stdout:ID="rocky"
2026-02-12T22:30:21.513 INFO:teuthology.orchestra.run.trial091.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T22:30:21.513 INFO:teuthology.orchestra.run.trial091.stdout:VERSION_ID="10.1"
2026-02-12T22:30:21.513 INFO:teuthology.orchestra.run.trial091.stdout:PLATFORM_ID="platform:el10"
2026-02-12T22:30:21.513 INFO:teuthology.orchestra.run.trial091.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T22:30:21.513 INFO:teuthology.orchestra.run.trial091.stdout:ANSI_COLOR="0;32"
2026-02-12T22:30:21.514 INFO:teuthology.orchestra.run.trial091.stdout:LOGO="fedora-logo-icon"
2026-02-12T22:30:21.514 INFO:teuthology.orchestra.run.trial091.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T22:30:21.514 INFO:teuthology.orchestra.run.trial091.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T22:30:21.514 INFO:teuthology.orchestra.run.trial091.stdout:VENDOR_NAME="RESF"
2026-02-12T22:30:21.514 INFO:teuthology.orchestra.run.trial091.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T22:30:21.514 INFO:teuthology.orchestra.run.trial091.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T22:30:21.514 INFO:teuthology.orchestra.run.trial091.stdout:SUPPORT_END="2035-05-31"
2026-02-12T22:30:21.514 INFO:teuthology.orchestra.run.trial091.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T22:30:21.514 INFO:teuthology.orchestra.run.trial091.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:30:21.514 INFO:teuthology.orchestra.run.trial091.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T22:30:21.514 INFO:teuthology.orchestra.run.trial091.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:30:21.515 INFO:teuthology.provision.fog.trial091:Deploy complete!
2026-02-12T22:30:21.516 DEBUG:teuthology.parallel:result is None
2026-02-12T22:30:28.262 ERROR:paramiko.transport:Unknown exception: The socket has already been closed by another greenlet
2026-02-12T22:30:28.262 ERROR:paramiko.transport:Traceback (most recent call last):
2026-02-12T22:30:28.263 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 2159, in run
2026-02-12T22:30:28.263 ERROR:paramiko.transport:    ptype, m = self.packetizer.read_message()
2026-02-12T22:30:28.263 ERROR:paramiko.transport:               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-12T22:30:28.263 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/packet.py", line 463, in read_message
2026-02-12T22:30:28.263 ERROR:paramiko.transport:    header = self.read_all(self.__block_size_in, check_rekey=True)
2026-02-12T22:30:28.263 ERROR:paramiko.transport:             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-12T22:30:28.263 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/packet.py", line 308, in read_all
2026-02-12T22:30:28.263 ERROR:paramiko.transport:    x = self.__socket.recv(n)
2026-02-12T22:30:28.263 ERROR:paramiko.transport:        ^^^^^^^^^^^^^^^^^^^^^
2026-02-12T22:30:28.263 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 666, in recv
2026-02-12T22:30:28.263 ERROR:paramiko.transport:    self._wait(self._read_event)
2026-02-12T22:30:28.263 ERROR:paramiko.transport:  File "src/gevent/_hub_primitives.py", line 317, in gevent._gevent_c_hub_primitives.wait_on_socket
2026-02-12T22:30:28.263 ERROR:paramiko.transport:  File "src/gevent/_hub_primitives.py", line 321, in gevent._gevent_c_hub_primitives.wait_on_socket
2026-02-12T22:30:28.263 ERROR:paramiko.transport:gevent.exceptions.ConcurrentObjectUseError: The socket has already been closed by another greenlet
2026-02-12T22:30:28.263 ERROR:paramiko.transport:
2026-02-12T22:30:28.273 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T22:30:28.273 DEBUG:teuthology.orchestra.run.trial145:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T22:30:28.454 INFO:teuthology.provision.fog.trial145:Node is ready
2026-02-12T22:30:28.454 DEBUG:teuthology.orchestra.run.trial145:> hostname
2026-02-12T22:30:28.511 INFO:teuthology.orchestra.run.trial145.stdout:trial145.front.sepia.ceph.com
2026-02-12T22:30:28.512 DEBUG:teuthology.orchestra.run.trial145:> grep trial145.front.sepia.ceph.com /etc/hosts
2026-02-12T22:30:28.569 INFO:teuthology.orchestra.run.trial145.stdout:10.20.193.145 trial145.front.sepia.ceph.com trial145
2026-02-12T22:30:28.570 DEBUG:teuthology.orchestra.run.trial145:> sudo hostname trial145
2026-02-12T22:30:28.642 DEBUG:teuthology.orchestra.run.trial145:> sudo sed -i -e 's/trial145.front.sepia.ceph.com/trial145/g' /etc/hosts
2026-02-12T22:30:28.709 DEBUG:teuthology.orchestra.run.trial145:> sudo sed -i -e 's/10.20.193.145/10.20.193.145/g' /etc/hosts
2026-02-12T22:30:28.775 DEBUG:teuthology.orchestra.run.trial145:> sudo sed -i -e 's/trial145.front.sepia.ceph.com/trial145/g' /etc/hostname
2026-02-12T22:30:28.844 DEBUG:teuthology.orchestra.run.trial145:> sudo hostname trial145
2026-02-12T22:30:28.911 DEBUG:teuthology.orchestra.run.trial145:> cat /etc/os-release
2026-02-12T22:30:28.970 INFO:teuthology.orchestra.run.trial145.stdout:NAME="Rocky Linux"
2026-02-12T22:30:28.970 INFO:teuthology.orchestra.run.trial145.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T22:30:28.970 INFO:teuthology.orchestra.run.trial145.stdout:ID="rocky"
2026-02-12T22:30:28.970 INFO:teuthology.orchestra.run.trial145.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T22:30:28.970 INFO:teuthology.orchestra.run.trial145.stdout:VERSION_ID="10.1"
2026-02-12T22:30:28.970 INFO:teuthology.orchestra.run.trial145.stdout:PLATFORM_ID="platform:el10"
2026-02-12T22:30:28.970 INFO:teuthology.orchestra.run.trial145.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T22:30:28.970 INFO:teuthology.orchestra.run.trial145.stdout:ANSI_COLOR="0;32"
2026-02-12T22:30:28.971 INFO:teuthology.orchestra.run.trial145.stdout:LOGO="fedora-logo-icon"
2026-02-12T22:30:28.971 INFO:teuthology.orchestra.run.trial145.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T22:30:28.971 INFO:teuthology.orchestra.run.trial145.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T22:30:28.971 INFO:teuthology.orchestra.run.trial145.stdout:VENDOR_NAME="RESF"
2026-02-12T22:30:28.971 INFO:teuthology.orchestra.run.trial145.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T22:30:28.971 INFO:teuthology.orchestra.run.trial145.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T22:30:28.971 INFO:teuthology.orchestra.run.trial145.stdout:SUPPORT_END="2035-05-31"
2026-02-12T22:30:28.971 INFO:teuthology.orchestra.run.trial145.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T22:30:28.971 INFO:teuthology.orchestra.run.trial145.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:30:28.971 INFO:teuthology.orchestra.run.trial145.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T22:30:28.971 INFO:teuthology.orchestra.run.trial145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:30:28.972 INFO:teuthology.provision.fog.trial145:Deploy complete!
2026-02-12T22:30:28.972 DEBUG:teuthology.parallel:result is None
2026-02-12T22:30:29.371 INFO:teuthology.lock.ops:Checking trial091.front.sepia.ceph.com
2026-02-12T22:30:29.371 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T22:30:29.433 INFO:teuthology.lock.ops:Checking trial145.front.sepia.ceph.com
2026-02-12T22:30:29.433 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T22:30:29.492 INFO:teuthology.lock.ops:Updating [trial091.front.sepia.ceph.com]: set os type and version on server
2026-02-12T22:30:29.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial091.front.sepia.ceph.com'
2026-02-12T22:30:29.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:30:29.553 DEBUG:teuthology.orchestra.run.trial091:> true
2026-02-12T22:30:29.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial091.front.sepia.ceph.com'
2026-02-12T22:30:29.633 DEBUG:teuthology.orchestra.run.trial091:> uname -m
2026-02-12T22:30:29.690 INFO:teuthology.orchestra.run.trial091.stdout:x86_64
2026-02-12T22:30:29.690 DEBUG:teuthology.orchestra.run.trial091:> cat /etc/os-release
2026-02-12T22:30:29.747 INFO:teuthology.orchestra.run.trial091.stdout:NAME="Rocky Linux"
2026-02-12T22:30:29.748 INFO:teuthology.orchestra.run.trial091.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T22:30:29.748 INFO:teuthology.orchestra.run.trial091.stdout:ID="rocky"
2026-02-12T22:30:29.748 INFO:teuthology.orchestra.run.trial091.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T22:30:29.748 INFO:teuthology.orchestra.run.trial091.stdout:VERSION_ID="10.1"
2026-02-12T22:30:29.748 INFO:teuthology.orchestra.run.trial091.stdout:PLATFORM_ID="platform:el10"
2026-02-12T22:30:29.748 INFO:teuthology.orchestra.run.trial091.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T22:30:29.748 INFO:teuthology.orchestra.run.trial091.stdout:ANSI_COLOR="0;32"
2026-02-12T22:30:29.748 INFO:teuthology.orchestra.run.trial091.stdout:LOGO="fedora-logo-icon"
2026-02-12T22:30:29.748 INFO:teuthology.orchestra.run.trial091.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T22:30:29.749 INFO:teuthology.orchestra.run.trial091.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T22:30:29.749 INFO:teuthology.orchestra.run.trial091.stdout:VENDOR_NAME="RESF"
2026-02-12T22:30:29.749 INFO:teuthology.orchestra.run.trial091.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T22:30:29.749 INFO:teuthology.orchestra.run.trial091.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T22:30:29.749 INFO:teuthology.orchestra.run.trial091.stdout:SUPPORT_END="2035-05-31"
2026-02-12T22:30:29.749 INFO:teuthology.orchestra.run.trial091.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T22:30:29.749 INFO:teuthology.orchestra.run.trial091.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:30:29.749 INFO:teuthology.orchestra.run.trial091.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T22:30:29.749 INFO:teuthology.orchestra.run.trial091.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:30:29.750 INFO:teuthology.lock.ops:Updating trial091.front.sepia.ceph.com on lock server
2026-02-12T22:30:29.852 INFO:teuthology.lock.ops:Updating [trial145.front.sepia.ceph.com]: set os type and version on server
2026-02-12T22:30:29.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial145.front.sepia.ceph.com'
2026-02-12T22:30:29.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:30:29.921 DEBUG:teuthology.orchestra.run.trial145:> true
2026-02-12T22:30:30.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial145.front.sepia.ceph.com'
2026-02-12T22:30:30.001 DEBUG:teuthology.orchestra.run.trial145:> uname -m
2026-02-12T22:30:30.058 INFO:teuthology.orchestra.run.trial145.stdout:x86_64
2026-02-12T22:30:30.059 DEBUG:teuthology.orchestra.run.trial145:> cat /etc/os-release
2026-02-12T22:30:30.116 INFO:teuthology.orchestra.run.trial145.stdout:NAME="Rocky Linux"
2026-02-12T22:30:30.116 INFO:teuthology.orchestra.run.trial145.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T22:30:30.116 INFO:teuthology.orchestra.run.trial145.stdout:ID="rocky"
2026-02-12T22:30:30.117 INFO:teuthology.orchestra.run.trial145.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T22:30:30.117 INFO:teuthology.orchestra.run.trial145.stdout:VERSION_ID="10.1"
2026-02-12T22:30:30.117 INFO:teuthology.orchestra.run.trial145.stdout:PLATFORM_ID="platform:el10"
2026-02-12T22:30:30.117 INFO:teuthology.orchestra.run.trial145.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T22:30:30.117 INFO:teuthology.orchestra.run.trial145.stdout:ANSI_COLOR="0;32"
2026-02-12T22:30:30.117 INFO:teuthology.orchestra.run.trial145.stdout:LOGO="fedora-logo-icon"
2026-02-12T22:30:30.117 INFO:teuthology.orchestra.run.trial145.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T22:30:30.117 INFO:teuthology.orchestra.run.trial145.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T22:30:30.117 INFO:teuthology.orchestra.run.trial145.stdout:VENDOR_NAME="RESF"
2026-02-12T22:30:30.117 INFO:teuthology.orchestra.run.trial145.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T22:30:30.117 INFO:teuthology.orchestra.run.trial145.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T22:30:30.117 INFO:teuthology.orchestra.run.trial145.stdout:SUPPORT_END="2035-05-31"
2026-02-12T22:30:30.118 INFO:teuthology.orchestra.run.trial145.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T22:30:30.118 INFO:teuthology.orchestra.run.trial145.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:30:30.118 INFO:teuthology.orchestra.run.trial145.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T22:30:30.118 INFO:teuthology.orchestra.run.trial145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:30:30.118 INFO:teuthology.lock.ops:Updating trial145.front.sepia.ceph.com on lock server
2026-02-12T22:30:30.220 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:30:30.318 INFO:teuthology.dispatcher.supervisor:Running job 47222
2026-02-12T22:30:30.318 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47222 --name pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/yes prefetch_oft_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47222/orig.config.yaml
2026-02-12T22:30:30.319 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47222
2026-02-12T22:30:30.319 INFO:teuthology.dispatcher.supervisor:Job PID: 822736
2026-02-12T22:30:30.319 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T22:32:30.384 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:34:30.587 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:36:30.731 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:38:30.940 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:38:31.028 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-12T22:38:31.142 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T22:38:31.634 INFO:teuthology.orchestra.console.trial145:Power off
2026-02-12T22:38:31.634 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T22:38:31.654 INFO:teuthology.orchestra.console.trial091:Power off
2026-02-12T22:38:31.654 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T22:38:31.673 DEBUG:teuthology.orchestra.console.trial145:power off output: Chassis Power Control: Down/Off
2026-02-12T22:38:31.692 DEBUG:teuthology.orchestra.console.trial091:power off output: Chassis Power Control: Down/Off
2026-02-12T22:38:35.678 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:38:35.693 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:38:35.787 DEBUG:teuthology.orchestra.console.trial145:check power output: Chassis Power is on
2026-02-12T22:38:35.801 DEBUG:teuthology.orchestra.console.trial091:check power output: Chassis Power is on
2026-02-12T22:38:39.791 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:38:39.802 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:38:39.901 DEBUG:teuthology.orchestra.console.trial145:check power output: Chassis Power is off
2026-02-12T22:38:39.902 INFO:teuthology.orchestra.console.trial145:Power off completed
2026-02-12T22:38:39.912 DEBUG:teuthology.orchestra.console.trial091:check power output: Chassis Power is off
2026-02-12T22:38:39.912 INFO:teuthology.orchestra.console.trial091:Power off completed
2026-02-12T22:38:40.150 INFO:teuthology.lock.ops:unlocked: trial145.front.sepia.ceph.com
2026-02-12T22:38:40.161 INFO:teuthology.lock.ops:unlocked: trial091.front.sepia.ceph.com