2026-02-17T19:06:08.111 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-17T19:06:08.111 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T19:06:08.969 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T19:06:09.241 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x720ca05b7650>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x720c9ffa7420>, signals=[15])
2026-02-17T19:06:09.241 INFO:teuthology.lock.ops:Start node 'trial054.front.sepia.ceph.com' reimaging
2026-02-17T19:06:09.241 INFO:teuthology.lock.ops:Updating [trial054.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T19:06:09.241 INFO:teuthology.lock.ops:Updating trial054.front.sepia.ceph.com on lock server
2026-02-17T19:06:09.298 INFO:teuthology.lock.ops:Start node 'trial099.front.sepia.ceph.com' reimaging
2026-02-17T19:06:09.298 INFO:teuthology.lock.ops:Updating [trial099.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T19:06:09.298 INFO:teuthology.lock.ops:Updating trial099.front.sepia.ceph.com on lock server
2026-02-17T19:06:09.355 INFO:teuthology.lock.ops:Start node 'trial112.front.sepia.ceph.com' reimaging
2026-02-17T19:06:09.355 INFO:teuthology.lock.ops:Updating [trial112.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T19:06:09.355 INFO:teuthology.lock.ops:Updating trial112.front.sepia.ceph.com on lock server
2026-02-17T19:06:09.586 DEBUG:teuthology.provision.fog.trial099:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T19:06:09.586 DEBUG:teuthology.provision.fog.trial054:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T19:06:09.645 DEBUG:teuthology.provision.fog.trial112:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T19:06:09.647 INFO:teuthology.provision.fog.trial054:Scheduling deploy of centos 9.stream
2026-02-17T19:06:09.648 INFO:teuthology.provision.fog.trial099:Scheduling deploy of centos 9.stream
2026-02-17T19:06:09.699 INFO:teuthology.provision.fog.trial112:Scheduling deploy of centos 9.stream
2026-02-17T19:06:10.900 INFO:teuthology.orchestra.console.trial054:Power off
2026-02-17T19:06:10.900 DEBUG:teuthology.orchestra.console.trial054:pexpect command: ipmitool -H trial054.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T19:06:10.909 INFO:teuthology.orchestra.console.trial099:Power off
2026-02-17T19:06:10.909 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T19:06:10.925 INFO:teuthology.orchestra.console.trial112:Power off
2026-02-17T19:06:10.925 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T19:06:10.938 DEBUG:teuthology.orchestra.console.trial054:power off output: Chassis Power Control: Down/Off
2026-02-17T19:06:10.946 DEBUG:teuthology.orchestra.console.trial099:power off output: Chassis Power Control: Down/Off
2026-02-17T19:06:10.963 DEBUG:teuthology.orchestra.console.trial112:power off output: Chassis Power Control: Down/Off
2026-02-17T19:06:14.940 DEBUG:teuthology.orchestra.console.trial054:pexpect command: ipmitool -H trial054.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T19:06:14.947 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T19:06:14.964 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T19:06:15.050 DEBUG:teuthology.orchestra.console.trial054:check power output: Chassis Power is off
2026-02-17T19:06:15.050 INFO:teuthology.orchestra.console.trial054:Power off completed
2026-02-17T19:06:15.054 DEBUG:teuthology.orchestra.console.trial099:check power output: Chassis Power is off
2026-02-17T19:06:15.054 INFO:teuthology.orchestra.console.trial099:Power off completed
2026-02-17T19:06:15.072 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is off
2026-02-17T19:06:15.072 INFO:teuthology.orchestra.console.trial112:Power off completed
2026-02-17T19:06:15.151 INFO:teuthology.orchestra.console.trial054:Power on
2026-02-17T19:06:15.152 DEBUG:teuthology.orchestra.console.trial054:pexpect command: ipmitool -H trial054.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T19:06:15.160 INFO:teuthology.orchestra.console.trial099:Power on
2026-02-17T19:06:15.161 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T19:06:15.173 INFO:teuthology.orchestra.console.trial112:Power on
2026-02-17T19:06:15.174 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T19:06:15.191 DEBUG:teuthology.orchestra.console.trial054:power on output: Chassis Power Control: Up/On
2026-02-17T19:06:15.200 DEBUG:teuthology.orchestra.console.trial099:power on output: Chassis Power Control: Up/On
2026-02-17T19:06:15.213 DEBUG:teuthology.orchestra.console.trial112:power on output: Chassis Power Control: Up/On
2026-02-17T19:06:19.196 DEBUG:teuthology.orchestra.console.trial054:pexpect command: ipmitool -H trial054.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T19:06:19.204 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T19:06:19.214 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T19:06:19.306 DEBUG:teuthology.orchestra.console.trial054:check power output: Chassis Power is on
2026-02-17T19:06:19.307 INFO:teuthology.orchestra.console.trial054:Power on completed
2026-02-17T19:06:19.314 DEBUG:teuthology.orchestra.console.trial099:check power output: Chassis Power is on
2026-02-17T19:06:19.314 INFO:teuthology.orchestra.console.trial099:Power on completed
2026-02-17T19:06:19.323 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is on
2026-02-17T19:06:19.323 INFO:teuthology.orchestra.console.trial112:Power on completed
2026-02-17T19:06:19.408 INFO:teuthology.provision.fog.trial054:Waiting for deploy to finish
2026-02-17T19:06:19.414 INFO:teuthology.provision.fog.trial099:Waiting for deploy to finish
2026-02-17T19:06:19.424 INFO:teuthology.provision.fog.trial112:Waiting for deploy to finish
2026-02-17T19:08:06.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T19:08:06.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial054.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T19:08:21.056 WARNING:teuthology.provision.fog.trial054:[Errno None] Unable to connect to port 22 on 10.20.193.54
2026-02-17T19:08:21.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T19:08:25.024 WARNING:teuthology.provision.fog.trial112:[Errno None] Unable to connect to port 22 on 10.20.193.112
2026-02-17T19:08:27.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial054.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T19:08:30.144 WARNING:teuthology.provision.fog.trial054:[Errno None] Unable to connect to port 22 on 10.20.193.54
2026-02-17T19:08:31.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T19:08:34.112 WARNING:teuthology.provision.fog.trial112:[Errno None] Unable to connect to port 22 on 10.20.193.112
2026-02-17T19:08:36.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial054.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T19:08:39.232 WARNING:teuthology.provision.fog.trial054:[Errno None] Unable to connect to port 22 on 10.20.193.54
2026-02-17T19:08:40.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T19:08:43.200 WARNING:teuthology.provision.fog.trial112:[Errno None] Unable to connect to port 22 on 10.20.193.112
2026-02-17T19:08:45.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial054.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T19:08:48.319 WARNING:teuthology.provision.fog.trial054:[Errno None] Unable to connect to port 22 on 10.20.193.54
2026-02-17T19:08:49.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T19:08:52.288 WARNING:teuthology.provision.fog.trial112:[Errno None] Unable to connect to port 22 on 10.20.193.112
2026-02-17T19:08:54.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial054.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T19:08:58.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T19:09:06.675 WARNING:teuthology.provision.fog.trial099:timed out
2026-02-17T19:09:12.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T19:09:17.964 ERROR:teuthology.orchestra.connection:Error authenticating with trial099.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T19:09:22.126 ERROR:teuthology.orchestra.connection:Error authenticating with trial099.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T19:09:29.228 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T19:09:29.228 DEBUG:teuthology.orchestra.run.trial099:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T19:09:29.383 INFO:teuthology.provision.fog.trial099:Node is ready
2026-02-17T19:09:29.383 DEBUG:teuthology.orchestra.run.trial099:> hostname
2026-02-17T19:09:29.439 INFO:teuthology.orchestra.run.trial099.stdout:trial099.front.sepia.ceph.com
2026-02-17T19:09:29.440 DEBUG:teuthology.orchestra.run.trial099:> grep trial099.front.sepia.ceph.com /etc/hosts
2026-02-17T19:09:29.496 INFO:teuthology.orchestra.run.trial099.stdout:10.20.193.99 trial099.front.sepia.ceph.com trial099
2026-02-17T19:09:29.497 DEBUG:teuthology.orchestra.run.trial099:> sudo hostname trial099
2026-02-17T19:09:29.565 DEBUG:teuthology.orchestra.run.trial099:> sudo sed -i -e 's/trial099.front.sepia.ceph.com/trial099/g' /etc/hosts
2026-02-17T19:09:29.631 DEBUG:teuthology.orchestra.run.trial099:> sudo sed -i -e 's/10.20.193.99/10.20.193.99/g' /etc/hosts
2026-02-17T19:09:29.694 DEBUG:teuthology.orchestra.run.trial099:> sudo sed -i -e 's/trial099.front.sepia.ceph.com/trial099/g' /etc/hostname
2026-02-17T19:09:29.758 DEBUG:teuthology.orchestra.run.trial099:> sudo hostname trial099
2026-02-17T19:09:29.822 DEBUG:teuthology.orchestra.run.trial099:> cat /etc/os-release
2026-02-17T19:09:29.879 INFO:teuthology.orchestra.run.trial099.stdout:NAME="CentOS Stream"
2026-02-17T19:09:29.879 INFO:teuthology.orchestra.run.trial099.stdout:VERSION="9"
2026-02-17T19:09:29.879 INFO:teuthology.orchestra.run.trial099.stdout:ID="centos"
2026-02-17T19:09:29.879 INFO:teuthology.orchestra.run.trial099.stdout:ID_LIKE="rhel fedora"
2026-02-17T19:09:29.879 INFO:teuthology.orchestra.run.trial099.stdout:VERSION_ID="9"
2026-02-17T19:09:29.880 INFO:teuthology.orchestra.run.trial099.stdout:PLATFORM_ID="platform:el9"
2026-02-17T19:09:29.880 INFO:teuthology.orchestra.run.trial099.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T19:09:29.880 INFO:teuthology.orchestra.run.trial099.stdout:ANSI_COLOR="0;31"
2026-02-17T19:09:29.880 INFO:teuthology.orchestra.run.trial099.stdout:LOGO="fedora-logo-icon"
2026-02-17T19:09:29.880 INFO:teuthology.orchestra.run.trial099.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T19:09:29.880 INFO:teuthology.orchestra.run.trial099.stdout:HOME_URL="https://centos.org/"
2026-02-17T19:09:29.880 INFO:teuthology.orchestra.run.trial099.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T19:09:29.880 INFO:teuthology.orchestra.run.trial099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T19:09:29.880 INFO:teuthology.orchestra.run.trial099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T19:09:29.882 INFO:teuthology.provision.fog.trial099:Deploy complete!
2026-02-17T19:09:29.882 DEBUG:teuthology.parallel:result is None
2026-02-17T19:09:30.526 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T19:09:30.526 DEBUG:teuthology.orchestra.run.trial054:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T19:09:30.768 INFO:teuthology.provision.fog.trial054:Node is ready
2026-02-17T19:09:30.769 DEBUG:teuthology.orchestra.run.trial054:> hostname
2026-02-17T19:09:30.830 INFO:teuthology.orchestra.run.trial054.stdout:trial054.front.sepia.ceph.com
2026-02-17T19:09:30.830 DEBUG:teuthology.orchestra.run.trial054:> grep trial054.front.sepia.ceph.com /etc/hosts
2026-02-17T19:09:30.886 INFO:teuthology.orchestra.run.trial054.stdout:10.20.193.54 trial054.front.sepia.ceph.com trial054
2026-02-17T19:09:30.887 DEBUG:teuthology.orchestra.run.trial054:> sudo hostname trial054
2026-02-17T19:09:30.958 DEBUG:teuthology.orchestra.run.trial054:> sudo sed -i -e 's/trial054.front.sepia.ceph.com/trial054/g' /etc/hosts
2026-02-17T19:09:31.025 DEBUG:teuthology.orchestra.run.trial054:> sudo sed -i -e 's/10.20.193.54/10.20.193.54/g' /etc/hosts
2026-02-17T19:09:31.089 DEBUG:teuthology.orchestra.run.trial054:> sudo sed -i -e 's/trial054.front.sepia.ceph.com/trial054/g' /etc/hostname
2026-02-17T19:09:31.155 DEBUG:teuthology.orchestra.run.trial054:> sudo hostname trial054
2026-02-17T19:09:31.281 DEBUG:teuthology.orchestra.run.trial054:> cat /etc/os-release
2026-02-17T19:09:31.343 INFO:teuthology.orchestra.run.trial054.stdout:NAME="CentOS Stream"
2026-02-17T19:09:31.344 INFO:teuthology.orchestra.run.trial054.stdout:VERSION="9"
2026-02-17T19:09:31.344 INFO:teuthology.orchestra.run.trial054.stdout:ID="centos"
2026-02-17T19:09:31.344 INFO:teuthology.orchestra.run.trial054.stdout:ID_LIKE="rhel fedora"
2026-02-17T19:09:31.344 INFO:teuthology.orchestra.run.trial054.stdout:VERSION_ID="9"
2026-02-17T19:09:31.344 INFO:teuthology.orchestra.run.trial054.stdout:PLATFORM_ID="platform:el9"
2026-02-17T19:09:31.344 INFO:teuthology.orchestra.run.trial054.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T19:09:31.344 INFO:teuthology.orchestra.run.trial054.stdout:ANSI_COLOR="0;31"
2026-02-17T19:09:31.344 INFO:teuthology.orchestra.run.trial054.stdout:LOGO="fedora-logo-icon"
2026-02-17T19:09:31.344 INFO:teuthology.orchestra.run.trial054.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T19:09:31.344 INFO:teuthology.orchestra.run.trial054.stdout:HOME_URL="https://centos.org/"
2026-02-17T19:09:31.345 INFO:teuthology.orchestra.run.trial054.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T19:09:31.345 INFO:teuthology.orchestra.run.trial054.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T19:09:31.345 INFO:teuthology.orchestra.run.trial054.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T19:09:31.345 INFO:teuthology.provision.fog.trial054:Deploy complete!
2026-02-17T19:09:31.346 DEBUG:teuthology.parallel:result is None
2026-02-17T19:09:34.073 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T19:09:34.073 DEBUG:teuthology.orchestra.run.trial112:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T19:09:34.225 INFO:teuthology.provision.fog.trial112:Node is ready
2026-02-17T19:09:34.225 DEBUG:teuthology.orchestra.run.trial112:> hostname
2026-02-17T19:09:34.282 INFO:teuthology.orchestra.run.trial112.stdout:trial112.front.sepia.ceph.com
2026-02-17T19:09:34.282 DEBUG:teuthology.orchestra.run.trial112:> grep trial112.front.sepia.ceph.com /etc/hosts
2026-02-17T19:09:34.339 INFO:teuthology.orchestra.run.trial112.stdout:10.20.193.112 trial112.front.sepia.ceph.com trial112
2026-02-17T19:09:34.339 DEBUG:teuthology.orchestra.run.trial112:> sudo hostname trial112
2026-02-17T19:09:34.409 DEBUG:teuthology.orchestra.run.trial112:> sudo sed -i -e 's/trial112.front.sepia.ceph.com/trial112/g' /etc/hosts
2026-02-17T19:09:34.459 ERROR:paramiko.transport:Unknown exception: The socket has already been closed by another greenlet
2026-02-17T19:09:34.462 ERROR:paramiko.transport:Traceback (most recent call last):
2026-02-17T19:09:34.462 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 2159, in run
2026-02-17T19:09:34.462 ERROR:paramiko.transport:    ptype, m = self.packetizer.read_message()
2026-02-17T19:09:34.462 ERROR:paramiko.transport:               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-17T19:09:34.462 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/packet.py", line 463, in read_message
2026-02-17T19:09:34.462 ERROR:paramiko.transport:    header = self.read_all(self.__block_size_in, check_rekey=True)
2026-02-17T19:09:34.462 ERROR:paramiko.transport:             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-17T19:09:34.462 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/packet.py", line 308, in read_all
2026-02-17T19:09:34.462 ERROR:paramiko.transport:    x = self.__socket.recv(n)
2026-02-17T19:09:34.463 ERROR:paramiko.transport:        ^^^^^^^^^^^^^^^^^^^^^
2026-02-17T19:09:34.463 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 666, in recv
2026-02-17T19:09:34.463 ERROR:paramiko.transport:    self._wait(self._read_event)
2026-02-17T19:09:34.463 ERROR:paramiko.transport:  File "src/gevent/_hub_primitives.py", line 317, in gevent._gevent_c_hub_primitives.wait_on_socket
2026-02-17T19:09:34.463 ERROR:paramiko.transport:  File "src/gevent/_hub_primitives.py", line 321, in gevent._gevent_c_hub_primitives.wait_on_socket
2026-02-17T19:09:34.463 ERROR:paramiko.transport:gevent.exceptions.ConcurrentObjectUseError: The socket has already been closed by another greenlet
2026-02-17T19:09:34.463 ERROR:paramiko.transport:
2026-02-17T19:09:34.475 DEBUG:teuthology.orchestra.run.trial112:> sudo sed -i -e 's/10.20.193.112/10.20.193.112/g' /etc/hosts
2026-02-17T19:09:34.540 DEBUG:teuthology.orchestra.run.trial112:> sudo sed -i -e 's/trial112.front.sepia.ceph.com/trial112/g' /etc/hostname
2026-02-17T19:09:34.604 DEBUG:teuthology.orchestra.run.trial112:> sudo hostname trial112
2026-02-17T19:09:34.668 DEBUG:teuthology.orchestra.run.trial112:> cat /etc/os-release
2026-02-17T19:09:34.724 INFO:teuthology.orchestra.run.trial112.stdout:NAME="CentOS Stream"
2026-02-17T19:09:34.724 INFO:teuthology.orchestra.run.trial112.stdout:VERSION="9"
2026-02-17T19:09:34.724 INFO:teuthology.orchestra.run.trial112.stdout:ID="centos"
2026-02-17T19:09:34.724 INFO:teuthology.orchestra.run.trial112.stdout:ID_LIKE="rhel fedora"
2026-02-17T19:09:34.724 INFO:teuthology.orchestra.run.trial112.stdout:VERSION_ID="9"
2026-02-17T19:09:34.724 INFO:teuthology.orchestra.run.trial112.stdout:PLATFORM_ID="platform:el9"
2026-02-17T19:09:34.724 INFO:teuthology.orchestra.run.trial112.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T19:09:34.725 INFO:teuthology.orchestra.run.trial112.stdout:ANSI_COLOR="0;31"
2026-02-17T19:09:34.725 INFO:teuthology.orchestra.run.trial112.stdout:LOGO="fedora-logo-icon"
2026-02-17T19:09:34.725 INFO:teuthology.orchestra.run.trial112.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T19:09:34.725 INFO:teuthology.orchestra.run.trial112.stdout:HOME_URL="https://centos.org/"
2026-02-17T19:09:34.725 INFO:teuthology.orchestra.run.trial112.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T19:09:34.725 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T19:09:34.725 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T19:09:34.726 INFO:teuthology.provision.fog.trial112:Deploy complete!
2026-02-17T19:09:34.726 DEBUG:teuthology.parallel:result is None
2026-02-17T19:09:35.249 INFO:teuthology.lock.ops:Checking trial054.front.sepia.ceph.com
2026-02-17T19:09:35.250 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T19:09:35.355 INFO:teuthology.lock.ops:Checking trial099.front.sepia.ceph.com
2026-02-17T19:09:35.356 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T19:09:35.420 INFO:teuthology.lock.ops:Checking trial112.front.sepia.ceph.com
2026-02-17T19:09:35.420 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T19:09:35.478 INFO:teuthology.lock.ops:Updating [trial054.front.sepia.ceph.com]: set os type and version on server
2026-02-17T19:09:35.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial054.front.sepia.ceph.com'
2026-02-17T19:09:35.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial054.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T19:09:35.541 DEBUG:teuthology.orchestra.run.trial054:> true
2026-02-17T19:09:35.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial054.front.sepia.ceph.com'
2026-02-17T19:09:35.614 DEBUG:teuthology.orchestra.run.trial054:> uname -m
2026-02-17T19:09:35.669 INFO:teuthology.orchestra.run.trial054.stdout:x86_64
2026-02-17T19:09:35.669 DEBUG:teuthology.orchestra.run.trial054:> cat /etc/os-release
2026-02-17T19:09:35.725 INFO:teuthology.orchestra.run.trial054.stdout:NAME="CentOS Stream"
2026-02-17T19:09:35.725 INFO:teuthology.orchestra.run.trial054.stdout:VERSION="9"
2026-02-17T19:09:35.725 INFO:teuthology.orchestra.run.trial054.stdout:ID="centos"
2026-02-17T19:09:35.725 INFO:teuthology.orchestra.run.trial054.stdout:ID_LIKE="rhel fedora"
2026-02-17T19:09:35.726 INFO:teuthology.orchestra.run.trial054.stdout:VERSION_ID="9"
2026-02-17T19:09:35.726 INFO:teuthology.orchestra.run.trial054.stdout:PLATFORM_ID="platform:el9"
2026-02-17T19:09:35.726 INFO:teuthology.orchestra.run.trial054.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T19:09:35.726 INFO:teuthology.orchestra.run.trial054.stdout:ANSI_COLOR="0;31"
2026-02-17T19:09:35.726 INFO:teuthology.orchestra.run.trial054.stdout:LOGO="fedora-logo-icon"
2026-02-17T19:09:35.726 INFO:teuthology.orchestra.run.trial054.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T19:09:35.726 INFO:teuthology.orchestra.run.trial054.stdout:HOME_URL="https://centos.org/"
2026-02-17T19:09:35.726 INFO:teuthology.orchestra.run.trial054.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T19:09:35.726 INFO:teuthology.orchestra.run.trial054.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T19:09:35.726 INFO:teuthology.orchestra.run.trial054.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T19:09:35.727 INFO:teuthology.lock.ops:Updating trial054.front.sepia.ceph.com on lock server
2026-02-17T19:09:35.830 INFO:teuthology.lock.ops:Updating [trial099.front.sepia.ceph.com]: set os type and version on server
2026-02-17T19:09:35.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial099.front.sepia.ceph.com'
2026-02-17T19:09:35.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T19:09:35.899 DEBUG:teuthology.orchestra.run.trial099:> true
2026-02-17T19:09:35.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial099.front.sepia.ceph.com'
2026-02-17T19:09:35.974 DEBUG:teuthology.orchestra.run.trial099:> uname -m
2026-02-17T19:09:36.029 INFO:teuthology.orchestra.run.trial099.stdout:x86_64
2026-02-17T19:09:36.030 DEBUG:teuthology.orchestra.run.trial099:> cat /etc/os-release
2026-02-17T19:09:36.085 INFO:teuthology.orchestra.run.trial099.stdout:NAME="CentOS Stream"
2026-02-17T19:09:36.085 INFO:teuthology.orchestra.run.trial099.stdout:VERSION="9"
2026-02-17T19:09:36.085 INFO:teuthology.orchestra.run.trial099.stdout:ID="centos"
2026-02-17T19:09:36.085 INFO:teuthology.orchestra.run.trial099.stdout:ID_LIKE="rhel fedora"
2026-02-17T19:09:36.085 INFO:teuthology.orchestra.run.trial099.stdout:VERSION_ID="9"
2026-02-17T19:09:36.085 INFO:teuthology.orchestra.run.trial099.stdout:PLATFORM_ID="platform:el9"
2026-02-17T19:09:36.086 INFO:teuthology.orchestra.run.trial099.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T19:09:36.086 INFO:teuthology.orchestra.run.trial099.stdout:ANSI_COLOR="0;31"
2026-02-17T19:09:36.086 INFO:teuthology.orchestra.run.trial099.stdout:LOGO="fedora-logo-icon"
2026-02-17T19:09:36.086 INFO:teuthology.orchestra.run.trial099.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T19:09:36.086 INFO:teuthology.orchestra.run.trial099.stdout:HOME_URL="https://centos.org/"
2026-02-17T19:09:36.086 INFO:teuthology.orchestra.run.trial099.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T19:09:36.086 INFO:teuthology.orchestra.run.trial099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T19:09:36.086 INFO:teuthology.orchestra.run.trial099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T19:09:36.087 INFO:teuthology.lock.ops:Updating trial099.front.sepia.ceph.com on lock server
2026-02-17T19:09:36.188 INFO:teuthology.lock.ops:Updating [trial112.front.sepia.ceph.com]: set os type and version on server
2026-02-17T19:09:36.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com'
2026-02-17T19:09:36.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T19:09:36.253 DEBUG:teuthology.orchestra.run.trial112:> true
2026-02-17T19:09:36.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com'
2026-02-17T19:09:36.327 DEBUG:teuthology.orchestra.run.trial112:> uname -m
2026-02-17T19:09:36.384 INFO:teuthology.orchestra.run.trial112.stdout:x86_64
2026-02-17T19:09:36.384 DEBUG:teuthology.orchestra.run.trial112:> cat /etc/os-release
2026-02-17T19:09:36.440 INFO:teuthology.orchestra.run.trial112.stdout:NAME="CentOS Stream"
2026-02-17T19:09:36.441 INFO:teuthology.orchestra.run.trial112.stdout:VERSION="9"
2026-02-17T19:09:36.441 INFO:teuthology.orchestra.run.trial112.stdout:ID="centos"
2026-02-17T19:09:36.441 INFO:teuthology.orchestra.run.trial112.stdout:ID_LIKE="rhel fedora"
2026-02-17T19:09:36.441 INFO:teuthology.orchestra.run.trial112.stdout:VERSION_ID="9"
2026-02-17T19:09:36.441 INFO:teuthology.orchestra.run.trial112.stdout:PLATFORM_ID="platform:el9"
2026-02-17T19:09:36.441 INFO:teuthology.orchestra.run.trial112.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T19:09:36.441 INFO:teuthology.orchestra.run.trial112.stdout:ANSI_COLOR="0;31"
2026-02-17T19:09:36.441 INFO:teuthology.orchestra.run.trial112.stdout:LOGO="fedora-logo-icon"
2026-02-17T19:09:36.441 INFO:teuthology.orchestra.run.trial112.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T19:09:36.442 INFO:teuthology.orchestra.run.trial112.stdout:HOME_URL="https://centos.org/"
2026-02-17T19:09:36.442 INFO:teuthology.orchestra.run.trial112.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T19:09:36.442 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T19:09:36.442 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T19:09:36.442 INFO:teuthology.lock.ops:Updating trial112.front.sepia.ceph.com on lock server
2026-02-17T19:09:36.545 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T19:09:36.645 INFO:teuthology.dispatcher.supervisor:Running job 52681
2026-02-17T19:09:36.645 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_jcollin@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:20:44-fs-wip-jcollin-testing-20260217.030412-squid-distro-default-trial/52681 --name jcollin-2026-02-17_12:20:44-fs-wip-jcollin-testing-20260217.030412-squid-distro-default-trial --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/pjd}} -- /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:20:44-fs-wip-jcollin-testing-20260217.030412-squid-distro-default-trial/52681/orig.config.yaml
2026-02-17T19:09:36.646 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:20:44-fs-wip-jcollin-testing-20260217.030412-squid-distro-default-trial/52681
2026-02-17T19:09:36.646 INFO:teuthology.dispatcher.supervisor:Job PID: 1118201
2026-02-17T19:09:36.646 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-17T19:11:36.730 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T19:13:36.934 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T19:15:37.118 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T19:17:37.327 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T19:19:37.504 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T19:21:37.686 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T19:23:37.868 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T19:25:38.010 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T19:27:38.203 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T19:29:38.384 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T19:31:38.551 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T19:33:38.751 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T19:35:38.891 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T19:35:38.979 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-17T19:35:39.153 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-17T19:35:39.819 INFO:teuthology.orchestra.console.trial099:Power off
2026-02-17T19:35:39.819 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T19:35:39.829 INFO:teuthology.orchestra.console.trial054:Power off
2026-02-17T19:35:39.829 DEBUG:teuthology.orchestra.console.trial054:pexpect command: ipmitool -H trial054.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T19:35:39.894 DEBUG:teuthology.orchestra.console.trial054:power off output: Chassis Power Control: Down/Off
2026-02-17T19:35:39.894 DEBUG:teuthology.orchestra.console.trial099:power off output: Chassis Power Control: Down/Off
2026-02-17T19:35:39.966 INFO:teuthology.orchestra.console.trial112:Power off
2026-02-17T19:35:39.966 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T19:35:40.004 DEBUG:teuthology.orchestra.console.trial112:power off output: Chassis Power Control: Down/Off
2026-02-17T19:35:43.897 DEBUG:teuthology.orchestra.console.trial054:pexpect command: ipmitool -H trial054.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T19:35:43.904 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T19:35:44.006 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T19:35:44.013 DEBUG:teuthology.orchestra.console.trial054:check power output: Chassis Power is on
2026-02-17T19:35:44.014 DEBUG:teuthology.orchestra.console.trial099:check power output: Chassis Power is on
2026-02-17T19:35:44.115 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is on
2026-02-17T19:35:48.018 DEBUG:teuthology.orchestra.console.trial054:pexpect command: ipmitool -H trial054.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T19:35:48.027 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T19:35:48.116 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T19:35:48.129 DEBUG:teuthology.orchestra.console.trial054:check power output: Chassis Power is off
2026-02-17T19:35:48.129 INFO:teuthology.orchestra.console.trial054:Power off completed
2026-02-17T19:35:48.136 DEBUG:teuthology.orchestra.console.trial099:check power output: Chassis Power is off
2026-02-17T19:35:48.137 INFO:teuthology.orchestra.console.trial099:Power off completed
2026-02-17T19:35:48.226 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is off
2026-02-17T19:35:48.226 INFO:teuthology.orchestra.console.trial112:Power off completed
2026-02-17T19:35:48.442 INFO:teuthology.lock.ops:unlocked: trial054.front.sepia.ceph.com
2026-02-17T19:35:48.451 INFO:teuthology.lock.ops:unlocked: trial099.front.sepia.ceph.com
2026-02-17T19:35:48.455 INFO:teuthology.lock.ops:unlocked: trial112.front.sepia.ceph.com