2026-02-19T23:39:11.614 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-19T23:39:11.615 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:39:11.689 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:39:11.952 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x799e811f99a0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x799e80a8fb00>, signals=[15])
2026-02-19T23:39:11.952 INFO:teuthology.lock.ops:Start node 'trial061.front.sepia.ceph.com' reimaging
2026-02-19T23:39:11.952 INFO:teuthology.lock.ops:Updating [trial061.front.sepia.ceph.com]: reset os type and version on server
2026-02-19T23:39:11.952 INFO:teuthology.lock.ops:Updating trial061.front.sepia.ceph.com on lock server
2026-02-19T23:39:12.009 INFO:teuthology.lock.ops:Start node 'trial102.front.sepia.ceph.com' reimaging
2026-02-19T23:39:12.009 INFO:teuthology.lock.ops:Updating [trial102.front.sepia.ceph.com]: reset os type and version on server
2026-02-19T23:39:12.009 INFO:teuthology.lock.ops:Updating trial102.front.sepia.ceph.com on lock server
2026-02-19T23:39:12.068 INFO:teuthology.lock.ops:Start node 'trial115.front.sepia.ceph.com' reimaging
2026-02-19T23:39:12.068 INFO:teuthology.lock.ops:Updating [trial115.front.sepia.ceph.com]: reset os type and version on server
2026-02-19T23:39:12.068 INFO:teuthology.lock.ops:Updating trial115.front.sepia.ceph.com on lock server
2026-02-19T23:39:12.295 DEBUG:teuthology.provision.fog.trial061:Requesting image trial_centos_9.stream (ID 3)
2026-02-19T23:39:12.296 DEBUG:teuthology.provision.fog.trial102:Requesting image trial_centos_9.stream (ID 3)
2026-02-19T23:39:12.344 INFO:teuthology.provision.fog.trial102:Scheduling deploy of centos 9.stream
2026-02-19T23:39:12.346 INFO:teuthology.provision.fog.trial061:Scheduling deploy of centos 9.stream
2026-02-19T23:39:12.350 DEBUG:teuthology.provision.fog.trial115:Requesting image trial_centos_9.stream (ID 3)
2026-02-19T23:39:12.402 INFO:teuthology.provision.fog.trial115:Scheduling deploy of centos 9.stream
2026-02-19T23:39:13.890 INFO:teuthology.orchestra.console.trial061:Power off
2026-02-19T23:39:13.890 DEBUG:teuthology.orchestra.console.trial061:pexpect command: ipmitool -H trial061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-19T23:39:13.901 INFO:teuthology.orchestra.console.trial102:Power off
2026-02-19T23:39:13.901 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-19T23:39:13.913 INFO:teuthology.orchestra.console.trial115:Power off
2026-02-19T23:39:13.913 DEBUG:teuthology.orchestra.console.trial115:pexpect command: ipmitool -H trial115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-19T23:39:13.928 DEBUG:teuthology.orchestra.console.trial061:power off output: Chassis Power Control: Down/Off
2026-02-19T23:39:13.942 DEBUG:teuthology.orchestra.console.trial102:power off output: Chassis Power Control: Down/Off
2026-02-19T23:39:13.951 DEBUG:teuthology.orchestra.console.trial115:power off output: Chassis Power Control: Down/Off
2026-02-19T23:39:17.933 DEBUG:teuthology.orchestra.console.trial061:pexpect command: ipmitool -H trial061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T23:39:17.942 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T23:39:17.952 DEBUG:teuthology.orchestra.console.trial115:pexpect command: ipmitool -H trial115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T23:39:18.043 DEBUG:teuthology.orchestra.console.trial061:check power output: Chassis Power is off
2026-02-19T23:39:18.044 INFO:teuthology.orchestra.console.trial061:Power off completed
2026-02-19T23:39:18.049 DEBUG:teuthology.orchestra.console.trial102:check power output: Chassis Power is off
2026-02-19T23:39:18.049 INFO:teuthology.orchestra.console.trial102:Power off completed
2026-02-19T23:39:18.061 DEBUG:teuthology.orchestra.console.trial115:check power output: Chassis Power is off
2026-02-19T23:39:18.061 INFO:teuthology.orchestra.console.trial115:Power off completed
2026-02-19T23:39:18.144 INFO:teuthology.orchestra.console.trial061:Power on
2026-02-19T23:39:18.145 DEBUG:teuthology.orchestra.console.trial061:pexpect command: ipmitool -H trial061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-19T23:39:18.154 INFO:teuthology.orchestra.console.trial102:Power on
2026-02-19T23:39:18.154 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-19T23:39:18.163 INFO:teuthology.orchestra.console.trial115:Power on
2026-02-19T23:39:18.163 DEBUG:teuthology.orchestra.console.trial115:pexpect command: ipmitool -H trial115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-19T23:39:18.231 DEBUG:teuthology.orchestra.console.trial102:power on output: Chassis Power Control: Up/On
2026-02-19T23:39:18.237 DEBUG:teuthology.orchestra.console.trial115:power on output: Chassis Power Control: Up/On
2026-02-19T23:39:18.241 DEBUG:teuthology.orchestra.console.trial061:power on output: Chassis Power Control: Up/On
2026-02-19T23:39:22.236 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T23:39:22.242 DEBUG:teuthology.orchestra.console.trial115:pexpect command: ipmitool -H trial115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T23:39:22.248 DEBUG:teuthology.orchestra.console.trial061:pexpect command: ipmitool -H trial061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T23:39:22.345 DEBUG:teuthology.orchestra.console.trial102:check power output: Chassis Power is on
2026-02-19T23:39:22.345 INFO:teuthology.orchestra.console.trial102:Power on completed
2026-02-19T23:39:22.350 DEBUG:teuthology.orchestra.console.trial115:check power output: Chassis Power is on
2026-02-19T23:39:22.350 INFO:teuthology.orchestra.console.trial115:Power on completed
2026-02-19T23:39:22.356 DEBUG:teuthology.orchestra.console.trial061:check power output: Chassis Power is on
2026-02-19T23:39:22.356 INFO:teuthology.orchestra.console.trial061:Power on completed
2026-02-19T23:39:22.446 INFO:teuthology.provision.fog.trial102:Waiting for deploy to finish
2026-02-19T23:39:22.451 INFO:teuthology.provision.fog.trial115:Waiting for deploy to finish
2026-02-19T23:39:22.456 INFO:teuthology.provision.fog.trial061:Waiting for deploy to finish
2026-02-19T23:41:10.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T23:41:10.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T23:41:10.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T23:41:10.311 ERROR:teuthology.orchestra.connection:Error authenticating with trial115.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-19T23:41:10.439 ERROR:teuthology.orchestra.connection:Error authenticating with trial061.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-19T23:41:10.439 ERROR:teuthology.orchestra.connection:Error authenticating with trial102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-19T23:41:22.496 WARNING:teuthology.provision.fog.trial115:[Errno None] Unable to connect to port 22 on 10.20.193.115
2026-02-19T23:41:28.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T23:41:31.584 WARNING:teuthology.provision.fog.trial115:[Errno None] Unable to connect to port 22 on 10.20.193.115
2026-02-19T23:41:37.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T23:41:40.673 WARNING:teuthology.provision.fog.trial115:[Errno None] Unable to connect to port 22 on 10.20.193.115
2026-02-19T23:41:46.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T23:41:49.760 WARNING:teuthology.provision.fog.trial115:[Errno None] Unable to connect to port 22 on 10.20.193.115
2026-02-19T23:41:55.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T23:42:14.441 WARNING:teuthology.provision.fog.trial061:timed out
2026-02-19T23:42:14.441 WARNING:teuthology.provision.fog.trial102:timed out
2026-02-19T23:42:20.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T23:42:20.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T23:42:23.732 ERROR:teuthology.orchestra.connection:Error authenticating with trial102.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-19T23:42:23.802 ERROR:teuthology.orchestra.connection:Error authenticating with trial061.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-19T23:42:27.807 ERROR:teuthology.orchestra.connection:Error authenticating with trial102.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-19T23:42:27.877 ERROR:teuthology.orchestra.connection:Error authenticating with trial061.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-19T23:42:31.900 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-19T23:42:31.900 DEBUG:teuthology.orchestra.run.trial115:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-19T23:42:32.050 INFO:teuthology.provision.fog.trial115:Node is ready
2026-02-19T23:42:32.050 DEBUG:teuthology.orchestra.run.trial115:> hostname
2026-02-19T23:42:32.106 INFO:teuthology.orchestra.run.trial115.stdout:trial115.front.sepia.ceph.com
2026-02-19T23:42:32.106 DEBUG:teuthology.orchestra.run.trial115:> grep trial115.front.sepia.ceph.com /etc/hosts
2026-02-19T23:42:32.162 INFO:teuthology.orchestra.run.trial115.stdout:10.20.193.115 trial115.front.sepia.ceph.com trial115
2026-02-19T23:42:32.162 DEBUG:teuthology.orchestra.run.trial115:> sudo hostname trial115
2026-02-19T23:42:32.235 DEBUG:teuthology.orchestra.run.trial115:> sudo sed -i -e 's/trial115.front.sepia.ceph.com/trial115/g' /etc/hosts
2026-02-19T23:42:32.301 DEBUG:teuthology.orchestra.run.trial115:> sudo sed -i -e 's/10.20.193.115/10.20.193.115/g' /etc/hosts
2026-02-19T23:42:32.368 DEBUG:teuthology.orchestra.run.trial115:> sudo sed -i -e 's/trial115.front.sepia.ceph.com/trial115/g' /etc/hostname
2026-02-19T23:42:32.435 DEBUG:teuthology.orchestra.run.trial115:> sudo hostname trial115
2026-02-19T23:42:32.500 DEBUG:teuthology.orchestra.run.trial115:> cat /etc/os-release
2026-02-19T23:42:32.556 INFO:teuthology.orchestra.run.trial115.stdout:NAME="CentOS Stream"
2026-02-19T23:42:32.556 INFO:teuthology.orchestra.run.trial115.stdout:VERSION="9"
2026-02-19T23:42:32.556 INFO:teuthology.orchestra.run.trial115.stdout:ID="centos"
2026-02-19T23:42:32.556 INFO:teuthology.orchestra.run.trial115.stdout:ID_LIKE="rhel fedora"
2026-02-19T23:42:32.556 INFO:teuthology.orchestra.run.trial115.stdout:VERSION_ID="9"
2026-02-19T23:42:32.556 INFO:teuthology.orchestra.run.trial115.stdout:PLATFORM_ID="platform:el9"
2026-02-19T23:42:32.556 INFO:teuthology.orchestra.run.trial115.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-19T23:42:32.556 INFO:teuthology.orchestra.run.trial115.stdout:ANSI_COLOR="0;31"
2026-02-19T23:42:32.556 INFO:teuthology.orchestra.run.trial115.stdout:LOGO="fedora-logo-icon"
2026-02-19T23:42:32.556 INFO:teuthology.orchestra.run.trial115.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-19T23:42:32.556 INFO:teuthology.orchestra.run.trial115.stdout:HOME_URL="https://centos.org/"
2026-02-19T23:42:32.556 INFO:teuthology.orchestra.run.trial115.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-19T23:42:32.556 INFO:teuthology.orchestra.run.trial115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-19T23:42:32.556 INFO:teuthology.orchestra.run.trial115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-19T23:42:32.556 INFO:teuthology.provision.fog.trial115:Deploy complete!
2026-02-19T23:42:32.557 DEBUG:teuthology.parallel:result is None
2026-02-19T23:42:34.890 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-19T23:42:34.890 DEBUG:teuthology.orchestra.run.trial102:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-19T23:42:34.942 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-19T23:42:34.943 DEBUG:teuthology.orchestra.run.trial061:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-19T23:42:35.089 INFO:teuthology.provision.fog.trial102:Node is ready
2026-02-19T23:42:35.089 DEBUG:teuthology.orchestra.run.trial102:> hostname
2026-02-19T23:42:35.102 INFO:teuthology.provision.fog.trial061:Node is ready
2026-02-19T23:42:35.103 DEBUG:teuthology.orchestra.run.trial061:> hostname
2026-02-19T23:42:35.146 INFO:teuthology.orchestra.run.trial102.stdout:trial102.front.sepia.ceph.com
2026-02-19T23:42:35.147 DEBUG:teuthology.orchestra.run.trial102:> grep trial102.front.sepia.ceph.com /etc/hosts
2026-02-19T23:42:35.158 INFO:teuthology.orchestra.run.trial061.stdout:trial061.front.sepia.ceph.com
2026-02-19T23:42:35.158 DEBUG:teuthology.orchestra.run.trial061:> grep trial061.front.sepia.ceph.com /etc/hosts
2026-02-19T23:42:35.202 INFO:teuthology.orchestra.run.trial102.stdout:10.20.193.102 trial102.front.sepia.ceph.com trial102
2026-02-19T23:42:35.203 DEBUG:teuthology.orchestra.run.trial102:> sudo hostname trial102
2026-02-19T23:42:35.214 INFO:teuthology.orchestra.run.trial061.stdout:10.20.193.61 trial061.front.sepia.ceph.com trial061
2026-02-19T23:42:35.215 DEBUG:teuthology.orchestra.run.trial061:> sudo hostname trial061
2026-02-19T23:42:35.271 DEBUG:teuthology.orchestra.run.trial102:> sudo sed -i -e 's/trial102.front.sepia.ceph.com/trial102/g' /etc/hosts
2026-02-19T23:42:35.285 DEBUG:teuthology.orchestra.run.trial061:> sudo sed -i -e 's/trial061.front.sepia.ceph.com/trial061/g' /etc/hosts
2026-02-19T23:42:35.335 DEBUG:teuthology.orchestra.run.trial102:> sudo sed -i -e 's/10.20.193.102/10.20.193.102/g' /etc/hosts
2026-02-19T23:42:35.350 DEBUG:teuthology.orchestra.run.trial061:> sudo sed -i -e 's/10.20.193.61/10.20.193.61/g' /etc/hosts
2026-02-19T23:42:35.399 DEBUG:teuthology.orchestra.run.trial102:> sudo sed -i -e 's/trial102.front.sepia.ceph.com/trial102/g' /etc/hostname
2026-02-19T23:42:35.414 DEBUG:teuthology.orchestra.run.trial061:> sudo sed -i -e 's/trial061.front.sepia.ceph.com/trial061/g' /etc/hostname
2026-02-19T23:42:35.464 DEBUG:teuthology.orchestra.run.trial102:> sudo hostname trial102
2026-02-19T23:42:35.478 DEBUG:teuthology.orchestra.run.trial061:> sudo hostname trial061
2026-02-19T23:42:35.527 DEBUG:teuthology.orchestra.run.trial102:> cat /etc/os-release
2026-02-19T23:42:35.541 DEBUG:teuthology.orchestra.run.trial061:> cat /etc/os-release
2026-02-19T23:42:35.583 INFO:teuthology.orchestra.run.trial102.stdout:NAME="CentOS Stream"
2026-02-19T23:42:35.583 INFO:teuthology.orchestra.run.trial102.stdout:VERSION="9"
2026-02-19T23:42:35.583 INFO:teuthology.orchestra.run.trial102.stdout:ID="centos"
2026-02-19T23:42:35.584 INFO:teuthology.orchestra.run.trial102.stdout:ID_LIKE="rhel fedora"
2026-02-19T23:42:35.584 INFO:teuthology.orchestra.run.trial102.stdout:VERSION_ID="9"
2026-02-19T23:42:35.584 INFO:teuthology.orchestra.run.trial102.stdout:PLATFORM_ID="platform:el9"
2026-02-19T23:42:35.584 INFO:teuthology.orchestra.run.trial102.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-19T23:42:35.584 INFO:teuthology.orchestra.run.trial102.stdout:ANSI_COLOR="0;31"
2026-02-19T23:42:35.584 INFO:teuthology.orchestra.run.trial102.stdout:LOGO="fedora-logo-icon"
2026-02-19T23:42:35.584 INFO:teuthology.orchestra.run.trial102.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-19T23:42:35.584 INFO:teuthology.orchestra.run.trial102.stdout:HOME_URL="https://centos.org/"
2026-02-19T23:42:35.584 INFO:teuthology.orchestra.run.trial102.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-19T23:42:35.584 INFO:teuthology.orchestra.run.trial102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-19T23:42:35.584 INFO:teuthology.orchestra.run.trial102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-19T23:42:35.585 INFO:teuthology.provision.fog.trial102:Deploy complete!
2026-02-19T23:42:35.586 DEBUG:teuthology.parallel:result is None
2026-02-19T23:42:35.597 INFO:teuthology.orchestra.run.trial061.stdout:NAME="CentOS Stream"
2026-02-19T23:42:35.598 INFO:teuthology.orchestra.run.trial061.stdout:VERSION="9"
2026-02-19T23:42:35.598 INFO:teuthology.orchestra.run.trial061.stdout:ID="centos"
2026-02-19T23:42:35.598 INFO:teuthology.orchestra.run.trial061.stdout:ID_LIKE="rhel fedora"
2026-02-19T23:42:35.598 INFO:teuthology.orchestra.run.trial061.stdout:VERSION_ID="9"
2026-02-19T23:42:35.598 INFO:teuthology.orchestra.run.trial061.stdout:PLATFORM_ID="platform:el9"
2026-02-19T23:42:35.598 INFO:teuthology.orchestra.run.trial061.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-19T23:42:35.598 INFO:teuthology.orchestra.run.trial061.stdout:ANSI_COLOR="0;31"
2026-02-19T23:42:35.598 INFO:teuthology.orchestra.run.trial061.stdout:LOGO="fedora-logo-icon"
2026-02-19T23:42:35.598 INFO:teuthology.orchestra.run.trial061.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-19T23:42:35.599 INFO:teuthology.orchestra.run.trial061.stdout:HOME_URL="https://centos.org/"
2026-02-19T23:42:35.599 INFO:teuthology.orchestra.run.trial061.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-19T23:42:35.599 INFO:teuthology.orchestra.run.trial061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-19T23:42:35.599 INFO:teuthology.orchestra.run.trial061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-19T23:42:35.599 INFO:teuthology.provision.fog.trial061:Deploy complete!
2026-02-19T23:42:35.600 DEBUG:teuthology.parallel:result is None
2026-02-19T23:42:36.116 INFO:teuthology.lock.ops:Checking trial061.front.sepia.ceph.com
2026-02-19T23:42:36.116 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-19T23:42:36.224 INFO:teuthology.lock.ops:Checking trial102.front.sepia.ceph.com
2026-02-19T23:42:36.224 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-19T23:42:36.296 INFO:teuthology.lock.ops:Checking trial115.front.sepia.ceph.com
2026-02-19T23:42:36.297 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-19T23:42:36.356 INFO:teuthology.lock.ops:Updating [trial061.front.sepia.ceph.com]: set os type and version on server
2026-02-19T23:42:36.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial061.front.sepia.ceph.com'
2026-02-19T23:42:36.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T23:42:36.417 DEBUG:teuthology.orchestra.run.trial061:> true
2026-02-19T23:42:36.492 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial061.front.sepia.ceph.com'
2026-02-19T23:42:36.493 DEBUG:teuthology.orchestra.run.trial061:> uname -m
2026-02-19T23:42:36.548 INFO:teuthology.orchestra.run.trial061.stdout:x86_64
2026-02-19T23:42:36.549 DEBUG:teuthology.orchestra.run.trial061:> cat /etc/os-release
2026-02-19T23:42:36.604 INFO:teuthology.orchestra.run.trial061.stdout:NAME="CentOS Stream"
2026-02-19T23:42:36.605 INFO:teuthology.orchestra.run.trial061.stdout:VERSION="9"
2026-02-19T23:42:36.605 INFO:teuthology.orchestra.run.trial061.stdout:ID="centos"
2026-02-19T23:42:36.605 INFO:teuthology.orchestra.run.trial061.stdout:ID_LIKE="rhel fedora"
2026-02-19T23:42:36.605 INFO:teuthology.orchestra.run.trial061.stdout:VERSION_ID="9"
2026-02-19T23:42:36.605 INFO:teuthology.orchestra.run.trial061.stdout:PLATFORM_ID="platform:el9"
2026-02-19T23:42:36.605 INFO:teuthology.orchestra.run.trial061.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-19T23:42:36.605 INFO:teuthology.orchestra.run.trial061.stdout:ANSI_COLOR="0;31"
2026-02-19T23:42:36.605 INFO:teuthology.orchestra.run.trial061.stdout:LOGO="fedora-logo-icon"
2026-02-19T23:42:36.606 INFO:teuthology.orchestra.run.trial061.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-19T23:42:36.606 INFO:teuthology.orchestra.run.trial061.stdout:HOME_URL="https://centos.org/"
2026-02-19T23:42:36.606 INFO:teuthology.orchestra.run.trial061.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-19T23:42:36.606 INFO:teuthology.orchestra.run.trial061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-19T23:42:36.606 INFO:teuthology.orchestra.run.trial061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-19T23:42:36.607 INFO:teuthology.lock.ops:Updating trial061.front.sepia.ceph.com on lock server
2026-02-19T23:42:36.711 INFO:teuthology.lock.ops:Updating [trial102.front.sepia.ceph.com]: set os type and version on server
2026-02-19T23:42:36.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial102.front.sepia.ceph.com'
2026-02-19T23:42:36.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T23:42:36.780 DEBUG:teuthology.orchestra.run.trial102:> true
2026-02-19T23:42:36.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial102.front.sepia.ceph.com'
2026-02-19T23:42:36.854 DEBUG:teuthology.orchestra.run.trial102:> uname -m
2026-02-19T23:42:36.910 INFO:teuthology.orchestra.run.trial102.stdout:x86_64
2026-02-19T23:42:36.910 DEBUG:teuthology.orchestra.run.trial102:> cat /etc/os-release
2026-02-19T23:42:36.966 INFO:teuthology.orchestra.run.trial102.stdout:NAME="CentOS Stream"
2026-02-19T23:42:36.966 INFO:teuthology.orchestra.run.trial102.stdout:VERSION="9"
2026-02-19T23:42:36.967 INFO:teuthology.orchestra.run.trial102.stdout:ID="centos"
2026-02-19T23:42:36.967 INFO:teuthology.orchestra.run.trial102.stdout:ID_LIKE="rhel fedora"
2026-02-19T23:42:36.967 INFO:teuthology.orchestra.run.trial102.stdout:VERSION_ID="9"
2026-02-19T23:42:36.967 INFO:teuthology.orchestra.run.trial102.stdout:PLATFORM_ID="platform:el9"
2026-02-19T23:42:36.967 INFO:teuthology.orchestra.run.trial102.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-19T23:42:36.967 INFO:teuthology.orchestra.run.trial102.stdout:ANSI_COLOR="0;31"
2026-02-19T23:42:36.967 INFO:teuthology.orchestra.run.trial102.stdout:LOGO="fedora-logo-icon"
2026-02-19T23:42:36.967 INFO:teuthology.orchestra.run.trial102.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-19T23:42:36.967 INFO:teuthology.orchestra.run.trial102.stdout:HOME_URL="https://centos.org/"
2026-02-19T23:42:36.967 INFO:teuthology.orchestra.run.trial102.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-19T23:42:36.967 INFO:teuthology.orchestra.run.trial102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-19T23:42:36.968 INFO:teuthology.orchestra.run.trial102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-19T23:42:36.968 INFO:teuthology.lock.ops:Updating trial102.front.sepia.ceph.com on lock server
2026-02-19T23:42:37.064 INFO:teuthology.lock.ops:Updating [trial115.front.sepia.ceph.com]: set os type and version on server
2026-02-19T23:42:37.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial115.front.sepia.ceph.com'
2026-02-19T23:42:37.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T23:42:37.131 DEBUG:teuthology.orchestra.run.trial115:> true
2026-02-19T23:42:37.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial115.front.sepia.ceph.com'
2026-02-19T23:42:37.206 DEBUG:teuthology.orchestra.run.trial115:> uname -m
2026-02-19T23:42:37.262 INFO:teuthology.orchestra.run.trial115.stdout:x86_64
2026-02-19T23:42:37.263 DEBUG:teuthology.orchestra.run.trial115:> cat /etc/os-release
2026-02-19T23:42:37.320 INFO:teuthology.orchestra.run.trial115.stdout:NAME="CentOS Stream"
2026-02-19T23:42:37.320 INFO:teuthology.orchestra.run.trial115.stdout:VERSION="9"
2026-02-19T23:42:37.320 INFO:teuthology.orchestra.run.trial115.stdout:ID="centos"
2026-02-19T23:42:37.320 INFO:teuthology.orchestra.run.trial115.stdout:ID_LIKE="rhel fedora"
2026-02-19T23:42:37.320 INFO:teuthology.orchestra.run.trial115.stdout:VERSION_ID="9"
2026-02-19T23:42:37.320 INFO:teuthology.orchestra.run.trial115.stdout:PLATFORM_ID="platform:el9"
2026-02-19T23:42:37.320 INFO:teuthology.orchestra.run.trial115.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-19T23:42:37.320 INFO:teuthology.orchestra.run.trial115.stdout:ANSI_COLOR="0;31"
2026-02-19T23:42:37.320 INFO:teuthology.orchestra.run.trial115.stdout:LOGO="fedora-logo-icon"
2026-02-19T23:42:37.321 INFO:teuthology.orchestra.run.trial115.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-19T23:42:37.321 INFO:teuthology.orchestra.run.trial115.stdout:HOME_URL="https://centos.org/"
2026-02-19T23:42:37.321 INFO:teuthology.orchestra.run.trial115.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-19T23:42:37.321 INFO:teuthology.orchestra.run.trial115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-19T23:42:37.321 INFO:teuthology.orchestra.run.trial115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-19T23:42:37.322 INFO:teuthology.lock.ops:Updating trial115.front.sepia.ceph.com on lock server
2026-02-19T23:42:37.388 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:42:37.480 INFO:teuthology.dispatcher.supervisor:Running job 55069
2026-02-19T23:42:37.480 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_jcollin@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_23:11:18-fs-wip-jcollin-testing-20260217.130836-squid-distro-default-trial/55069 --name jcollin-2026-02-17_23:11:18-fs-wip-jcollin-testing-20260217.130836-squid-distro-default-trial --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/fsx}} -- /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_23:11:18-fs-wip-jcollin-testing-20260217.130836-squid-distro-default-trial/55069/orig.config.yaml
2026-02-19T23:42:37.480 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_23:11:18-fs-wip-jcollin-testing-20260217.130836-squid-distro-default-trial/55069
2026-02-19T23:42:37.480 INFO:teuthology.dispatcher.supervisor:Job PID: 2791717
2026-02-19T23:42:37.480 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-19T23:44:37.481 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:46:37.589 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:48:37.708 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:50:37.816 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:52:37.920 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:54:38.043 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:56:38.122 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:58:38.243 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T00:00:38.370 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T00:02:38.492 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T00:04:38.612 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T00:06:38.741 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T00:06:38.814 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-20T00:06:38.992 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-20T00:06:39.732 INFO:teuthology.orchestra.console.trial102:Power off
2026-02-20T00:06:39.732 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T00:06:39.748 INFO:teuthology.orchestra.console.trial115:Power off
2026-02-20T00:06:39.748 DEBUG:teuthology.orchestra.console.trial115:pexpect command: ipmitool -H trial115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T00:06:39.759 INFO:teuthology.orchestra.console.trial061:Power off
2026-02-20T00:06:39.759 DEBUG:teuthology.orchestra.console.trial061:pexpect command: ipmitool -H trial061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T00:06:39.776 DEBUG:teuthology.orchestra.console.trial102:power off output: Chassis Power Control: Down/Off
2026-02-20T00:06:39.790 DEBUG:teuthology.orchestra.console.trial115:power off output: Chassis Power Control: Down/Off
2026-02-20T00:06:39.805 DEBUG:teuthology.orchestra.console.trial061:power off output: Chassis Power Control: Down/Off
2026-02-20T00:06:43.777 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T00:06:43.791 DEBUG:teuthology.orchestra.console.trial115:pexpect command: ipmitool -H trial115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T00:06:43.805 DEBUG:teuthology.orchestra.console.trial061:pexpect command: ipmitool -H trial061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T00:06:43.886 DEBUG:teuthology.orchestra.console.trial102:check power output: Chassis Power is on
2026-02-20T00:06:43.899 DEBUG:teuthology.orchestra.console.trial115:check power output: Chassis Power is on
2026-02-20T00:06:43.914 DEBUG:teuthology.orchestra.console.trial061:check power output: Chassis Power is on
2026-02-20T00:06:47.887 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T00:06:47.900 DEBUG:teuthology.orchestra.console.trial115:pexpect command: ipmitool -H trial115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T00:06:47.914 DEBUG:teuthology.orchestra.console.trial061:pexpect command: ipmitool -H trial061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T00:06:47.998 DEBUG:teuthology.orchestra.console.trial102:check power output: Chassis Power is off
2026-02-20T00:06:47.999 INFO:teuthology.orchestra.console.trial102:Power off completed
2026-02-20T00:06:48.008 DEBUG:teuthology.orchestra.console.trial115:check power output: Chassis Power is off
2026-02-20T00:06:48.009 INFO:teuthology.orchestra.console.trial115:Power off completed
2026-02-20T00:06:48.024 DEBUG:teuthology.orchestra.console.trial061:check power output: Chassis Power is off
2026-02-20T00:06:48.024 INFO:teuthology.orchestra.console.trial061:Power off completed
2026-02-20T00:06:48.299 INFO:teuthology.lock.ops:unlocked: trial102.front.sepia.ceph.com
2026-02-20T00:06:48.308 INFO:teuthology.lock.ops:unlocked: trial115.front.sepia.ceph.com
2026-02-20T00:06:48.312 INFO:teuthology.lock.ops:unlocked: trial061.front.sepia.ceph.com