2026-02-23T13:20:48.565 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-23T13:20:48.565 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:20:48.636 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:20:48.829 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x79512a246030>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x795129a7f920>, signals=[15])
2026-02-23T13:20:48.829 INFO:teuthology.lock.ops:Start node 'trial006.front.sepia.ceph.com' reimaging
2026-02-23T13:20:48.829 INFO:teuthology.lock.ops:Updating [trial006.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T13:20:48.829 INFO:teuthology.lock.ops:Updating trial006.front.sepia.ceph.com on lock server
2026-02-23T13:20:48.888 INFO:teuthology.lock.ops:Start node 'trial198.front.sepia.ceph.com' reimaging
2026-02-23T13:20:48.888 INFO:teuthology.lock.ops:Updating [trial198.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T13:20:48.888 INFO:teuthology.lock.ops:Updating trial198.front.sepia.ceph.com on lock server
2026-02-23T13:20:49.121 DEBUG:teuthology.provision.fog.trial006:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T13:20:49.129 DEBUG:teuthology.provision.fog.trial198:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T13:20:49.172 INFO:teuthology.provision.fog.trial006:Scheduling deploy of centos 9.stream
2026-02-23T13:20:49.182 INFO:teuthology.provision.fog.trial198:Scheduling deploy of centos 9.stream
2026-02-23T13:20:50.647 INFO:teuthology.orchestra.console.trial198:Power off
2026-02-23T13:20:50.647 DEBUG:teuthology.orchestra.console.trial198:pexpect command: ipmitool -H trial198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T13:20:50.657 INFO:teuthology.orchestra.console.trial006:Power off
2026-02-23T13:20:50.657 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T13:20:50.686 DEBUG:teuthology.orchestra.console.trial198:power off output: Chassis Power Control: Down/Off
2026-02-23T13:20:50.696 DEBUG:teuthology.orchestra.console.trial006:power off output: Chassis Power Control: Down/Off
2026-02-23T13:20:54.690 DEBUG:teuthology.orchestra.console.trial198:pexpect command: ipmitool -H trial198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T13:20:54.699 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T13:20:54.802 DEBUG:teuthology.orchestra.console.trial198:check power output: Chassis Power is off
2026-02-23T13:20:54.802 INFO:teuthology.orchestra.console.trial198:Power off completed
2026-02-23T13:20:54.808 DEBUG:teuthology.orchestra.console.trial006:check power output: Chassis Power is off
2026-02-23T13:20:54.808 INFO:teuthology.orchestra.console.trial006:Power off completed
2026-02-23T13:20:54.903 INFO:teuthology.orchestra.console.trial198:Power on
2026-02-23T13:20:54.904 DEBUG:teuthology.orchestra.console.trial198:pexpect command: ipmitool -H trial198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T13:20:54.912 INFO:teuthology.orchestra.console.trial006:Power on
2026-02-23T13:20:54.912 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T13:20:54.945 DEBUG:teuthology.orchestra.console.trial198:power on output: Chassis Power Control: Up/On
2026-02-23T13:20:54.953 DEBUG:teuthology.orchestra.console.trial006:power on output: Chassis Power Control: Up/On
2026-02-23T13:20:58.949 DEBUG:teuthology.orchestra.console.trial198:pexpect command: ipmitool -H trial198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T13:20:58.958 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T13:20:59.060 DEBUG:teuthology.orchestra.console.trial198:check power output: Chassis Power is on
2026-02-23T13:20:59.061 INFO:teuthology.orchestra.console.trial198:Power on completed
2026-02-23T13:20:59.068 DEBUG:teuthology.orchestra.console.trial006:check power output: Chassis Power is on
2026-02-23T13:20:59.068 INFO:teuthology.orchestra.console.trial006:Power on completed
2026-02-23T13:20:59.162 INFO:teuthology.provision.fog.trial198:Waiting for deploy to finish
2026-02-23T13:20:59.169 INFO:teuthology.provision.fog.trial006:Waiting for deploy to finish
2026-02-23T13:22:46.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T13:22:47.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T13:23:46.916 WARNING:teuthology.provision.fog.trial198:timed out
2026-02-23T13:23:47.048 WARNING:teuthology.provision.fog.trial006:timed out
2026-02-23T13:23:52.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T13:23:53.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T13:23:58.367 ERROR:teuthology.orchestra.connection:Error authenticating with trial006.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-23T13:24:00.235 ERROR:teuthology.orchestra.connection:Error authenticating with trial198.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-23T13:24:02.519 ERROR:teuthology.orchestra.connection:Error authenticating with trial006.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-23T13:24:04.316 ERROR:teuthology.orchestra.connection:Error authenticating with trial198.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-23T13:24:09.632 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T13:24:09.633 DEBUG:teuthology.orchestra.run.trial006:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T13:24:09.794 INFO:teuthology.provision.fog.trial006:Node is ready
2026-02-23T13:24:09.794 DEBUG:teuthology.orchestra.run.trial006:> hostname
2026-02-23T13:24:09.846 INFO:teuthology.orchestra.run.trial006.stdout:trial006.front.sepia.ceph.com
2026-02-23T13:24:09.847 DEBUG:teuthology.orchestra.run.trial006:> grep trial006.front.sepia.ceph.com /etc/hosts
2026-02-23T13:24:09.900 INFO:teuthology.orchestra.run.trial006.stdout:10.20.193.6 trial006.front.sepia.ceph.com trial006
2026-02-23T13:24:09.900 DEBUG:teuthology.orchestra.run.trial006:> sudo hostname trial006
2026-02-23T13:24:09.969 DEBUG:teuthology.orchestra.run.trial006:> sudo sed -i -e 's/trial006.front.sepia.ceph.com/trial006/g' /etc/hosts
2026-02-23T13:24:10.033 DEBUG:teuthology.orchestra.run.trial006:> sudo sed -i -e 's/10.20.193.6/10.20.193.6/g' /etc/hosts
2026-02-23T13:24:10.096 DEBUG:teuthology.orchestra.run.trial006:> sudo sed -i -e 's/trial006.front.sepia.ceph.com/trial006/g' /etc/hostname
2026-02-23T13:24:10.159 DEBUG:teuthology.orchestra.run.trial006:> sudo hostname trial006
2026-02-23T13:24:10.220 DEBUG:teuthology.orchestra.run.trial006:> cat /etc/os-release
2026-02-23T13:24:10.273 INFO:teuthology.orchestra.run.trial006.stdout:NAME="CentOS Stream"
2026-02-23T13:24:10.273 INFO:teuthology.orchestra.run.trial006.stdout:VERSION="9"
2026-02-23T13:24:10.273 INFO:teuthology.orchestra.run.trial006.stdout:ID="centos"
2026-02-23T13:24:10.273 INFO:teuthology.orchestra.run.trial006.stdout:ID_LIKE="rhel fedora"
2026-02-23T13:24:10.273 INFO:teuthology.orchestra.run.trial006.stdout:VERSION_ID="9"
2026-02-23T13:24:10.273 INFO:teuthology.orchestra.run.trial006.stdout:PLATFORM_ID="platform:el9"
2026-02-23T13:24:10.273 INFO:teuthology.orchestra.run.trial006.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T13:24:10.273 INFO:teuthology.orchestra.run.trial006.stdout:ANSI_COLOR="0;31"
2026-02-23T13:24:10.274 INFO:teuthology.orchestra.run.trial006.stdout:LOGO="fedora-logo-icon"
2026-02-23T13:24:10.274 INFO:teuthology.orchestra.run.trial006.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T13:24:10.274 INFO:teuthology.orchestra.run.trial006.stdout:HOME_URL="https://centos.org/"
2026-02-23T13:24:10.274 INFO:teuthology.orchestra.run.trial006.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T13:24:10.274 INFO:teuthology.orchestra.run.trial006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T13:24:10.274 INFO:teuthology.orchestra.run.trial006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T13:24:10.275 INFO:teuthology.provision.fog.trial006:Deploy complete!
2026-02-23T13:24:10.276 DEBUG:teuthology.parallel:result is None
2026-02-23T13:24:11.409 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T13:24:11.409 DEBUG:teuthology.orchestra.run.trial198:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T13:24:11.564 INFO:teuthology.provision.fog.trial198:Node is ready
2026-02-23T13:24:11.564 DEBUG:teuthology.orchestra.run.trial198:> hostname
2026-02-23T13:24:11.619 INFO:teuthology.orchestra.run.trial198.stdout:trial198.front.sepia.ceph.com
2026-02-23T13:24:11.619 DEBUG:teuthology.orchestra.run.trial198:> grep trial198.front.sepia.ceph.com /etc/hosts
2026-02-23T13:24:11.676 INFO:teuthology.orchestra.run.trial198.stdout:10.20.193.198 trial198.front.sepia.ceph.com trial198
2026-02-23T13:24:11.676 DEBUG:teuthology.orchestra.run.trial198:> sudo hostname trial198
2026-02-23T13:24:11.746 DEBUG:teuthology.orchestra.run.trial198:> sudo sed -i -e 's/trial198.front.sepia.ceph.com/trial198/g' /etc/hosts
2026-02-23T13:24:11.810 DEBUG:teuthology.orchestra.run.trial198:> sudo sed -i -e 's/10.20.193.198/10.20.193.198/g' /etc/hosts
2026-02-23T13:24:11.876 DEBUG:teuthology.orchestra.run.trial198:> sudo sed -i -e 's/trial198.front.sepia.ceph.com/trial198/g' /etc/hostname
2026-02-23T13:24:11.941 DEBUG:teuthology.orchestra.run.trial198:> sudo hostname trial198
2026-02-23T13:24:12.005 DEBUG:teuthology.orchestra.run.trial198:> cat /etc/os-release
2026-02-23T13:24:12.061 INFO:teuthology.orchestra.run.trial198.stdout:NAME="CentOS Stream"
2026-02-23T13:24:12.061 INFO:teuthology.orchestra.run.trial198.stdout:VERSION="9"
2026-02-23T13:24:12.062 INFO:teuthology.orchestra.run.trial198.stdout:ID="centos"
2026-02-23T13:24:12.062 INFO:teuthology.orchestra.run.trial198.stdout:ID_LIKE="rhel fedora"
2026-02-23T13:24:12.062 INFO:teuthology.orchestra.run.trial198.stdout:VERSION_ID="9"
2026-02-23T13:24:12.062 INFO:teuthology.orchestra.run.trial198.stdout:PLATFORM_ID="platform:el9"
2026-02-23T13:24:12.062 INFO:teuthology.orchestra.run.trial198.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T13:24:12.062 INFO:teuthology.orchestra.run.trial198.stdout:ANSI_COLOR="0;31"
2026-02-23T13:24:12.062 INFO:teuthology.orchestra.run.trial198.stdout:LOGO="fedora-logo-icon"
2026-02-23T13:24:12.062 INFO:teuthology.orchestra.run.trial198.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T13:24:12.062 INFO:teuthology.orchestra.run.trial198.stdout:HOME_URL="https://centos.org/"
2026-02-23T13:24:12.062 INFO:teuthology.orchestra.run.trial198.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T13:24:12.063 INFO:teuthology.orchestra.run.trial198.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T13:24:12.063 INFO:teuthology.orchestra.run.trial198.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T13:24:12.063 INFO:teuthology.provision.fog.trial198:Deploy complete!
2026-02-23T13:24:12.064 DEBUG:teuthology.parallel:result is None
2026-02-23T13:24:12.479 INFO:teuthology.lock.ops:Checking trial006.front.sepia.ceph.com
2026-02-23T13:24:12.480 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T13:24:12.553 INFO:teuthology.lock.ops:Checking trial198.front.sepia.ceph.com
2026-02-23T13:24:12.553 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T13:24:12.609 INFO:teuthology.lock.ops:Updating [trial006.front.sepia.ceph.com]: set os type and version on server
2026-02-23T13:24:12.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial006.front.sepia.ceph.com'
2026-02-23T13:24:12.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T13:24:12.673 DEBUG:teuthology.orchestra.run.trial006:> true
2026-02-23T13:24:12.750 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial006.front.sepia.ceph.com'
2026-02-23T13:24:12.750 DEBUG:teuthology.orchestra.run.trial006:> uname -m
2026-02-23T13:24:12.807 INFO:teuthology.orchestra.run.trial006.stdout:x86_64
2026-02-23T13:24:12.807 DEBUG:teuthology.orchestra.run.trial006:> cat /etc/os-release
2026-02-23T13:24:12.863 INFO:teuthology.orchestra.run.trial006.stdout:NAME="CentOS Stream"
2026-02-23T13:24:12.863 INFO:teuthology.orchestra.run.trial006.stdout:VERSION="9"
2026-02-23T13:24:12.863 INFO:teuthology.orchestra.run.trial006.stdout:ID="centos"
2026-02-23T13:24:12.864 INFO:teuthology.orchestra.run.trial006.stdout:ID_LIKE="rhel fedora"
2026-02-23T13:24:12.864 INFO:teuthology.orchestra.run.trial006.stdout:VERSION_ID="9"
2026-02-23T13:24:12.864 INFO:teuthology.orchestra.run.trial006.stdout:PLATFORM_ID="platform:el9"
2026-02-23T13:24:12.864 INFO:teuthology.orchestra.run.trial006.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T13:24:12.864 INFO:teuthology.orchestra.run.trial006.stdout:ANSI_COLOR="0;31"
2026-02-23T13:24:12.864 INFO:teuthology.orchestra.run.trial006.stdout:LOGO="fedora-logo-icon"
2026-02-23T13:24:12.864 INFO:teuthology.orchestra.run.trial006.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T13:24:12.864 INFO:teuthology.orchestra.run.trial006.stdout:HOME_URL="https://centos.org/"
2026-02-23T13:24:12.864 INFO:teuthology.orchestra.run.trial006.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T13:24:12.864 INFO:teuthology.orchestra.run.trial006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T13:24:12.864 INFO:teuthology.orchestra.run.trial006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T13:24:12.865 INFO:teuthology.lock.ops:Updating trial006.front.sepia.ceph.com on lock server
2026-02-23T13:24:12.964 INFO:teuthology.lock.ops:Updating [trial198.front.sepia.ceph.com]: set os type and version on server
2026-02-23T13:24:12.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial198.front.sepia.ceph.com'
2026-02-23T13:24:12.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T13:24:13.030 DEBUG:teuthology.orchestra.run.trial198:> true
2026-02-23T13:24:13.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial198.front.sepia.ceph.com'
2026-02-23T13:24:13.104 DEBUG:teuthology.orchestra.run.trial198:> uname -m
2026-02-23T13:24:13.161 INFO:teuthology.orchestra.run.trial198.stdout:x86_64
2026-02-23T13:24:13.162 DEBUG:teuthology.orchestra.run.trial198:> cat /etc/os-release
2026-02-23T13:24:13.217 INFO:teuthology.orchestra.run.trial198.stdout:NAME="CentOS Stream"
2026-02-23T13:24:13.217 INFO:teuthology.orchestra.run.trial198.stdout:VERSION="9"
2026-02-23T13:24:13.218 INFO:teuthology.orchestra.run.trial198.stdout:ID="centos"
2026-02-23T13:24:13.218 INFO:teuthology.orchestra.run.trial198.stdout:ID_LIKE="rhel fedora"
2026-02-23T13:24:13.218 INFO:teuthology.orchestra.run.trial198.stdout:VERSION_ID="9"
2026-02-23T13:24:13.218 INFO:teuthology.orchestra.run.trial198.stdout:PLATFORM_ID="platform:el9"
2026-02-23T13:24:13.218 INFO:teuthology.orchestra.run.trial198.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T13:24:13.218 INFO:teuthology.orchestra.run.trial198.stdout:ANSI_COLOR="0;31"
2026-02-23T13:24:13.218 INFO:teuthology.orchestra.run.trial198.stdout:LOGO="fedora-logo-icon"
2026-02-23T13:24:13.218 INFO:teuthology.orchestra.run.trial198.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T13:24:13.218 INFO:teuthology.orchestra.run.trial198.stdout:HOME_URL="https://centos.org/"
2026-02-23T13:24:13.218 INFO:teuthology.orchestra.run.trial198.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T13:24:13.218 INFO:teuthology.orchestra.run.trial198.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T13:24:13.219 INFO:teuthology.orchestra.run.trial198.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T13:24:13.219 INFO:teuthology.lock.ops:Updating trial198.front.sepia.ceph.com on lock server
2026-02-23T13:24:13.326 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:24:13.423 INFO:teuthology.dispatcher.supervisor:Running job 66512
2026-02-23T13:24:13.423 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_shraddhaag@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66512 --name shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/cephadm objectstore/crimson_bluestore thrashers/{default} thrashosds-health workloads/snaps-few-objects-localized} -- /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66512/orig.config.yaml
2026-02-23T13:24:13.423 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66512
2026-02-23T13:24:13.423 INFO:teuthology.dispatcher.supervisor:Job PID: 835169
2026-02-23T13:24:13.424 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-23T13:26:13.503 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:28:13.692 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:30:13.878 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:32:14.206 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:34:14.403 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:36:14.613 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:38:14.806 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:40:14.981 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:42:15.178 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:44:15.379 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:46:15.560 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:48:15.772 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:50:15.952 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:52:16.049 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:54:16.222 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:56:16.403 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:58:16.589 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:00:16.746 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:02:16.945 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:04:17.040 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:06:17.189 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:08:17.308 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:10:17.496 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:12:17.695 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:14:17.884 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:16:18.053 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:18:18.459 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:20:18.574 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:22:18.744 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:24:18.878 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:26:19.036 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:28:19.233 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:30:19.403 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:32:19.607 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:34:19.794 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:36:20.138 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:38:20.315 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:40:20.412 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:42:20.592 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:44:20.701 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:46:20.874 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:48:20.988 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:50:21.134 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:52:21.323 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:54:21.463 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:56:21.623 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:58:21.800 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:00:21.956 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:02:22.133 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:04:22.318 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:06:22.433 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:08:22.624 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:10:22.824 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:12:23.049 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:14:23.258 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:16:23.393 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:18:23.602 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:20:23.825 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:22:24.001 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:24:24.142 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:26:24.345 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:28:24.568 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:30:24.789 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:32:24.970 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:34:25.154 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:36:25.363 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:38:25.535 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:40:25.728 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:42:25.956 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:44:26.153 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:46:26.363 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:48:26.575 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:50:26.775 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:52:26.967 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:54:27.140 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:56:27.314 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:58:27.503 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:00:27.614 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:02:27.819 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:04:28.008 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:06:28.133 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:08:28.338 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:10:28.547 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:12:28.735 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:14:33.869 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:16:34.025 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:18:34.234 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:20:34.405 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:22:34.614 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:24:34.812 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:24:34.896 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2026-02-23T16:24:35.007 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-23T16:24:35.536 INFO:teuthology.orchestra.console.trial006:Power off
2026-02-23T16:24:35.536 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T16:24:35.642 DEBUG:teuthology.orchestra.console.trial006:power off output: Chassis Power Control: Down/Off
2026-02-23T16:24:35.749 INFO:teuthology.orchestra.console.trial198:Power off
2026-02-23T16:24:35.749 DEBUG:teuthology.orchestra.console.trial198:pexpect command: ipmitool -H trial198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T16:24:35.804 DEBUG:teuthology.orchestra.console.trial198:power off output: Chassis Power Control: Down/Off
2026-02-23T16:24:39.647 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T16:24:39.754 DEBUG:teuthology.orchestra.console.trial006:check power output: Chassis Power is on
2026-02-23T16:24:39.804 DEBUG:teuthology.orchestra.console.trial198:pexpect command: ipmitool -H trial198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T16:24:39.909 DEBUG:teuthology.orchestra.console.trial198:check power output: Chassis Power is on
2026-02-23T16:24:43.756 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T16:24:43.865 DEBUG:teuthology.orchestra.console.trial006:check power output: Chassis Power is off
2026-02-23T16:24:43.866 INFO:teuthology.orchestra.console.trial006:Power off completed
2026-02-23T16:24:43.910 DEBUG:teuthology.orchestra.console.trial198:pexpect command: ipmitool -H trial198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T16:24:44.063 DEBUG:teuthology.orchestra.console.trial198:check power output: Chassis Power is on
2026-02-23T16:24:44.068 ERROR:teuthology.lock.ops:failed to unlock trial006.front.sepia.ceph.com. reason: Cannot unlock an already-unlocked node
2026-02-23T16:24:48.068 DEBUG:teuthology.orchestra.console.trial198:pexpect command: ipmitool -H trial198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T16:24:48.175 DEBUG:teuthology.orchestra.console.trial198:check power output: Chassis Power is off
2026-02-23T16:24:48.175 INFO:teuthology.orchestra.console.trial198:Power off completed
2026-02-23T16:24:48.378 ERROR:teuthology.lock.ops:failed to unlock trial198.front.sepia.ceph.com. reason: Cannot unlock an already-unlocked node
2026-02-23T16:24:48.379 DEBUG:teuthology.parallel:result is False