2026-02-23T10:44:30.471 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-23T10:44:30.471 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:44:30.542 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:44:30.734 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7c2950fab290>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7c295078da80>, signals=[15])
2026-02-23T10:44:30.734 INFO:teuthology.lock.ops:Start node 'trial030.front.sepia.ceph.com' reimaging
2026-02-23T10:44:30.734 INFO:teuthology.lock.ops:Updating [trial030.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T10:44:30.734 INFO:teuthology.lock.ops:Updating trial030.front.sepia.ceph.com on lock server
2026-02-23T10:44:30.791 INFO:teuthology.lock.ops:Start node 'trial121.front.sepia.ceph.com' reimaging
2026-02-23T10:44:30.791 INFO:teuthology.lock.ops:Updating [trial121.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T10:44:30.791 INFO:teuthology.lock.ops:Updating trial121.front.sepia.ceph.com on lock server
2026-02-23T10:44:31.017 DEBUG:teuthology.provision.fog.trial030:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T10:44:31.031 DEBUG:teuthology.provision.fog.trial121:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T10:44:31.069 INFO:teuthology.provision.fog.trial030:Scheduling deploy of centos 9.stream
2026-02-23T10:44:31.082 INFO:teuthology.provision.fog.trial121:Scheduling deploy of centos 9.stream
2026-02-23T10:44:32.671 INFO:teuthology.orchestra.console.trial121:Power off
2026-02-23T10:44:32.672 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T10:44:32.709 DEBUG:teuthology.orchestra.console.trial121:power off output: Chassis Power Control: Down/Off
2026-02-23T10:44:32.819 INFO:teuthology.orchestra.console.trial030:Power off
2026-02-23T10:44:32.819 DEBUG:teuthology.orchestra.console.trial030:pexpect command: ipmitool -H trial030.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T10:44:32.857 DEBUG:teuthology.orchestra.console.trial030:power off output: Chassis Power Control: Down/Off
2026-02-23T10:44:36.714 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T10:44:36.824 DEBUG:teuthology.orchestra.console.trial121:check power output: Chassis Power is off
2026-02-23T10:44:36.824 INFO:teuthology.orchestra.console.trial121:Power off completed
2026-02-23T10:44:36.858 DEBUG:teuthology.orchestra.console.trial030:pexpect command: ipmitool -H trial030.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T10:44:36.926 INFO:teuthology.orchestra.console.trial121:Power on
2026-02-23T10:44:36.926 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T10:44:36.966 DEBUG:teuthology.orchestra.console.trial121:power on output: Chassis Power Control: Up/On
2026-02-23T10:44:36.969 DEBUG:teuthology.orchestra.console.trial030:check power output: Chassis Power is off
2026-02-23T10:44:36.970 INFO:teuthology.orchestra.console.trial030:Power off completed
2026-02-23T10:44:37.071 INFO:teuthology.orchestra.console.trial030:Power on
2026-02-23T10:44:37.071 DEBUG:teuthology.orchestra.console.trial030:pexpect command: ipmitool -H trial030.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T10:44:37.111 DEBUG:teuthology.orchestra.console.trial030:power on output: Chassis Power Control: Up/On
2026-02-23T10:44:40.971 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T10:44:41.081 DEBUG:teuthology.orchestra.console.trial121:check power output: Chassis Power is on
2026-02-23T10:44:41.082 INFO:teuthology.orchestra.console.trial121:Power on completed
2026-02-23T10:44:41.112 DEBUG:teuthology.orchestra.console.trial030:pexpect command: ipmitool -H trial030.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T10:44:41.183 INFO:teuthology.provision.fog.trial121:Waiting for deploy to finish
2026-02-23T10:44:41.222 DEBUG:teuthology.orchestra.console.trial030:check power output: Chassis Power is on
2026-02-23T10:44:41.222 INFO:teuthology.orchestra.console.trial030:Power on completed
2026-02-23T10:44:41.322 INFO:teuthology.provision.fog.trial030:Waiting for deploy to finish
2026-02-23T10:46:29.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T10:46:29.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial030.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T10:46:29.233 ERROR:teuthology.orchestra.connection:Error authenticating with trial030.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-23T10:47:29.119 WARNING:teuthology.provision.fog.trial121:timed out
2026-02-23T10:47:33.235 WARNING:teuthology.provision.fog.trial030:timed out
2026-02-23T10:47:35.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T10:47:39.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial030.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T10:47:42.625 ERROR:teuthology.orchestra.connection:Error authenticating with trial121.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-23T10:47:46.570 ERROR:teuthology.orchestra.connection:Error authenticating with trial030.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-23T10:47:46.728 ERROR:teuthology.orchestra.connection:Error authenticating with trial121.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-23T10:47:50.694 ERROR:teuthology.orchestra.connection:Error authenticating with trial030.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-23T10:47:53.811 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T10:47:53.811 DEBUG:teuthology.orchestra.run.trial121:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T10:47:53.975 INFO:teuthology.provision.fog.trial121:Node is ready
2026-02-23T10:47:53.975 DEBUG:teuthology.orchestra.run.trial121:> hostname
2026-02-23T10:47:54.031 INFO:teuthology.orchestra.run.trial121.stdout:trial121.front.sepia.ceph.com
2026-02-23T10:47:54.032 DEBUG:teuthology.orchestra.run.trial121:> grep trial121.front.sepia.ceph.com /etc/hosts
2026-02-23T10:47:54.088 INFO:teuthology.orchestra.run.trial121.stdout:10.20.193.121 trial121.front.sepia.ceph.com trial121
2026-02-23T10:47:54.089 DEBUG:teuthology.orchestra.run.trial121:> sudo hostname trial121
2026-02-23T10:47:54.158 DEBUG:teuthology.orchestra.run.trial121:> sudo sed -i -e 's/trial121.front.sepia.ceph.com/trial121/g' /etc/hosts
2026-02-23T10:47:54.222 DEBUG:teuthology.orchestra.run.trial121:> sudo sed -i -e 's/10.20.193.121/10.20.193.121/g' /etc/hosts
2026-02-23T10:47:54.288 DEBUG:teuthology.orchestra.run.trial121:> sudo sed -i -e 's/trial121.front.sepia.ceph.com/trial121/g' /etc/hostname
2026-02-23T10:47:54.352 DEBUG:teuthology.orchestra.run.trial121:> sudo hostname trial121
2026-02-23T10:47:54.416 DEBUG:teuthology.orchestra.run.trial121:> cat /etc/os-release
2026-02-23T10:47:54.472 INFO:teuthology.orchestra.run.trial121.stdout:NAME="CentOS Stream"
2026-02-23T10:47:54.473 INFO:teuthology.orchestra.run.trial121.stdout:VERSION="9"
2026-02-23T10:47:54.473 INFO:teuthology.orchestra.run.trial121.stdout:ID="centos"
2026-02-23T10:47:54.473 INFO:teuthology.orchestra.run.trial121.stdout:ID_LIKE="rhel fedora"
2026-02-23T10:47:54.473 INFO:teuthology.orchestra.run.trial121.stdout:VERSION_ID="9"
2026-02-23T10:47:54.473 INFO:teuthology.orchestra.run.trial121.stdout:PLATFORM_ID="platform:el9"
2026-02-23T10:47:54.473 INFO:teuthology.orchestra.run.trial121.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T10:47:54.473 INFO:teuthology.orchestra.run.trial121.stdout:ANSI_COLOR="0;31"
2026-02-23T10:47:54.473 INFO:teuthology.orchestra.run.trial121.stdout:LOGO="fedora-logo-icon"
2026-02-23T10:47:54.473 INFO:teuthology.orchestra.run.trial121.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T10:47:54.473 INFO:teuthology.orchestra.run.trial121.stdout:HOME_URL="https://centos.org/"
2026-02-23T10:47:54.474 INFO:teuthology.orchestra.run.trial121.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T10:47:54.474 INFO:teuthology.orchestra.run.trial121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T10:47:54.474 INFO:teuthology.orchestra.run.trial121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T10:47:54.475 INFO:teuthology.provision.fog.trial121:Deploy complete!
2026-02-23T10:47:54.476 DEBUG:teuthology.parallel:result is None
2026-02-23T10:47:57.806 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T10:47:57.807 DEBUG:teuthology.orchestra.run.trial030:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T10:47:57.967 INFO:teuthology.provision.fog.trial030:Node is ready
2026-02-23T10:47:57.968 DEBUG:teuthology.orchestra.run.trial030:> hostname
2026-02-23T10:47:58.024 INFO:teuthology.orchestra.run.trial030.stdout:trial030.front.sepia.ceph.com
2026-02-23T10:47:58.024 DEBUG:teuthology.orchestra.run.trial030:> grep trial030.front.sepia.ceph.com /etc/hosts
2026-02-23T10:47:58.080 INFO:teuthology.orchestra.run.trial030.stdout:10.20.193.30 trial030.front.sepia.ceph.com trial030
2026-02-23T10:47:58.080 DEBUG:teuthology.orchestra.run.trial030:> sudo hostname trial030
2026-02-23T10:47:58.149 DEBUG:teuthology.orchestra.run.trial030:> sudo sed -i -e 's/trial030.front.sepia.ceph.com/trial030/g' /etc/hosts
2026-02-23T10:47:58.214 DEBUG:teuthology.orchestra.run.trial030:> sudo sed -i -e 's/10.20.193.30/10.20.193.30/g' /etc/hosts
2026-02-23T10:47:58.279 DEBUG:teuthology.orchestra.run.trial030:> sudo sed -i -e 's/trial030.front.sepia.ceph.com/trial030/g' /etc/hostname
2026-02-23T10:47:58.343 DEBUG:teuthology.orchestra.run.trial030:> sudo hostname trial030
2026-02-23T10:47:58.406 DEBUG:teuthology.orchestra.run.trial030:> cat /etc/os-release
2026-02-23T10:47:58.463 INFO:teuthology.orchestra.run.trial030.stdout:NAME="CentOS Stream"
2026-02-23T10:47:58.463 INFO:teuthology.orchestra.run.trial030.stdout:VERSION="9"
2026-02-23T10:47:58.463 INFO:teuthology.orchestra.run.trial030.stdout:ID="centos"
2026-02-23T10:47:58.463 INFO:teuthology.orchestra.run.trial030.stdout:ID_LIKE="rhel fedora"
2026-02-23T10:47:58.463 INFO:teuthology.orchestra.run.trial030.stdout:VERSION_ID="9"
2026-02-23T10:47:58.464 INFO:teuthology.orchestra.run.trial030.stdout:PLATFORM_ID="platform:el9"
2026-02-23T10:47:58.464 INFO:teuthology.orchestra.run.trial030.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T10:47:58.464 INFO:teuthology.orchestra.run.trial030.stdout:ANSI_COLOR="0;31"
2026-02-23T10:47:58.464 INFO:teuthology.orchestra.run.trial030.stdout:LOGO="fedora-logo-icon"
2026-02-23T10:47:58.464 INFO:teuthology.orchestra.run.trial030.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T10:47:58.464 INFO:teuthology.orchestra.run.trial030.stdout:HOME_URL="https://centos.org/"
2026-02-23T10:47:58.464 INFO:teuthology.orchestra.run.trial030.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T10:47:58.464 INFO:teuthology.orchestra.run.trial030.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T10:47:58.464 INFO:teuthology.orchestra.run.trial030.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T10:47:58.465 INFO:teuthology.provision.fog.trial030:Deploy complete!
2026-02-23T10:47:58.466 DEBUG:teuthology.parallel:result is None
2026-02-23T10:47:58.872 INFO:teuthology.lock.ops:Checking trial030.front.sepia.ceph.com
2026-02-23T10:47:58.872 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T10:47:58.979 INFO:teuthology.lock.ops:Checking trial121.front.sepia.ceph.com
2026-02-23T10:47:58.979 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T10:47:59.048 INFO:teuthology.lock.ops:Updating [trial030.front.sepia.ceph.com]: set os type and version on server
2026-02-23T10:47:59.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial030.front.sepia.ceph.com'
2026-02-23T10:47:59.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial030.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T10:47:59.112 DEBUG:teuthology.orchestra.run.trial030:> true
2026-02-23T10:47:59.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial030.front.sepia.ceph.com'
2026-02-23T10:47:59.185 DEBUG:teuthology.orchestra.run.trial030:> uname -m
2026-02-23T10:47:59.241 INFO:teuthology.orchestra.run.trial030.stdout:x86_64
2026-02-23T10:47:59.241 DEBUG:teuthology.orchestra.run.trial030:> cat /etc/os-release
2026-02-23T10:47:59.297 INFO:teuthology.orchestra.run.trial030.stdout:NAME="CentOS Stream"
2026-02-23T10:47:59.297 INFO:teuthology.orchestra.run.trial030.stdout:VERSION="9"
2026-02-23T10:47:59.298 INFO:teuthology.orchestra.run.trial030.stdout:ID="centos"
2026-02-23T10:47:59.298 INFO:teuthology.orchestra.run.trial030.stdout:ID_LIKE="rhel fedora"
2026-02-23T10:47:59.298 INFO:teuthology.orchestra.run.trial030.stdout:VERSION_ID="9"
2026-02-23T10:47:59.298 INFO:teuthology.orchestra.run.trial030.stdout:PLATFORM_ID="platform:el9"
2026-02-23T10:47:59.298 INFO:teuthology.orchestra.run.trial030.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T10:47:59.298 INFO:teuthology.orchestra.run.trial030.stdout:ANSI_COLOR="0;31"
2026-02-23T10:47:59.298 INFO:teuthology.orchestra.run.trial030.stdout:LOGO="fedora-logo-icon"
2026-02-23T10:47:59.298 INFO:teuthology.orchestra.run.trial030.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T10:47:59.298 INFO:teuthology.orchestra.run.trial030.stdout:HOME_URL="https://centos.org/"
2026-02-23T10:47:59.298 INFO:teuthology.orchestra.run.trial030.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T10:47:59.298 INFO:teuthology.orchestra.run.trial030.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T10:47:59.298 INFO:teuthology.orchestra.run.trial030.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T10:47:59.299 INFO:teuthology.lock.ops:Updating trial030.front.sepia.ceph.com on lock server
2026-02-23T10:47:59.402 INFO:teuthology.lock.ops:Updating [trial121.front.sepia.ceph.com]: set os type and version on server
2026-02-23T10:47:59.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial121.front.sepia.ceph.com'
2026-02-23T10:47:59.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T10:47:59.466 DEBUG:teuthology.orchestra.run.trial121:> true
2026-02-23T10:47:59.545 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial121.front.sepia.ceph.com'
2026-02-23T10:47:59.545 DEBUG:teuthology.orchestra.run.trial121:> uname -m
2026-02-23T10:47:59.601 INFO:teuthology.orchestra.run.trial121.stdout:x86_64
2026-02-23T10:47:59.601 DEBUG:teuthology.orchestra.run.trial121:> cat /etc/os-release
2026-02-23T10:47:59.657 INFO:teuthology.orchestra.run.trial121.stdout:NAME="CentOS Stream"
2026-02-23T10:47:59.657 INFO:teuthology.orchestra.run.trial121.stdout:VERSION="9"
2026-02-23T10:47:59.657 INFO:teuthology.orchestra.run.trial121.stdout:ID="centos"
2026-02-23T10:47:59.657 INFO:teuthology.orchestra.run.trial121.stdout:ID_LIKE="rhel fedora"
2026-02-23T10:47:59.657 INFO:teuthology.orchestra.run.trial121.stdout:VERSION_ID="9"
2026-02-23T10:47:59.657 INFO:teuthology.orchestra.run.trial121.stdout:PLATFORM_ID="platform:el9"
2026-02-23T10:47:59.657 INFO:teuthology.orchestra.run.trial121.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T10:47:59.657 INFO:teuthology.orchestra.run.trial121.stdout:ANSI_COLOR="0;31"
2026-02-23T10:47:59.657 INFO:teuthology.orchestra.run.trial121.stdout:LOGO="fedora-logo-icon"
2026-02-23T10:47:59.657 INFO:teuthology.orchestra.run.trial121.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T10:47:59.657 INFO:teuthology.orchestra.run.trial121.stdout:HOME_URL="https://centos.org/"
2026-02-23T10:47:59.657 INFO:teuthology.orchestra.run.trial121.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T10:47:59.657 INFO:teuthology.orchestra.run.trial121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T10:47:59.657 INFO:teuthology.orchestra.run.trial121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T10:47:59.657 INFO:teuthology.lock.ops:Updating trial121.front.sepia.ceph.com on lock server
2026-02-23T10:47:59.719 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:47:59.804 INFO:teuthology.dispatcher.supervisor:Running job 66142
2026-02-23T10:47:59.804 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_shraddhaag@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66142 --name shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/crimson_bluestore thrashers/{default} thrashosds-health workloads/write_fadvise_dontneed} -- /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66142/orig.config.yaml
2026-02-23T10:47:59.805 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66142
2026-02-23T10:47:59.805 INFO:teuthology.dispatcher.supervisor:Job PID: 34301
2026-02-23T10:47:59.805 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-23T10:49:59.806 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:51:59.950 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:54:00.028 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:56:00.159 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:58:00.281 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T11:00:00.370 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T11:02:00.491 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T11:04:00.616 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T11:06:00.726 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T11:06:00.801 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-23T11:06:00.914 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-23T11:06:01.439 INFO:teuthology.orchestra.console.trial030:Power off
2026-02-23T11:06:01.439 DEBUG:teuthology.orchestra.console.trial030:pexpect command: ipmitool -H trial030.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T11:06:01.450 INFO:teuthology.orchestra.console.trial121:Power off
2026-02-23T11:06:01.450 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T11:06:01.478 DEBUG:teuthology.orchestra.console.trial030:power off output: Chassis Power Control: Down/Off
2026-02-23T11:06:01.488 DEBUG:teuthology.orchestra.console.trial121:power off output: Chassis Power Control: Down/Off
2026-02-23T11:06:05.479 DEBUG:teuthology.orchestra.console.trial030:pexpect command: ipmitool -H trial030.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T11:06:05.489 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T11:06:05.589 DEBUG:teuthology.orchestra.console.trial030:check power output: Chassis Power is on
2026-02-23T11:06:05.598 DEBUG:teuthology.orchestra.console.trial121:check power output: Chassis Power is on
2026-02-23T11:06:09.591 DEBUG:teuthology.orchestra.console.trial030:pexpect command: ipmitool -H trial030.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T11:06:09.599 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T11:06:09.702 DEBUG:teuthology.orchestra.console.trial030:check power output: Chassis Power is off
2026-02-23T11:06:09.702 INFO:teuthology.orchestra.console.trial030:Power off completed
2026-02-23T11:06:09.709 DEBUG:teuthology.orchestra.console.trial121:check power output: Chassis Power is off
2026-02-23T11:06:09.709 INFO:teuthology.orchestra.console.trial121:Power off completed
2026-02-23T11:06:09.947 INFO:teuthology.lock.ops:unlocked: trial030.front.sepia.ceph.com
2026-02-23T11:06:09.960 INFO:teuthology.lock.ops:unlocked: trial121.front.sepia.ceph.com