2026-02-24T13:16:34.688 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-24T13:16:34.688 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:16:34.761 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:16:35.077 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7b14cdb52cc0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7b14cd385800>, signals=[15])
2026-02-24T13:16:35.077 INFO:teuthology.lock.ops:Start node 'trial055.front.sepia.ceph.com' reimaging
2026-02-24T13:16:35.077 INFO:teuthology.lock.ops:Updating [trial055.front.sepia.ceph.com]: reset os type and version on server
2026-02-24T13:16:35.077 INFO:teuthology.lock.ops:Updating trial055.front.sepia.ceph.com on lock server
2026-02-24T13:16:35.135 INFO:teuthology.lock.ops:Start node 'trial111.front.sepia.ceph.com' reimaging
2026-02-24T13:16:35.135 INFO:teuthology.lock.ops:Updating [trial111.front.sepia.ceph.com]: reset os type and version on server
2026-02-24T13:16:35.135 INFO:teuthology.lock.ops:Updating trial111.front.sepia.ceph.com on lock server
2026-02-24T13:16:35.195 INFO:teuthology.lock.ops:Start node 'trial149.front.sepia.ceph.com' reimaging
2026-02-24T13:16:35.195 INFO:teuthology.lock.ops:Updating [trial149.front.sepia.ceph.com]: reset os type and version on server
2026-02-24T13:16:35.195 INFO:teuthology.lock.ops:Updating trial149.front.sepia.ceph.com on lock server
2026-02-24T13:16:35.294 INFO:teuthology.lock.ops:Start node 'trial156.front.sepia.ceph.com' reimaging
2026-02-24T13:16:35.294 INFO:teuthology.lock.ops:Updating [trial156.front.sepia.ceph.com]: reset os type and version on server
2026-02-24T13:16:35.294 INFO:teuthology.lock.ops:Updating trial156.front.sepia.ceph.com on lock server
2026-02-24T13:16:35.482 DEBUG:teuthology.provision.fog.trial111:Requesting image trial_centos_9.stream (ID 3)
2026-02-24T13:16:35.483 DEBUG:teuthology.provision.fog.trial055:Requesting image trial_centos_9.stream (ID 3)
2026-02-24T13:16:35.535 INFO:teuthology.provision.fog.trial111:Scheduling deploy of centos 9.stream
2026-02-24T13:16:35.535 INFO:teuthology.provision.fog.trial055:Scheduling deploy of centos 9.stream
2026-02-24T13:16:35.561 DEBUG:teuthology.provision.fog.trial149:Requesting image trial_centos_9.stream (ID 3)
2026-02-24T13:16:35.589 DEBUG:teuthology.provision.fog.trial156:Requesting image trial_centos_9.stream (ID 3)
2026-02-24T13:16:35.609 INFO:teuthology.provision.fog.trial149:Scheduling deploy of centos 9.stream
2026-02-24T13:16:35.640 INFO:teuthology.provision.fog.trial156:Scheduling deploy of centos 9.stream
2026-02-24T13:16:37.255 INFO:teuthology.orchestra.console.trial111:Power off
2026-02-24T13:16:37.255 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:16:37.318 INFO:teuthology.orchestra.console.trial055:Power off
2026-02-24T13:16:37.318 DEBUG:teuthology.orchestra.console.trial055:pexpect command: ipmitool -H trial055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:16:37.326 DEBUG:teuthology.orchestra.console.trial111:power off output: Chassis Power Control: Down/Off
2026-02-24T13:16:37.377 INFO:teuthology.orchestra.console.trial156:Power off
2026-02-24T13:16:37.377 DEBUG:teuthology.orchestra.console.trial156:pexpect command: ipmitool -H trial156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:16:37.382 DEBUG:teuthology.orchestra.console.trial055:power off output: Chassis Power Control: Down/Off
2026-02-24T13:16:37.396 INFO:teuthology.orchestra.console.trial149:Power off
2026-02-24T13:16:37.396 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:16:37.414 DEBUG:teuthology.orchestra.console.trial156:power off output: Chassis Power Control: Down/Off
2026-02-24T13:16:37.435 DEBUG:teuthology.orchestra.console.trial149:power off output: Chassis Power Control: Down/Off
2026-02-24T13:16:41.329 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:16:41.382 DEBUG:teuthology.orchestra.console.trial055:pexpect command: ipmitool -H trial055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:16:41.415 DEBUG:teuthology.orchestra.console.trial156:pexpect command: ipmitool -H trial156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:16:41.436 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:16:41.445 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is off
2026-02-24T13:16:41.446 INFO:teuthology.orchestra.console.trial111:Power off completed
2026-02-24T13:16:41.490 DEBUG:teuthology.orchestra.console.trial055:check power output: Chassis Power is off
2026-02-24T13:16:41.490 INFO:teuthology.orchestra.console.trial055:Power off completed
2026-02-24T13:16:41.523 DEBUG:teuthology.orchestra.console.trial156:check power output: Chassis Power is off
2026-02-24T13:16:41.523 INFO:teuthology.orchestra.console.trial156:Power off completed
2026-02-24T13:16:41.545 DEBUG:teuthology.orchestra.console.trial149:check power output: Chassis Power is off
2026-02-24T13:16:41.545 INFO:teuthology.orchestra.console.trial149:Power off completed
2026-02-24T13:16:41.546 INFO:teuthology.orchestra.console.trial111:Power on
2026-02-24T13:16:41.547 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-24T13:16:41.587 DEBUG:teuthology.orchestra.console.trial111:power on output: Chassis Power Control: Up/On
2026-02-24T13:16:41.590 INFO:teuthology.orchestra.console.trial055:Power on
2026-02-24T13:16:41.591 DEBUG:teuthology.orchestra.console.trial055:pexpect command: ipmitool -H trial055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-24T13:16:41.624 INFO:teuthology.orchestra.console.trial156:Power on
2026-02-24T13:16:41.624 DEBUG:teuthology.orchestra.console.trial156:pexpect command: ipmitool -H trial156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-24T13:16:41.633 DEBUG:teuthology.orchestra.console.trial055:power on output: Chassis Power Control: Up/On
2026-02-24T13:16:41.646 INFO:teuthology.orchestra.console.trial149:Power on
2026-02-24T13:16:41.646 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-24T13:16:41.663 DEBUG:teuthology.orchestra.console.trial156:power on output: Chassis Power Control: Up/On
2026-02-24T13:16:41.689 DEBUG:teuthology.orchestra.console.trial149:power on output: Chassis Power Control: Up/On
2026-02-24T13:16:45.592 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:16:45.634 DEBUG:teuthology.orchestra.console.trial055:pexpect command: ipmitool -H trial055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:16:45.664 DEBUG:teuthology.orchestra.console.trial156:pexpect command: ipmitool -H trial156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:16:45.690 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:16:45.701 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is on
2026-02-24T13:16:45.702 INFO:teuthology.orchestra.console.trial111:Power on completed
2026-02-24T13:16:45.743 DEBUG:teuthology.orchestra.console.trial055:check power output: Chassis Power is on
2026-02-24T13:16:45.743 INFO:teuthology.orchestra.console.trial055:Power on completed
2026-02-24T13:16:45.773 DEBUG:teuthology.orchestra.console.trial156:check power output: Chassis Power is on
2026-02-24T13:16:45.773 INFO:teuthology.orchestra.console.trial156:Power on completed
2026-02-24T13:16:45.800 DEBUG:teuthology.orchestra.console.trial149:check power output: Chassis Power is on
2026-02-24T13:16:45.800 INFO:teuthology.orchestra.console.trial149:Power on completed
2026-02-24T13:16:45.802 INFO:teuthology.provision.fog.trial111:Waiting for deploy to finish
2026-02-24T13:16:45.844 INFO:teuthology.provision.fog.trial055:Waiting for deploy to finish
2026-02-24T13:16:45.874 INFO:teuthology.provision.fog.trial156:Waiting for deploy to finish
2026-02-24T13:16:45.900 INFO:teuthology.provision.fog.trial149:Waiting for deploy to finish
2026-02-24T13:18:34.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:18:34.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:18:35.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:18:35.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:18:35.438 ERROR:teuthology.orchestra.connection:Error authenticating with trial156.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-24T13:18:37.376 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111
2026-02-24T13:18:43.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:18:46.464 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111
2026-02-24T13:18:52.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:18:55.552 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111
2026-02-24T13:19:01.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:19:04.640 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111
2026-02-24T13:19:10.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:19:13.729 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111
2026-02-24T13:19:19.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:19:34.687 WARNING:teuthology.provision.fog.trial055:timed out
2026-02-24T13:19:35.198 WARNING:teuthology.provision.fog.trial149:timed out
2026-02-24T13:19:39.442 WARNING:teuthology.provision.fog.trial156:timed out
2026-02-24T13:19:40.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:19:41.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:19:45.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:19:45.926 ERROR:teuthology.orchestra.connection:Error authenticating with trial055.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-24T13:19:46.306 WARNING:teuthology.provision.fog.trial149:[Errno None] Unable to connect to port 22 on 10.20.193.149
2026-02-24T13:19:50.044 ERROR:teuthology.orchestra.connection:Error authenticating with trial055.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-24T13:19:52.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:19:52.539 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-24T13:19:52.540 DEBUG:teuthology.orchestra.run.trial149:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-24T13:19:52.775 ERROR:teuthology.orchestra.connection:Error authenticating with trial156.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-24T13:19:55.897 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-24T13:19:55.897 DEBUG:teuthology.orchestra.run.trial111:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-24T13:19:56.120 INFO:teuthology.provision.fog.trial111:Node is ready
2026-02-24T13:19:56.120 DEBUG:teuthology.orchestra.run.trial111:> hostname
2026-02-24T13:19:56.178 INFO:teuthology.orchestra.run.trial111.stdout:trial111.front.sepia.ceph.com
2026-02-24T13:19:56.179 DEBUG:teuthology.orchestra.run.trial111:> grep trial111.front.sepia.ceph.com /etc/hosts
2026-02-24T13:19:56.239 INFO:teuthology.orchestra.run.trial111.stdout:10.20.193.111 trial111.front.sepia.ceph.com trial111
2026-02-24T13:19:56.239 DEBUG:teuthology.orchestra.run.trial111:> sudo hostname trial111
2026-02-24T13:19:56.311 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i -e 's/trial111.front.sepia.ceph.com/trial111/g' /etc/hosts
2026-02-24T13:19:56.380 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i -e 's/10.20.193.111/10.20.193.111/g' /etc/hosts
2026-02-24T13:19:56.449 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i -e 's/trial111.front.sepia.ceph.com/trial111/g' /etc/hostname
2026-02-24T13:19:56.519 DEBUG:teuthology.orchestra.run.trial111:> sudo hostname trial111
2026-02-24T13:19:56.586 DEBUG:teuthology.orchestra.run.trial111:> cat /etc/os-release
2026-02-24T13:19:56.645 INFO:teuthology.orchestra.run.trial111.stdout:NAME="CentOS Stream"
2026-02-24T13:19:56.645 INFO:teuthology.orchestra.run.trial111.stdout:VERSION="9"
2026-02-24T13:19:56.645 INFO:teuthology.orchestra.run.trial111.stdout:ID="centos"
2026-02-24T13:19:56.645 INFO:teuthology.orchestra.run.trial111.stdout:ID_LIKE="rhel fedora"
2026-02-24T13:19:56.645 INFO:teuthology.orchestra.run.trial111.stdout:VERSION_ID="9"
2026-02-24T13:19:56.645 INFO:teuthology.orchestra.run.trial111.stdout:PLATFORM_ID="platform:el9"
2026-02-24T13:19:56.645 INFO:teuthology.orchestra.run.trial111.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T13:19:56.645 INFO:teuthology.orchestra.run.trial111.stdout:ANSI_COLOR="0;31"
2026-02-24T13:19:56.645 INFO:teuthology.orchestra.run.trial111.stdout:LOGO="fedora-logo-icon"
2026-02-24T13:19:56.646 INFO:teuthology.orchestra.run.trial111.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T13:19:56.646 INFO:teuthology.orchestra.run.trial111.stdout:HOME_URL="https://centos.org/"
2026-02-24T13:19:56.646 INFO:teuthology.orchestra.run.trial111.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T13:19:56.646 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T13:19:56.646 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T13:19:56.646 INFO:teuthology.provision.fog.trial111:Deploy complete!
2026-02-24T13:19:56.647 DEBUG:teuthology.parallel:result is None
2026-02-24T13:19:56.852 ERROR:teuthology.orchestra.connection:Error authenticating with trial156.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-24T13:19:57.128 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-24T13:19:57.129 DEBUG:teuthology.orchestra.run.trial055:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-24T13:19:57.367 INFO:teuthology.provision.fog.trial055:Node is ready
2026-02-24T13:19:57.367 DEBUG:teuthology.orchestra.run.trial055:> hostname
2026-02-24T13:19:57.419 INFO:teuthology.orchestra.run.trial055.stdout:trial055.front.sepia.ceph.com
2026-02-24T13:19:57.419 DEBUG:teuthology.orchestra.run.trial055:> grep trial055.front.sepia.ceph.com /etc/hosts
2026-02-24T13:19:57.473 INFO:teuthology.orchestra.run.trial055.stdout:10.20.193.55 trial055.front.sepia.ceph.com trial055
2026-02-24T13:19:57.473 DEBUG:teuthology.orchestra.run.trial055:> sudo hostname trial055
2026-02-24T13:19:57.545 DEBUG:teuthology.orchestra.run.trial055:> sudo sed -i -e 's/trial055.front.sepia.ceph.com/trial055/g' /etc/hosts
2026-02-24T13:19:57.610 DEBUG:teuthology.orchestra.run.trial055:> sudo sed -i -e 's/10.20.193.55/10.20.193.55/g' /etc/hosts
2026-02-24T13:19:57.675 DEBUG:teuthology.orchestra.run.trial055:> sudo sed -i -e 's/trial055.front.sepia.ceph.com/trial055/g' /etc/hostname
2026-02-24T13:19:57.740 DEBUG:teuthology.orchestra.run.trial055:> sudo hostname trial055
2026-02-24T13:19:57.787 INFO:teuthology.provision.fog.trial149:Node is ready
2026-02-24T13:19:57.787 DEBUG:teuthology.orchestra.run.trial149:> hostname
2026-02-24T13:19:57.804 DEBUG:teuthology.orchestra.run.trial055:> cat /etc/os-release
2026-02-24T13:19:57.826 INFO:teuthology.orchestra.run.trial149.stdout:trial149.front.sepia.ceph.com
2026-02-24T13:19:57.826 DEBUG:teuthology.orchestra.run.trial149:> grep trial149.front.sepia.ceph.com /etc/hosts
2026-02-24T13:19:57.861 INFO:teuthology.orchestra.run.trial055.stdout:NAME="CentOS Stream"
2026-02-24T13:19:57.861 INFO:teuthology.orchestra.run.trial055.stdout:VERSION="9"
2026-02-24T13:19:57.861 INFO:teuthology.orchestra.run.trial055.stdout:ID="centos"
2026-02-24T13:19:57.861 INFO:teuthology.orchestra.run.trial055.stdout:ID_LIKE="rhel fedora"
2026-02-24T13:19:57.861 INFO:teuthology.orchestra.run.trial055.stdout:VERSION_ID="9"
2026-02-24T13:19:57.862 INFO:teuthology.orchestra.run.trial055.stdout:PLATFORM_ID="platform:el9"
2026-02-24T13:19:57.862 INFO:teuthology.orchestra.run.trial055.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T13:19:57.862 INFO:teuthology.orchestra.run.trial055.stdout:ANSI_COLOR="0;31"
2026-02-24T13:19:57.862 INFO:teuthology.orchestra.run.trial055.stdout:LOGO="fedora-logo-icon"
2026-02-24T13:19:57.862 INFO:teuthology.orchestra.run.trial055.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T13:19:57.862 INFO:teuthology.orchestra.run.trial055.stdout:HOME_URL="https://centos.org/"
2026-02-24T13:19:57.862 INFO:teuthology.orchestra.run.trial055.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T13:19:57.862 INFO:teuthology.orchestra.run.trial055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T13:19:57.862 INFO:teuthology.orchestra.run.trial055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T13:19:57.862 INFO:teuthology.provision.fog.trial055:Deploy complete!
2026-02-24T13:19:57.862 DEBUG:teuthology.parallel:result is None
2026-02-24T13:19:57.922 INFO:teuthology.orchestra.run.trial149.stdout:10.20.193.149 trial149.front.sepia.ceph.com trial149
2026-02-24T13:19:57.922 DEBUG:teuthology.orchestra.run.trial149:> sudo hostname trial149
2026-02-24T13:19:57.953 DEBUG:teuthology.orchestra.run.trial149:> sudo sed -i -e 's/trial149.front.sepia.ceph.com/trial149/g' /etc/hosts
2026-02-24T13:19:58.019 DEBUG:teuthology.orchestra.run.trial149:> sudo sed -i -e 's/10.20.193.149/10.20.193.149/g' /etc/hosts
2026-02-24T13:19:58.083 DEBUG:teuthology.orchestra.run.trial149:> sudo sed -i -e 's/trial149.front.sepia.ceph.com/trial149/g' /etc/hostname
2026-02-24T13:19:58.149 DEBUG:teuthology.orchestra.run.trial149:> sudo hostname trial149
2026-02-24T13:19:58.216 DEBUG:teuthology.orchestra.run.trial149:> cat /etc/os-release
2026-02-24T13:19:58.273 INFO:teuthology.orchestra.run.trial149.stdout:NAME="CentOS Stream"
2026-02-24T13:19:58.273 INFO:teuthology.orchestra.run.trial149.stdout:VERSION="9"
2026-02-24T13:19:58.273 INFO:teuthology.orchestra.run.trial149.stdout:ID="centos"
2026-02-24T13:19:58.273 INFO:teuthology.orchestra.run.trial149.stdout:ID_LIKE="rhel fedora"
2026-02-24T13:19:58.273 INFO:teuthology.orchestra.run.trial149.stdout:VERSION_ID="9"
2026-02-24T13:19:58.273 INFO:teuthology.orchestra.run.trial149.stdout:PLATFORM_ID="platform:el9"
2026-02-24T13:19:58.273 INFO:teuthology.orchestra.run.trial149.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T13:19:58.274 INFO:teuthology.orchestra.run.trial149.stdout:ANSI_COLOR="0;31"
2026-02-24T13:19:58.274 INFO:teuthology.orchestra.run.trial149.stdout:LOGO="fedora-logo-icon"
2026-02-24T13:19:58.274 INFO:teuthology.orchestra.run.trial149.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T13:19:58.274 INFO:teuthology.orchestra.run.trial149.stdout:HOME_URL="https://centos.org/"
2026-02-24T13:19:58.274 INFO:teuthology.orchestra.run.trial149.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T13:19:58.274 INFO:teuthology.orchestra.run.trial149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T13:19:58.274 INFO:teuthology.orchestra.run.trial149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T13:19:58.275 INFO:teuthology.provision.fog.trial149:Deploy complete!
2026-02-24T13:19:58.275 DEBUG:teuthology.parallel:result is None
2026-02-24T13:20:03.921 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-24T13:20:03.921 DEBUG:teuthology.orchestra.run.trial156:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-24T13:20:04.082 INFO:teuthology.provision.fog.trial156:Node is ready
2026-02-24T13:20:04.082 DEBUG:teuthology.orchestra.run.trial156:> hostname
2026-02-24T13:20:04.138 INFO:teuthology.orchestra.run.trial156.stdout:trial156.front.sepia.ceph.com
2026-02-24T13:20:04.138 DEBUG:teuthology.orchestra.run.trial156:> grep trial156.front.sepia.ceph.com /etc/hosts
2026-02-24T13:20:04.195 INFO:teuthology.orchestra.run.trial156.stdout:10.20.193.156 trial156.front.sepia.ceph.com trial156
2026-02-24T13:20:04.196 DEBUG:teuthology.orchestra.run.trial156:> sudo hostname trial156
2026-02-24T13:20:04.266 DEBUG:teuthology.orchestra.run.trial156:> sudo sed -i -e 's/trial156.front.sepia.ceph.com/trial156/g' /etc/hosts
2026-02-24T13:20:04.330 DEBUG:teuthology.orchestra.run.trial156:> sudo sed -i -e 's/10.20.193.156/10.20.193.156/g' /etc/hosts
2026-02-24T13:20:04.395 DEBUG:teuthology.orchestra.run.trial156:> sudo sed -i -e 's/trial156.front.sepia.ceph.com/trial156/g' /etc/hostname
2026-02-24T13:20:04.460 DEBUG:teuthology.orchestra.run.trial156:> sudo hostname trial156
2026-02-24T13:20:04.524 DEBUG:teuthology.orchestra.run.trial156:> cat /etc/os-release
2026-02-24T13:20:04.581 INFO:teuthology.orchestra.run.trial156.stdout:NAME="CentOS Stream"
2026-02-24T13:20:04.581 INFO:teuthology.orchestra.run.trial156.stdout:VERSION="9"
2026-02-24T13:20:04.581 INFO:teuthology.orchestra.run.trial156.stdout:ID="centos"
2026-02-24T13:20:04.581 INFO:teuthology.orchestra.run.trial156.stdout:ID_LIKE="rhel fedora"
2026-02-24T13:20:04.581 INFO:teuthology.orchestra.run.trial156.stdout:VERSION_ID="9"
2026-02-24T13:20:04.581 INFO:teuthology.orchestra.run.trial156.stdout:PLATFORM_ID="platform:el9"
2026-02-24T13:20:04.581 INFO:teuthology.orchestra.run.trial156.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T13:20:04.581 INFO:teuthology.orchestra.run.trial156.stdout:ANSI_COLOR="0;31"
2026-02-24T13:20:04.582 INFO:teuthology.orchestra.run.trial156.stdout:LOGO="fedora-logo-icon"
2026-02-24T13:20:04.582 INFO:teuthology.orchestra.run.trial156.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T13:20:04.582 INFO:teuthology.orchestra.run.trial156.stdout:HOME_URL="https://centos.org/"
2026-02-24T13:20:04.582 INFO:teuthology.orchestra.run.trial156.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T13:20:04.582 INFO:teuthology.orchestra.run.trial156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T13:20:04.582 INFO:teuthology.orchestra.run.trial156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T13:20:04.583 INFO:teuthology.provision.fog.trial156:Deploy complete!
2026-02-24T13:20:04.583 DEBUG:teuthology.parallel:result is None
2026-02-24T13:20:05.214 INFO:teuthology.lock.ops:Checking trial055.front.sepia.ceph.com
2026-02-24T13:20:05.214 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-24T13:20:05.317 INFO:teuthology.lock.ops:Checking trial111.front.sepia.ceph.com
2026-02-24T13:20:05.317 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-24T13:20:05.379 INFO:teuthology.lock.ops:Checking trial149.front.sepia.ceph.com
2026-02-24T13:20:05.379 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-24T13:20:05.437 INFO:teuthology.lock.ops:Checking trial156.front.sepia.ceph.com
2026-02-24T13:20:05.437 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-24T13:20:05.500 INFO:teuthology.lock.ops:Updating [trial055.front.sepia.ceph.com]: set os type and version on server
2026-02-24T13:20:05.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial055.front.sepia.ceph.com'
2026-02-24T13:20:05.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:20:05.564 DEBUG:teuthology.orchestra.run.trial055:> true
2026-02-24T13:20:05.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial055.front.sepia.ceph.com'
2026-02-24T13:20:05.639 DEBUG:teuthology.orchestra.run.trial055:> uname -m
2026-02-24T13:20:05.694 INFO:teuthology.orchestra.run.trial055.stdout:x86_64
2026-02-24T13:20:05.694 DEBUG:teuthology.orchestra.run.trial055:> cat /etc/os-release
2026-02-24T13:20:05.749 INFO:teuthology.orchestra.run.trial055.stdout:NAME="CentOS Stream"
2026-02-24T13:20:05.749 INFO:teuthology.orchestra.run.trial055.stdout:VERSION="9"
2026-02-24T13:20:05.749 INFO:teuthology.orchestra.run.trial055.stdout:ID="centos"
2026-02-24T13:20:05.749 INFO:teuthology.orchestra.run.trial055.stdout:ID_LIKE="rhel fedora"
2026-02-24T13:20:05.749 INFO:teuthology.orchestra.run.trial055.stdout:VERSION_ID="9"
2026-02-24T13:20:05.749 INFO:teuthology.orchestra.run.trial055.stdout:PLATFORM_ID="platform:el9"
2026-02-24T13:20:05.750 INFO:teuthology.orchestra.run.trial055.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T13:20:05.750 INFO:teuthology.orchestra.run.trial055.stdout:ANSI_COLOR="0;31"
2026-02-24T13:20:05.750 INFO:teuthology.orchestra.run.trial055.stdout:LOGO="fedora-logo-icon"
2026-02-24T13:20:05.750 INFO:teuthology.orchestra.run.trial055.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T13:20:05.750 INFO:teuthology.orchestra.run.trial055.stdout:HOME_URL="https://centos.org/"
2026-02-24T13:20:05.750 INFO:teuthology.orchestra.run.trial055.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T13:20:05.750 INFO:teuthology.orchestra.run.trial055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T13:20:05.750 INFO:teuthology.orchestra.run.trial055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T13:20:05.750 INFO:teuthology.lock.ops:Updating trial055.front.sepia.ceph.com on lock server
2026-02-24T13:20:05.809 INFO:teuthology.lock.ops:Updating [trial111.front.sepia.ceph.com]: set os type and version on server
2026-02-24T13:20:05.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com'
2026-02-24T13:20:05.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:20:05.870 DEBUG:teuthology.orchestra.run.trial111:> true
2026-02-24T13:20:05.945 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com'
2026-02-24T13:20:05.945 DEBUG:teuthology.orchestra.run.trial111:> uname -m
2026-02-24T13:20:06.001 INFO:teuthology.orchestra.run.trial111.stdout:x86_64
2026-02-24T13:20:06.001 DEBUG:teuthology.orchestra.run.trial111:> cat /etc/os-release
2026-02-24T13:20:06.058 INFO:teuthology.orchestra.run.trial111.stdout:NAME="CentOS Stream"
2026-02-24T13:20:06.058 INFO:teuthology.orchestra.run.trial111.stdout:VERSION="9"
2026-02-24T13:20:06.058 INFO:teuthology.orchestra.run.trial111.stdout:ID="centos"
2026-02-24T13:20:06.058 INFO:teuthology.orchestra.run.trial111.stdout:ID_LIKE="rhel fedora"
2026-02-24T13:20:06.058 INFO:teuthology.orchestra.run.trial111.stdout:VERSION_ID="9"
2026-02-24T13:20:06.058 INFO:teuthology.orchestra.run.trial111.stdout:PLATFORM_ID="platform:el9"
2026-02-24T13:20:06.058 INFO:teuthology.orchestra.run.trial111.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T13:20:06.058 INFO:teuthology.orchestra.run.trial111.stdout:ANSI_COLOR="0;31"
2026-02-24T13:20:06.058 INFO:teuthology.orchestra.run.trial111.stdout:LOGO="fedora-logo-icon"
2026-02-24T13:20:06.058 INFO:teuthology.orchestra.run.trial111.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T13:20:06.058 INFO:teuthology.orchestra.run.trial111.stdout:HOME_URL="https://centos.org/"
2026-02-24T13:20:06.058 INFO:teuthology.orchestra.run.trial111.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T13:20:06.058 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T13:20:06.058 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T13:20:06.059 INFO:teuthology.lock.ops:Updating trial111.front.sepia.ceph.com on lock server
2026-02-24T13:20:06.130 INFO:teuthology.lock.ops:Updating [trial149.front.sepia.ceph.com]: set os type and version on server
2026-02-24T13:20:06.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com'
2026-02-24T13:20:06.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:20:06.192 DEBUG:teuthology.orchestra.run.trial149:> true
2026-02-24T13:20:06.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com'
2026-02-24T13:20:06.266 DEBUG:teuthology.orchestra.run.trial149:> uname -m
2026-02-24T13:20:06.322 INFO:teuthology.orchestra.run.trial149.stdout:x86_64
2026-02-24T13:20:06.322 DEBUG:teuthology.orchestra.run.trial149:> cat /etc/os-release
2026-02-24T13:20:06.377 INFO:teuthology.orchestra.run.trial149.stdout:NAME="CentOS Stream"
2026-02-24T13:20:06.377 INFO:teuthology.orchestra.run.trial149.stdout:VERSION="9"
2026-02-24T13:20:06.377 INFO:teuthology.orchestra.run.trial149.stdout:ID="centos"
2026-02-24T13:20:06.377 INFO:teuthology.orchestra.run.trial149.stdout:ID_LIKE="rhel fedora"
2026-02-24T13:20:06.377 INFO:teuthology.orchestra.run.trial149.stdout:VERSION_ID="9"
2026-02-24T13:20:06.377 INFO:teuthology.orchestra.run.trial149.stdout:PLATFORM_ID="platform:el9"
2026-02-24T13:20:06.377 INFO:teuthology.orchestra.run.trial149.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T13:20:06.377 INFO:teuthology.orchestra.run.trial149.stdout:ANSI_COLOR="0;31"
2026-02-24T13:20:06.377 INFO:teuthology.orchestra.run.trial149.stdout:LOGO="fedora-logo-icon"
2026-02-24T13:20:06.377 INFO:teuthology.orchestra.run.trial149.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T13:20:06.377 INFO:teuthology.orchestra.run.trial149.stdout:HOME_URL="https://centos.org/"
2026-02-24T13:20:06.377 INFO:teuthology.orchestra.run.trial149.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T13:20:06.377 INFO:teuthology.orchestra.run.trial149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T13:20:06.377 INFO:teuthology.orchestra.run.trial149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T13:20:06.378 INFO:teuthology.lock.ops:Updating trial149.front.sepia.ceph.com on lock server
2026-02-24T13:20:06.436 INFO:teuthology.lock.ops:Updating [trial156.front.sepia.ceph.com]: set os type and version on server
2026-02-24T13:20:06.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial156.front.sepia.ceph.com'
2026-02-24T13:20:06.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:20:06.499 DEBUG:teuthology.orchestra.run.trial156:> true
2026-02-24T13:20:06.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial156.front.sepia.ceph.com'
2026-02-24T13:20:06.577 DEBUG:teuthology.orchestra.run.trial156:> uname -m
2026-02-24T13:20:06.633 INFO:teuthology.orchestra.run.trial156.stdout:x86_64
2026-02-24T13:20:06.633 DEBUG:teuthology.orchestra.run.trial156:> cat /etc/os-release
2026-02-24T13:20:06.690 INFO:teuthology.orchestra.run.trial156.stdout:NAME="CentOS Stream"
2026-02-24T13:20:06.690 INFO:teuthology.orchestra.run.trial156.stdout:VERSION="9"
2026-02-24T13:20:06.691 INFO:teuthology.orchestra.run.trial156.stdout:ID="centos"
2026-02-24T13:20:06.691 INFO:teuthology.orchestra.run.trial156.stdout:ID_LIKE="rhel fedora"
2026-02-24T13:20:06.691 INFO:teuthology.orchestra.run.trial156.stdout:VERSION_ID="9"
2026-02-24T13:20:06.691 INFO:teuthology.orchestra.run.trial156.stdout:PLATFORM_ID="platform:el9"
2026-02-24T13:20:06.691 INFO:teuthology.orchestra.run.trial156.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T13:20:06.692 INFO:teuthology.orchestra.run.trial156.stdout:ANSI_COLOR="0;31"
2026-02-24T13:20:06.692 INFO:teuthology.orchestra.run.trial156.stdout:LOGO="fedora-logo-icon"
2026-02-24T13:20:06.692 INFO:teuthology.orchestra.run.trial156.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T13:20:06.692 INFO:teuthology.orchestra.run.trial156.stdout:HOME_URL="https://centos.org/"
2026-02-24T13:20:06.692 INFO:teuthology.orchestra.run.trial156.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T13:20:06.692 INFO:teuthology.orchestra.run.trial156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T13:20:06.693 INFO:teuthology.orchestra.run.trial156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T13:20:06.694 INFO:teuthology.lock.ops:Updating trial156.front.sepia.ceph.com on lock server
2026-02-24T13:20:06.796 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:20:06.891 INFO:teuthology.dispatcher.supervisor:Running job 67810
2026-02-24T13:20:06.891 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_cjames@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/cjames-2026-02-24_10:01:51-rados-main-distro-default-trial/67810 --name cjames-2026-02-24_10:01:51-rados-main-distro-default-trial --description rados/thrash-erasure-code/{ceph clusters/{fixed-4} ec_direct_reads/ec_direct_reads_on ec_optimizations/ec_optimizations_on fast/normal mon_election/classic msgr-failures/few objectstore/{bluestore/{alloc$/{btree} base mem$/{low} onode-segment$/{1M} write$/{v1/{compr$/{yes$/{zstd}} v1}}}} rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} -- /home/teuthworker/mnt/teuthology/cjames-2026-02-24_10:01:51-rados-main-distro-default-trial/67810/orig.config.yaml
2026-02-24T13:20:06.891 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/cjames-2026-02-24_10:01:51-rados-main-distro-default-trial/67810
2026-02-24T13:20:06.891 INFO:teuthology.dispatcher.supervisor:Job PID: 554723
2026-02-24T13:20:06.891 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-24T13:22:06.892 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:24:07.016 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:26:07.089 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:28:07.213 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:30:07.335 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:32:07.513 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:34:07.631 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:36:07.733 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:38:07.859 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:40:08.125 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:42:08.245 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:44:08.375 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:44:08.499 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-24T13:44:08.749 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-24T13:44:09.626 INFO:teuthology.orchestra.console.trial149:Power off
2026-02-24T13:44:09.627 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:44:09.734 INFO:teuthology.orchestra.console.trial055:Power off
2026-02-24T13:44:09.734 DEBUG:teuthology.orchestra.console.trial055:pexpect command: ipmitool -H trial055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:44:09.740 DEBUG:teuthology.orchestra.console.trial149:power off output: Chassis Power Control: Down/Off
2026-02-24T13:44:09.747 INFO:teuthology.orchestra.console.trial156:Power off
2026-02-24T13:44:09.747 DEBUG:teuthology.orchestra.console.trial156:pexpect command: ipmitool -H trial156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:44:09.755 INFO:teuthology.orchestra.console.trial111:Power off
2026-02-24T13:44:09.756 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:44:09.773 DEBUG:teuthology.orchestra.console.trial055:power off output: Chassis Power Control: Down/Off
2026-02-24T13:44:09.786 DEBUG:teuthology.orchestra.console.trial156:power off output: Chassis Power Control: Down/Off
2026-02-24T13:44:09.795 DEBUG:teuthology.orchestra.console.trial111:power off output: Chassis Power Control: Down/Off
2026-02-24T13:44:13.741 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:44:13.773 DEBUG:teuthology.orchestra.console.trial055:pexpect command: ipmitool -H trial055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:44:13.787 DEBUG:teuthology.orchestra.console.trial156:pexpect command: ipmitool -H trial156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:44:13.796 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:44:13.852 DEBUG:teuthology.orchestra.console.trial149:check power output: Chassis Power is on
2026-02-24T13:44:13.883 DEBUG:teuthology.orchestra.console.trial055:check power output: Chassis Power is on
2026-02-24T13:44:13.895 DEBUG:teuthology.orchestra.console.trial156:check power output: Chassis Power is on
2026-02-24T13:44:13.906 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is on
2026-02-24T13:44:17.854 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:44:17.884 DEBUG:teuthology.orchestra.console.trial055:pexpect command: ipmitool -H trial055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:44:17.896 DEBUG:teuthology.orchestra.console.trial156:pexpect command: ipmitool -H trial156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:44:17.907 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:44:17.964 DEBUG:teuthology.orchestra.console.trial149:check power output: Chassis Power is off
2026-02-24T13:44:17.965 INFO:teuthology.orchestra.console.trial149:Power off completed
2026-02-24T13:44:17.994 DEBUG:teuthology.orchestra.console.trial055:check power output: Chassis Power is off
2026-02-24T13:44:17.995 INFO:teuthology.orchestra.console.trial055:Power off completed
2026-02-24T13:44:18.004 DEBUG:teuthology.orchestra.console.trial156:check power output: Chassis Power is off
2026-02-24T13:44:18.004 INFO:teuthology.orchestra.console.trial156:Power off completed
2026-02-24T13:44:18.014 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is off
2026-02-24T13:44:18.015 INFO:teuthology.orchestra.console.trial111:Power off completed
2026-02-24T13:44:18.307 INFO:teuthology.lock.ops:unlocked: trial149.front.sepia.ceph.com
2026-02-24T13:44:18.315 INFO:teuthology.lock.ops:unlocked: trial156.front.sepia.ceph.com
2026-02-24T13:44:18.320 INFO:teuthology.lock.ops:unlocked: trial055.front.sepia.ceph.com
2026-02-24T13:44:18.328 INFO:teuthology.lock.ops:unlocked: trial111.front.sepia.ceph.com