2026-02-22T20:25:16.023 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-22T20:25:16.023 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-22T20:25:16.098 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-22T20:25:16.415 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x721476da4fe0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x721476585080>, signals=[15])
2026-02-22T20:25:16.415 INFO:teuthology.lock.ops:Start node 'trial069.front.sepia.ceph.com' reimaging
2026-02-22T20:25:16.415 INFO:teuthology.lock.ops:Updating [trial069.front.sepia.ceph.com]: reset os type and version on server
2026-02-22T20:25:16.415 INFO:teuthology.lock.ops:Updating trial069.front.sepia.ceph.com on lock server
2026-02-22T20:25:16.474 INFO:teuthology.lock.ops:Start node 'trial073.front.sepia.ceph.com' reimaging
2026-02-22T20:25:16.475 INFO:teuthology.lock.ops:Updating [trial073.front.sepia.ceph.com]: reset os type and version on server
2026-02-22T20:25:16.475 INFO:teuthology.lock.ops:Updating trial073.front.sepia.ceph.com on lock server
2026-02-22T20:25:16.535 INFO:teuthology.lock.ops:Start node 'trial114.front.sepia.ceph.com' reimaging
2026-02-22T20:25:16.535 INFO:teuthology.lock.ops:Updating [trial114.front.sepia.ceph.com]: reset os type and version on server
2026-02-22T20:25:16.535 INFO:teuthology.lock.ops:Updating trial114.front.sepia.ceph.com on lock server
2026-02-22T20:25:16.635 INFO:teuthology.lock.ops:Start node 'trial172.front.sepia.ceph.com' reimaging
2026-02-22T20:25:16.635 INFO:teuthology.lock.ops:Updating [trial172.front.sepia.ceph.com]: reset os type and version on server
2026-02-22T20:25:16.635 INFO:teuthology.lock.ops:Updating trial172.front.sepia.ceph.com on lock server
2026-02-22T20:25:16.825 DEBUG:teuthology.provision.fog.trial073:Requesting image trial_rocky_10.1 (ID 4)
2026-02-22T20:25:16.826 DEBUG:teuthology.provision.fog.trial069:Requesting image trial_rocky_10.1 (ID 4)
2026-02-22T20:25:16.933 DEBUG:teuthology.provision.fog.trial172:Requesting image trial_rocky_10.1 (ID 4)
2026-02-22T20:25:16.935 DEBUG:teuthology.provision.fog.trial114:Requesting image trial_rocky_10.1 (ID 4)
2026-02-22T20:25:16.937 INFO:teuthology.provision.fog.trial069:Scheduling deploy of rocky 10.1
2026-02-22T20:25:16.939 INFO:teuthology.provision.fog.trial073:Scheduling deploy of rocky 10.1
2026-02-22T20:25:16.960 INFO:teuthology.provision.fog.trial172:Scheduling deploy of rocky 10.1
2026-02-22T20:25:16.990 INFO:teuthology.provision.fog.trial114:Scheduling deploy of rocky 10.1
2026-02-22T20:25:18.959 INFO:teuthology.orchestra.console.trial073:Power off
2026-02-22T20:25:18.959 DEBUG:teuthology.orchestra.console.trial073:pexpect command: ipmitool -H trial073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-22T20:25:18.980 INFO:teuthology.orchestra.console.trial114:Power off
2026-02-22T20:25:18.980 DEBUG:teuthology.orchestra.console.trial114:pexpect command: ipmitool -H trial114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-22T20:25:19.000 DEBUG:teuthology.orchestra.console.trial073:power off output: Chassis Power Control: Down/Off
2026-02-22T20:25:19.063 DEBUG:teuthology.orchestra.console.trial114:power off output: Chassis Power Control: Down/Off
2026-02-22T20:25:19.077 INFO:teuthology.orchestra.console.trial069:Power off
2026-02-22T20:25:19.077 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-22T20:25:19.154 DEBUG:teuthology.orchestra.console.trial069:power off output: Chassis Power Control: Down/Off
2026-02-22T20:25:19.167 INFO:teuthology.orchestra.console.trial172:Power off
2026-02-22T20:25:19.167 DEBUG:teuthology.orchestra.console.trial172:pexpect command: ipmitool -H trial172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-22T20:25:19.206 DEBUG:teuthology.orchestra.console.trial172:power off output: Chassis Power Control: Down/Off
2026-02-22T20:25:23.005 DEBUG:teuthology.orchestra.console.trial073:pexpect command: ipmitool -H trial073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-22T20:25:23.064 DEBUG:teuthology.orchestra.console.trial114:pexpect command: ipmitool -H trial114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-22T20:25:23.114 DEBUG:teuthology.orchestra.console.trial073:check power output: Chassis Power is off
2026-02-22T20:25:23.115 INFO:teuthology.orchestra.console.trial073:Power off completed
2026-02-22T20:25:23.155 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-22T20:25:23.172 DEBUG:teuthology.orchestra.console.trial114:check power output: Chassis Power is off
2026-02-22T20:25:23.173 INFO:teuthology.orchestra.console.trial114:Power off completed
2026-02-22T20:25:23.207 DEBUG:teuthology.orchestra.console.trial172:pexpect command: ipmitool -H trial172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-22T20:25:23.215 INFO:teuthology.orchestra.console.trial073:Power on
2026-02-22T20:25:23.215 DEBUG:teuthology.orchestra.console.trial073:pexpect command: ipmitool -H trial073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-22T20:25:23.255 DEBUG:teuthology.orchestra.console.trial073:power on output: Chassis Power Control: Up/On
2026-02-22T20:25:23.264 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is off
2026-02-22T20:25:23.264 INFO:teuthology.orchestra.console.trial069:Power off completed
2026-02-22T20:25:23.274 INFO:teuthology.orchestra.console.trial114:Power on
2026-02-22T20:25:23.274 DEBUG:teuthology.orchestra.console.trial114:pexpect command: ipmitool -H trial114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-22T20:25:23.315 DEBUG:teuthology.orchestra.console.trial114:power on output: Chassis Power Control: Up/On
2026-02-22T20:25:23.317 DEBUG:teuthology.orchestra.console.trial172:check power output: Chassis Power is off
2026-02-22T20:25:23.317 INFO:teuthology.orchestra.console.trial172:Power off completed
2026-02-22T20:25:23.365 INFO:teuthology.orchestra.console.trial069:Power on
2026-02-22T20:25:23.365 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-22T20:25:23.406 DEBUG:teuthology.orchestra.console.trial069:power on output: Chassis Power Control: Up/On
2026-02-22T20:25:23.418 INFO:teuthology.orchestra.console.trial172:Power on
2026-02-22T20:25:23.418 DEBUG:teuthology.orchestra.console.trial172:pexpect command: ipmitool -H trial172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-22T20:25:23.457 DEBUG:teuthology.orchestra.console.trial172:power on output: Chassis Power Control: Up/On
2026-02-22T20:25:27.260 DEBUG:teuthology.orchestra.console.trial073:pexpect command: ipmitool -H trial073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-22T20:25:27.316 DEBUG:teuthology.orchestra.console.trial114:pexpect command: ipmitool -H trial114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-22T20:25:27.372 DEBUG:teuthology.orchestra.console.trial073:check power output: Chassis Power is on
2026-02-22T20:25:27.372 INFO:teuthology.orchestra.console.trial073:Power on completed
2026-02-22T20:25:27.407 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-22T20:25:27.427 DEBUG:teuthology.orchestra.console.trial114:check power output: Chassis Power is off
2026-02-22T20:25:27.459 DEBUG:teuthology.orchestra.console.trial172:pexpect command: ipmitool -H trial172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-22T20:25:27.473 INFO:teuthology.provision.fog.trial073:Waiting for deploy to finish
2026-02-22T20:25:27.517 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is on
2026-02-22T20:25:27.518 INFO:teuthology.orchestra.console.trial069:Power on completed
2026-02-22T20:25:27.568 DEBUG:teuthology.orchestra.console.trial172:check power output: Chassis Power is on
2026-02-22T20:25:27.568 INFO:teuthology.orchestra.console.trial172:Power on completed
2026-02-22T20:25:27.618 INFO:teuthology.provision.fog.trial069:Waiting for deploy to finish
2026-02-22T20:25:27.669 INFO:teuthology.provision.fog.trial172:Waiting for deploy to finish
2026-02-22T20:25:31.431 DEBUG:teuthology.orchestra.console.trial114:pexpect command: ipmitool -H trial114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-22T20:25:31.542 DEBUG:teuthology.orchestra.console.trial114:check power output: Chassis Power is on
2026-02-22T20:25:31.542 INFO:teuthology.orchestra.console.trial114:Power on completed
2026-02-22T20:25:31.643 INFO:teuthology.provision.fog.trial114:Waiting for deploy to finish
2026-02-22T20:27:16.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:16.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:16.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:19.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:19.296 WARNING:teuthology.provision.fog.trial172:[Errno None] Unable to connect to port 22 on 10.20.193.172
2026-02-22T20:27:19.360 WARNING:teuthology.provision.fog.trial073:[Errno None] Unable to connect to port 22 on 10.20.193.73
2026-02-22T20:27:19.360 WARNING:teuthology.provision.fog.trial069:[Errno None] Unable to connect to port 22 on 10.20.193.69
2026-02-22T20:27:22.368 WARNING:teuthology.provision.fog.trial114:[Errno None] Unable to connect to port 22 on 10.20.193.114
2026-02-22T20:27:25.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:25.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:25.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:28.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:28.384 WARNING:teuthology.provision.fog.trial172:[Errno None] Unable to connect to port 22 on 10.20.193.172
2026-02-22T20:27:28.448 WARNING:teuthology.provision.fog.trial073:[Errno None] Unable to connect to port 22 on 10.20.193.73
2026-02-22T20:27:28.448 WARNING:teuthology.provision.fog.trial069:[Errno None] Unable to connect to port 22 on 10.20.193.69
2026-02-22T20:27:31.456 WARNING:teuthology.provision.fog.trial114:[Errno None] Unable to connect to port 22 on 10.20.193.114
2026-02-22T20:27:34.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:34.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:34.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:37.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:37.472 WARNING:teuthology.provision.fog.trial172:[Errno None] Unable to connect to port 22 on 10.20.193.172
2026-02-22T20:27:37.536 WARNING:teuthology.provision.fog.trial073:[Errno None] Unable to connect to port 22 on 10.20.193.73
2026-02-22T20:27:37.536 WARNING:teuthology.provision.fog.trial069:[Errno None] Unable to connect to port 22 on 10.20.193.69
2026-02-22T20:27:40.544 WARNING:teuthology.provision.fog.trial114:[Errno None] Unable to connect to port 22 on 10.20.193.114
2026-02-22T20:27:43.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:43.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:43.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:46.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:46.560 WARNING:teuthology.provision.fog.trial172:[Errno None] Unable to connect to port 22 on 10.20.193.172
2026-02-22T20:27:46.624 WARNING:teuthology.provision.fog.trial073:[Errno None] Unable to connect to port 22 on 10.20.193.73
2026-02-22T20:27:46.624 WARNING:teuthology.provision.fog.trial069:[Errno None] Unable to connect to port 22 on 10.20.193.69
2026-02-22T20:27:49.632 WARNING:teuthology.provision.fog.trial114:[Errno None] Unable to connect to port 22 on 10.20.193.114
2026-02-22T20:27:52.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:52.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:52.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:55.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:27:55.648 WARNING:teuthology.provision.fog.trial172:[Errno None] Unable to connect to port 22 on 10.20.193.172
2026-02-22T20:27:55.712 WARNING:teuthology.provision.fog.trial073:[Errno None] Unable to connect to port 22 on 10.20.193.73
2026-02-22T20:27:55.712 WARNING:teuthology.provision.fog.trial069:[Errno None] Unable to connect to port 22 on 10.20.193.69
2026-02-22T20:27:58.720 WARNING:teuthology.provision.fog.trial114:[Errno None] Unable to connect to port 22 on 10.20.193.114
2026-02-22T20:28:01.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:28:01.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:28:01.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:28:04.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:28:37.801 ERROR:teuthology.orchestra.connection:Error authenticating with trial069.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-22T20:28:37.803 ERROR:teuthology.orchestra.connection:Error authenticating with trial073.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-22T20:28:37.836 ERROR:teuthology.orchestra.connection:Error authenticating with trial172.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-22T20:28:40.828 ERROR:teuthology.orchestra.connection:Error authenticating with trial114.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-22T20:28:41.918 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-22T20:28:41.918 DEBUG:teuthology.orchestra.run.trial073:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-22T20:28:41.931 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-22T20:28:41.931 DEBUG:teuthology.orchestra.run.trial069:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-22T20:28:42.016 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-22T20:28:42.016 DEBUG:teuthology.orchestra.run.trial172:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-22T20:28:42.118 INFO:teuthology.provision.fog.trial069:Node is ready
2026-02-22T20:28:42.118 DEBUG:teuthology.orchestra.run.trial069:> hostname
2026-02-22T20:28:42.173 INFO:teuthology.orchestra.run.trial069.stdout:trial069.front.sepia.ceph.com
2026-02-22T20:28:42.173 DEBUG:teuthology.orchestra.run.trial069:> grep trial069.front.sepia.ceph.com /etc/hosts
2026-02-22T20:28:42.227 INFO:teuthology.orchestra.run.trial069.stdout:10.20.193.69 trial069.front.sepia.ceph.com trial069
2026-02-22T20:28:42.228 DEBUG:teuthology.orchestra.run.trial069:> sudo hostname trial069
2026-02-22T20:28:42.283 INFO:teuthology.provision.fog.trial172:Node is ready
2026-02-22T20:28:42.283 DEBUG:teuthology.orchestra.run.trial172:> hostname
2026-02-22T20:28:42.297 DEBUG:teuthology.orchestra.run.trial069:> sudo sed -i -e 's/trial069.front.sepia.ceph.com/trial069/g' /etc/hosts
2026-02-22T20:28:42.313 INFO:teuthology.provision.fog.trial073:Node is ready
2026-02-22T20:28:42.313 DEBUG:teuthology.orchestra.run.trial073:> hostname
2026-02-22T20:28:42.341 INFO:teuthology.orchestra.run.trial172.stdout:trial172.front.sepia.ceph.com
2026-02-22T20:28:42.341 DEBUG:teuthology.orchestra.run.trial172:> grep trial172.front.sepia.ceph.com /etc/hosts
2026-02-22T20:28:42.360 DEBUG:teuthology.orchestra.run.trial069:> sudo sed -i -e 's/10.20.193.69/10.20.193.69/g' /etc/hosts
2026-02-22T20:28:42.369 INFO:teuthology.orchestra.run.trial073.stdout:trial073.front.sepia.ceph.com
2026-02-22T20:28:42.369 DEBUG:teuthology.orchestra.run.trial073:> grep trial073.front.sepia.ceph.com /etc/hosts
2026-02-22T20:28:42.399 INFO:teuthology.orchestra.run.trial172.stdout:10.20.193.172 trial172.front.sepia.ceph.com trial172
2026-02-22T20:28:42.400 DEBUG:teuthology.orchestra.run.trial172:> sudo hostname trial172
2026-02-22T20:28:42.424 DEBUG:teuthology.orchestra.run.trial069:> sudo sed -i -e 's/trial069.front.sepia.ceph.com/trial069/g' /etc/hostname
2026-02-22T20:28:42.427 INFO:teuthology.orchestra.run.trial073.stdout:10.20.193.73 trial073.front.sepia.ceph.com trial073
2026-02-22T20:28:42.427 DEBUG:teuthology.orchestra.run.trial073:> sudo hostname trial073
2026-02-22T20:28:42.471 DEBUG:teuthology.orchestra.run.trial172:> sudo sed -i -e 's/trial172.front.sepia.ceph.com/trial172/g' /etc/hosts
2026-02-22T20:28:42.489 DEBUG:teuthology.orchestra.run.trial069:> sudo hostname trial069
2026-02-22T20:28:42.499 DEBUG:teuthology.orchestra.run.trial073:> sudo sed -i -e 's/trial073.front.sepia.ceph.com/trial073/g' /etc/hosts
2026-02-22T20:28:42.538 DEBUG:teuthology.orchestra.run.trial172:> sudo sed -i -e 's/10.20.193.172/10.20.193.172/g' /etc/hosts
2026-02-22T20:28:42.552 DEBUG:teuthology.orchestra.run.trial069:> cat /etc/os-release
2026-02-22T20:28:42.566 DEBUG:teuthology.orchestra.run.trial073:> sudo sed -i -e 's/10.20.193.73/10.20.193.73/g' /etc/hosts
2026-02-22T20:28:42.608 INFO:teuthology.orchestra.run.trial069.stdout:NAME="Rocky Linux"
2026-02-22T20:28:42.608 INFO:teuthology.orchestra.run.trial069.stdout:VERSION="10.1 (Red Quartz)"
2026-02-22T20:28:42.608 INFO:teuthology.orchestra.run.trial069.stdout:ID="rocky"
2026-02-22T20:28:42.608 INFO:teuthology.orchestra.run.trial069.stdout:ID_LIKE="rhel centos fedora"
2026-02-22T20:28:42.608 INFO:teuthology.orchestra.run.trial069.stdout:VERSION_ID="10.1"
2026-02-22T20:28:42.608 INFO:teuthology.orchestra.run.trial069.stdout:PLATFORM_ID="platform:el10"
2026-02-22T20:28:42.608 INFO:teuthology.orchestra.run.trial069.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-22T20:28:42.609 INFO:teuthology.orchestra.run.trial069.stdout:ANSI_COLOR="0;32"
2026-02-22T20:28:42.609 INFO:teuthology.orchestra.run.trial069.stdout:LOGO="fedora-logo-icon"
2026-02-22T20:28:42.609 INFO:teuthology.orchestra.run.trial069.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-22T20:28:42.609 INFO:teuthology.orchestra.run.trial069.stdout:HOME_URL="https://rockylinux.org/"
2026-02-22T20:28:42.609 INFO:teuthology.orchestra.run.trial069.stdout:VENDOR_NAME="RESF"
2026-02-22T20:28:42.609 INFO:teuthology.orchestra.run.trial069.stdout:VENDOR_URL="https://resf.org/"
2026-02-22T20:28:42.609 INFO:teuthology.orchestra.run.trial069.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-22T20:28:42.609 INFO:teuthology.orchestra.run.trial069.stdout:SUPPORT_END="2035-05-31"
2026-02-22T20:28:42.609 INFO:teuthology.orchestra.run.trial069.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-22T20:28:42.609 INFO:teuthology.orchestra.run.trial069.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-22T20:28:42.610 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-22T20:28:42.610 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-22T20:28:42.611 INFO:teuthology.provision.fog.trial069:Deploy complete!
2026-02-22T20:28:42.612 DEBUG:teuthology.parallel:result is None
2026-02-22T20:28:42.623 DEBUG:teuthology.orchestra.run.trial172:> sudo sed -i -e 's/trial172.front.sepia.ceph.com/trial172/g' /etc/hostname
2026-02-22T20:28:42.640 DEBUG:teuthology.orchestra.run.trial073:> sudo sed -i -e 's/trial073.front.sepia.ceph.com/trial073/g' /etc/hostname
2026-02-22T20:28:42.690 DEBUG:teuthology.orchestra.run.trial172:> sudo hostname trial172
2026-02-22T20:28:42.707 DEBUG:teuthology.orchestra.run.trial073:> sudo hostname trial073
2026-02-22T20:28:42.758 DEBUG:teuthology.orchestra.run.trial172:> cat /etc/os-release
2026-02-22T20:28:42.774 DEBUG:teuthology.orchestra.run.trial073:> cat /etc/os-release
2026-02-22T20:28:42.816 INFO:teuthology.orchestra.run.trial172.stdout:NAME="Rocky Linux"
2026-02-22T20:28:42.816 INFO:teuthology.orchestra.run.trial172.stdout:VERSION="10.1 (Red Quartz)"
2026-02-22T20:28:42.816 INFO:teuthology.orchestra.run.trial172.stdout:ID="rocky"
2026-02-22T20:28:42.816 INFO:teuthology.orchestra.run.trial172.stdout:ID_LIKE="rhel centos fedora"
2026-02-22T20:28:42.816 INFO:teuthology.orchestra.run.trial172.stdout:VERSION_ID="10.1"
2026-02-22T20:28:42.816 INFO:teuthology.orchestra.run.trial172.stdout:PLATFORM_ID="platform:el10"
2026-02-22T20:28:42.816 INFO:teuthology.orchestra.run.trial172.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-22T20:28:42.816 INFO:teuthology.orchestra.run.trial172.stdout:ANSI_COLOR="0;32"
2026-02-22T20:28:42.816 INFO:teuthology.orchestra.run.trial172.stdout:LOGO="fedora-logo-icon"
2026-02-22T20:28:42.817 INFO:teuthology.orchestra.run.trial172.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-22T20:28:42.817 INFO:teuthology.orchestra.run.trial172.stdout:HOME_URL="https://rockylinux.org/"
2026-02-22T20:28:42.817 INFO:teuthology.orchestra.run.trial172.stdout:VENDOR_NAME="RESF"
2026-02-22T20:28:42.817 INFO:teuthology.orchestra.run.trial172.stdout:VENDOR_URL="https://resf.org/"
2026-02-22T20:28:42.817 INFO:teuthology.orchestra.run.trial172.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-22T20:28:42.817 INFO:teuthology.orchestra.run.trial172.stdout:SUPPORT_END="2035-05-31"
2026-02-22T20:28:42.817 INFO:teuthology.orchestra.run.trial172.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-22T20:28:42.817 INFO:teuthology.orchestra.run.trial172.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-22T20:28:42.817 INFO:teuthology.orchestra.run.trial172.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-22T20:28:42.817 INFO:teuthology.orchestra.run.trial172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-22T20:28:42.818 INFO:teuthology.provision.fog.trial172:Deploy complete!
2026-02-22T20:28:42.819 DEBUG:teuthology.parallel:result is None
2026-02-22T20:28:42.836 INFO:teuthology.orchestra.run.trial073.stdout:NAME="Rocky Linux"
2026-02-22T20:28:42.837 INFO:teuthology.orchestra.run.trial073.stdout:VERSION="10.1 (Red Quartz)"
2026-02-22T20:28:42.837 INFO:teuthology.orchestra.run.trial073.stdout:ID="rocky"
2026-02-22T20:28:42.837 INFO:teuthology.orchestra.run.trial073.stdout:ID_LIKE="rhel centos fedora"
2026-02-22T20:28:42.837 INFO:teuthology.orchestra.run.trial073.stdout:VERSION_ID="10.1"
2026-02-22T20:28:42.837 INFO:teuthology.orchestra.run.trial073.stdout:PLATFORM_ID="platform:el10"
2026-02-22T20:28:42.837 INFO:teuthology.orchestra.run.trial073.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-22T20:28:42.837 INFO:teuthology.orchestra.run.trial073.stdout:ANSI_COLOR="0;32"
2026-02-22T20:28:42.837 INFO:teuthology.orchestra.run.trial073.stdout:LOGO="fedora-logo-icon"
2026-02-22T20:28:42.837 INFO:teuthology.orchestra.run.trial073.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-22T20:28:42.837 INFO:teuthology.orchestra.run.trial073.stdout:HOME_URL="https://rockylinux.org/"
2026-02-22T20:28:42.838 INFO:teuthology.orchestra.run.trial073.stdout:VENDOR_NAME="RESF"
2026-02-22T20:28:42.838 INFO:teuthology.orchestra.run.trial073.stdout:VENDOR_URL="https://resf.org/"
2026-02-22T20:28:42.838 INFO:teuthology.orchestra.run.trial073.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-22T20:28:42.838 INFO:teuthology.orchestra.run.trial073.stdout:SUPPORT_END="2035-05-31"
2026-02-22T20:28:42.838 INFO:teuthology.orchestra.run.trial073.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-22T20:28:42.838 INFO:teuthology.orchestra.run.trial073.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-22T20:28:42.838 INFO:teuthology.orchestra.run.trial073.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-22T20:28:42.838 INFO:teuthology.orchestra.run.trial073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-22T20:28:42.838 INFO:teuthology.provision.fog.trial073:Deploy complete!
2026-02-22T20:28:42.839 DEBUG:teuthology.parallel:result is None
2026-02-22T20:28:44.912 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-22T20:28:44.912 DEBUG:teuthology.orchestra.run.trial114:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-22T20:28:45.105 INFO:teuthology.provision.fog.trial114:Node is ready
2026-02-22T20:28:45.105 DEBUG:teuthology.orchestra.run.trial114:> hostname
2026-02-22T20:28:45.166 INFO:teuthology.orchestra.run.trial114.stdout:trial114.front.sepia.ceph.com
2026-02-22T20:28:45.166 DEBUG:teuthology.orchestra.run.trial114:> grep trial114.front.sepia.ceph.com /etc/hosts
2026-02-22T20:28:45.227 INFO:teuthology.orchestra.run.trial114.stdout:10.20.193.114 trial114.front.sepia.ceph.com trial114
2026-02-22T20:28:45.228 DEBUG:teuthology.orchestra.run.trial114:> sudo hostname trial114
2026-02-22T20:28:45.329 DEBUG:teuthology.orchestra.run.trial114:> sudo sed -i -e 's/trial114.front.sepia.ceph.com/trial114/g' /etc/hosts
2026-02-22T20:28:45.357 DEBUG:teuthology.orchestra.run.trial114:> sudo sed -i -e 's/10.20.193.114/10.20.193.114/g' /etc/hosts
2026-02-22T20:28:45.427 DEBUG:teuthology.orchestra.run.trial114:> sudo sed -i -e 's/trial114.front.sepia.ceph.com/trial114/g' /etc/hostname
2026-02-22T20:28:45.498 DEBUG:teuthology.orchestra.run.trial114:> sudo hostname trial114
2026-02-22T20:28:45.567 DEBUG:teuthology.orchestra.run.trial114:> cat /etc/os-release
2026-02-22T20:28:45.629 INFO:teuthology.orchestra.run.trial114.stdout:NAME="Rocky Linux"
2026-02-22T20:28:45.629 INFO:teuthology.orchestra.run.trial114.stdout:VERSION="10.1 (Red Quartz)"
2026-02-22T20:28:45.629 INFO:teuthology.orchestra.run.trial114.stdout:ID="rocky"
2026-02-22T20:28:45.629 INFO:teuthology.orchestra.run.trial114.stdout:ID_LIKE="rhel centos fedora"
2026-02-22T20:28:45.629 INFO:teuthology.orchestra.run.trial114.stdout:VERSION_ID="10.1"
2026-02-22T20:28:45.629 INFO:teuthology.orchestra.run.trial114.stdout:PLATFORM_ID="platform:el10"
2026-02-22T20:28:45.629 INFO:teuthology.orchestra.run.trial114.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-22T20:28:45.630 INFO:teuthology.orchestra.run.trial114.stdout:ANSI_COLOR="0;32"
2026-02-22T20:28:45.630 INFO:teuthology.orchestra.run.trial114.stdout:LOGO="fedora-logo-icon"
2026-02-22T20:28:45.630 INFO:teuthology.orchestra.run.trial114.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-22T20:28:45.630 INFO:teuthology.orchestra.run.trial114.stdout:HOME_URL="https://rockylinux.org/"
2026-02-22T20:28:45.630 INFO:teuthology.orchestra.run.trial114.stdout:VENDOR_NAME="RESF"
2026-02-22T20:28:45.630 INFO:teuthology.orchestra.run.trial114.stdout:VENDOR_URL="https://resf.org/"
2026-02-22T20:28:45.630 INFO:teuthology.orchestra.run.trial114.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-22T20:28:45.630 INFO:teuthology.orchestra.run.trial114.stdout:SUPPORT_END="2035-05-31"
2026-02-22T20:28:45.630 INFO:teuthology.orchestra.run.trial114.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-22T20:28:45.630 INFO:teuthology.orchestra.run.trial114.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-22T20:28:45.630 INFO:teuthology.orchestra.run.trial114.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-22T20:28:45.630 INFO:teuthology.orchestra.run.trial114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-22T20:28:45.631 INFO:teuthology.provision.fog.trial114:Deploy complete!
2026-02-22T20:28:45.632 DEBUG:teuthology.parallel:result is None
2026-02-22T20:28:46.320 INFO:teuthology.lock.ops:Checking trial069.front.sepia.ceph.com
2026-02-22T20:28:46.320 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-22T20:28:46.383 INFO:teuthology.lock.ops:Checking trial073.front.sepia.ceph.com
2026-02-22T20:28:46.384 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-22T20:28:46.443 INFO:teuthology.lock.ops:Checking trial114.front.sepia.ceph.com
2026-02-22T20:28:46.443 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-22T20:28:46.506 INFO:teuthology.lock.ops:Checking trial172.front.sepia.ceph.com
2026-02-22T20:28:46.506 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-22T20:28:46.563 INFO:teuthology.lock.ops:Updating [trial069.front.sepia.ceph.com]: set os type and version on server
2026-02-22T20:28:46.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial069.front.sepia.ceph.com'
2026-02-22T20:28:46.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:28:46.625 DEBUG:teuthology.orchestra.run.trial069:> true
2026-02-22T20:28:46.699 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial069.front.sepia.ceph.com'
2026-02-22T20:28:46.699 DEBUG:teuthology.orchestra.run.trial069:> uname -m
2026-02-22T20:28:46.757 INFO:teuthology.orchestra.run.trial069.stdout:x86_64
2026-02-22T20:28:46.757 DEBUG:teuthology.orchestra.run.trial069:> cat /etc/os-release
2026-02-22T20:28:46.815 INFO:teuthology.orchestra.run.trial069.stdout:NAME="Rocky Linux"
2026-02-22T20:28:46.815 INFO:teuthology.orchestra.run.trial069.stdout:VERSION="10.1 (Red Quartz)"
2026-02-22T20:28:46.815 INFO:teuthology.orchestra.run.trial069.stdout:ID="rocky"
2026-02-22T20:28:46.815 INFO:teuthology.orchestra.run.trial069.stdout:ID_LIKE="rhel centos fedora"
2026-02-22T20:28:46.815 INFO:teuthology.orchestra.run.trial069.stdout:VERSION_ID="10.1"
2026-02-22T20:28:46.815 INFO:teuthology.orchestra.run.trial069.stdout:PLATFORM_ID="platform:el10"
2026-02-22T20:28:46.815 INFO:teuthology.orchestra.run.trial069.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-22T20:28:46.815 INFO:teuthology.orchestra.run.trial069.stdout:ANSI_COLOR="0;32"
2026-02-22T20:28:46.816 INFO:teuthology.orchestra.run.trial069.stdout:LOGO="fedora-logo-icon"
2026-02-22T20:28:46.816 INFO:teuthology.orchestra.run.trial069.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-22T20:28:46.816 INFO:teuthology.orchestra.run.trial069.stdout:HOME_URL="https://rockylinux.org/"
2026-02-22T20:28:46.816 INFO:teuthology.orchestra.run.trial069.stdout:VENDOR_NAME="RESF"
2026-02-22T20:28:46.816 INFO:teuthology.orchestra.run.trial069.stdout:VENDOR_URL="https://resf.org/"
2026-02-22T20:28:46.816 INFO:teuthology.orchestra.run.trial069.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-22T20:28:46.816 INFO:teuthology.orchestra.run.trial069.stdout:SUPPORT_END="2035-05-31"
2026-02-22T20:28:46.816 INFO:teuthology.orchestra.run.trial069.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-22T20:28:46.816 INFO:teuthology.orchestra.run.trial069.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-22T20:28:46.816 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-22T20:28:46.816 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-22T20:28:46.817 INFO:teuthology.lock.ops:Updating trial069.front.sepia.ceph.com on lock server
2026-02-22T20:28:46.914 INFO:teuthology.lock.ops:Updating [trial073.front.sepia.ceph.com]: set os type and version on server
2026-02-22T20:28:46.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial073.front.sepia.ceph.com'
2026-02-22T20:28:46.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:28:46.987 DEBUG:teuthology.orchestra.run.trial073:> true
2026-02-22T20:28:47.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial073.front.sepia.ceph.com'
2026-02-22T20:28:47.064 DEBUG:teuthology.orchestra.run.trial073:> uname -m
2026-02-22T20:28:47.121 INFO:teuthology.orchestra.run.trial073.stdout:x86_64
2026-02-22T20:28:47.122 DEBUG:teuthology.orchestra.run.trial073:> cat /etc/os-release
2026-02-22T20:28:47.178 INFO:teuthology.orchestra.run.trial073.stdout:NAME="Rocky Linux"
2026-02-22T20:28:47.178 INFO:teuthology.orchestra.run.trial073.stdout:VERSION="10.1 (Red Quartz)"
2026-02-22T20:28:47.178 INFO:teuthology.orchestra.run.trial073.stdout:ID="rocky"
2026-02-22T20:28:47.179 INFO:teuthology.orchestra.run.trial073.stdout:ID_LIKE="rhel centos fedora"
2026-02-22T20:28:47.179 INFO:teuthology.orchestra.run.trial073.stdout:VERSION_ID="10.1"
2026-02-22T20:28:47.179 INFO:teuthology.orchestra.run.trial073.stdout:PLATFORM_ID="platform:el10"
2026-02-22T20:28:47.179 INFO:teuthology.orchestra.run.trial073.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-22T20:28:47.179 INFO:teuthology.orchestra.run.trial073.stdout:ANSI_COLOR="0;32"
2026-02-22T20:28:47.179 INFO:teuthology.orchestra.run.trial073.stdout:LOGO="fedora-logo-icon"
2026-02-22T20:28:47.179 INFO:teuthology.orchestra.run.trial073.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-22T20:28:47.179 INFO:teuthology.orchestra.run.trial073.stdout:HOME_URL="https://rockylinux.org/"
2026-02-22T20:28:47.179 INFO:teuthology.orchestra.run.trial073.stdout:VENDOR_NAME="RESF"
2026-02-22T20:28:47.179 INFO:teuthology.orchestra.run.trial073.stdout:VENDOR_URL="https://resf.org/"
2026-02-22T20:28:47.179 INFO:teuthology.orchestra.run.trial073.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-22T20:28:47.179 INFO:teuthology.orchestra.run.trial073.stdout:SUPPORT_END="2035-05-31"
2026-02-22T20:28:47.179 INFO:teuthology.orchestra.run.trial073.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-22T20:28:47.179 INFO:teuthology.orchestra.run.trial073.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-22T20:28:47.179 INFO:teuthology.orchestra.run.trial073.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-22T20:28:47.179 INFO:teuthology.orchestra.run.trial073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-22T20:28:47.179 INFO:teuthology.lock.ops:Updating trial073.front.sepia.ceph.com on lock server
2026-02-22T20:28:47.247 INFO:teuthology.lock.ops:Updating [trial114.front.sepia.ceph.com]: set os type and version on server
2026-02-22T20:28:47.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com'
2026-02-22T20:28:47.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:28:47.309 DEBUG:teuthology.orchestra.run.trial114:> true
2026-02-22T20:28:47.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com'
2026-02-22T20:28:47.385 DEBUG:teuthology.orchestra.run.trial114:> uname -m
2026-02-22T20:28:47.443 INFO:teuthology.orchestra.run.trial114.stdout:x86_64
2026-02-22T20:28:47.444 DEBUG:teuthology.orchestra.run.trial114:> cat /etc/os-release
2026-02-22T20:28:47.500 INFO:teuthology.orchestra.run.trial114.stdout:NAME="Rocky Linux"
2026-02-22T20:28:47.501 INFO:teuthology.orchestra.run.trial114.stdout:VERSION="10.1 (Red Quartz)"
2026-02-22T20:28:47.501 INFO:teuthology.orchestra.run.trial114.stdout:ID="rocky"
2026-02-22T20:28:47.501 INFO:teuthology.orchestra.run.trial114.stdout:ID_LIKE="rhel centos fedora"
2026-02-22T20:28:47.501 INFO:teuthology.orchestra.run.trial114.stdout:VERSION_ID="10.1"
2026-02-22T20:28:47.501 INFO:teuthology.orchestra.run.trial114.stdout:PLATFORM_ID="platform:el10"
2026-02-22T20:28:47.501 INFO:teuthology.orchestra.run.trial114.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-22T20:28:47.501 INFO:teuthology.orchestra.run.trial114.stdout:ANSI_COLOR="0;32"
2026-02-22T20:28:47.501 INFO:teuthology.orchestra.run.trial114.stdout:LOGO="fedora-logo-icon"
2026-02-22T20:28:47.501 INFO:teuthology.orchestra.run.trial114.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-22T20:28:47.501 INFO:teuthology.orchestra.run.trial114.stdout:HOME_URL="https://rockylinux.org/"
2026-02-22T20:28:47.501 INFO:teuthology.orchestra.run.trial114.stdout:VENDOR_NAME="RESF"
2026-02-22T20:28:47.501 INFO:teuthology.orchestra.run.trial114.stdout:VENDOR_URL="https://resf.org/"
2026-02-22T20:28:47.501 INFO:teuthology.orchestra.run.trial114.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-22T20:28:47.501 INFO:teuthology.orchestra.run.trial114.stdout:SUPPORT_END="2035-05-31"
2026-02-22T20:28:47.501 INFO:teuthology.orchestra.run.trial114.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-22T20:28:47.501 INFO:teuthology.orchestra.run.trial114.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-22T20:28:47.501 INFO:teuthology.orchestra.run.trial114.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-22T20:28:47.501 INFO:teuthology.orchestra.run.trial114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-22T20:28:47.501 INFO:teuthology.lock.ops:Updating trial114.front.sepia.ceph.com on lock server
2026-02-22T20:28:47.560 INFO:teuthology.lock.ops:Updating [trial172.front.sepia.ceph.com]: set os type and version on server
2026-02-22T20:28:47.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial172.front.sepia.ceph.com'
2026-02-22T20:28:47.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-22T20:28:47.623 DEBUG:teuthology.orchestra.run.trial172:> true
2026-02-22T20:28:47.696 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial172.front.sepia.ceph.com'
2026-02-22T20:28:47.696 DEBUG:teuthology.orchestra.run.trial172:> uname -m
2026-02-22T20:28:47.754 INFO:teuthology.orchestra.run.trial172.stdout:x86_64
2026-02-22T20:28:47.754 DEBUG:teuthology.orchestra.run.trial172:> cat /etc/os-release
2026-02-22T20:28:47.812 INFO:teuthology.orchestra.run.trial172.stdout:NAME="Rocky Linux"
2026-02-22T20:28:47.812 INFO:teuthology.orchestra.run.trial172.stdout:VERSION="10.1 (Red Quartz)"
2026-02-22T20:28:47.812 INFO:teuthology.orchestra.run.trial172.stdout:ID="rocky"
2026-02-22T20:28:47.812 INFO:teuthology.orchestra.run.trial172.stdout:ID_LIKE="rhel centos fedora"
2026-02-22T20:28:47.812 INFO:teuthology.orchestra.run.trial172.stdout:VERSION_ID="10.1"
2026-02-22T20:28:47.813 INFO:teuthology.orchestra.run.trial172.stdout:PLATFORM_ID="platform:el10"
2026-02-22T20:28:47.813 INFO:teuthology.orchestra.run.trial172.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-22T20:28:47.813 INFO:teuthology.orchestra.run.trial172.stdout:ANSI_COLOR="0;32"
2026-02-22T20:28:47.813 INFO:teuthology.orchestra.run.trial172.stdout:LOGO="fedora-logo-icon"
2026-02-22T20:28:47.813 INFO:teuthology.orchestra.run.trial172.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-22T20:28:47.813 INFO:teuthology.orchestra.run.trial172.stdout:HOME_URL="https://rockylinux.org/"
2026-02-22T20:28:47.813 INFO:teuthology.orchestra.run.trial172.stdout:VENDOR_NAME="RESF"
2026-02-22T20:28:47.813 INFO:teuthology.orchestra.run.trial172.stdout:VENDOR_URL="https://resf.org/"
2026-02-22T20:28:47.813 INFO:teuthology.orchestra.run.trial172.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-22T20:28:47.813 INFO:teuthology.orchestra.run.trial172.stdout:SUPPORT_END="2035-05-31"
2026-02-22T20:28:47.813 INFO:teuthology.orchestra.run.trial172.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-22T20:28:47.814 INFO:teuthology.orchestra.run.trial172.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-22T20:28:47.814 INFO:teuthology.orchestra.run.trial172.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-22T20:28:47.814 INFO:teuthology.orchestra.run.trial172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-22T20:28:47.814 INFO:teuthology.lock.ops:Updating trial172.front.sepia.ceph.com on lock server
2026-02-22T20:28:47.923 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-22T20:28:48.017 INFO:teuthology.dispatcher.supervisor:Running job 64518
2026-02-22T20:28:48.017 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_nmordech@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64518 --name nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial --description rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-4} ec_optimizations/ec_optimizations_off mon_election/classic msgr-failures/osd-dispatch-delay objectstore/{bluestore/{alloc$/{stupid} base mem$/{normal-2} onode-segment$/{512K} write$/{v1/{compr$/{yes$/{snappy}} v1}}}} rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rpm_latest} thrashers/mapgap_host thrashosds-health workloads/ec-rados-plugin=isa-k=10-m=4} -- /home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64518/orig.config.yaml
2026-02-22T20:28:48.018 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64518
2026-02-22T20:28:48.018 INFO:teuthology.dispatcher.supervisor:Job PID: 3875371
2026-02-22T20:28:48.018 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-22T20:30:48.117 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-22T20:32:48.287 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-22T20:34:48.471 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-22T20:36:48.664 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-22T20:38:49.215 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-22T20:40:49.388 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-22T20:42:49.586 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-22T20:44:49.800 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-22T20:46:49.957 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-22T20:48:50.165 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-22T20:50:50.371 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-22T20:52:50.494 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-22T20:54:50.674 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-22T20:54:50.745 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-22T20:54:50.968 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-22T20:54:51.966 INFO:teuthology.orchestra.console.trial069:Power off
2026-02-22T20:54:51.966 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-22T20:54:51.974 INFO:teuthology.orchestra.console.trial114:Power off
2026-02-22T20:54:51.974 DEBUG:teuthology.orchestra.console.trial114:pexpect command: ipmitool -H trial114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-22T20:54:51.993 INFO:teuthology.orchestra.console.trial172:Power off
2026-02-22T20:54:51.993 DEBUG:teuthology.orchestra.console.trial172:pexpect command: ipmitool -H trial172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-22T20:54:52.003 INFO:teuthology.orchestra.console.trial073:Power off
2026-02-22T20:54:52.003 DEBUG:teuthology.orchestra.console.trial073:pexpect command: ipmitool -H trial073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-22T20:54:52.010 DEBUG:teuthology.orchestra.console.trial069:power off output: Chassis Power Control: Down/Off
2026-02-22T20:54:52.011 DEBUG:teuthology.orchestra.console.trial114:power off output: Chassis Power Control: Down/Off
2026-02-22T20:54:52.030 DEBUG:teuthology.orchestra.console.trial172:power off output: Chassis Power Control: Down/Off
2026-02-22T20:54:52.041 DEBUG:teuthology.orchestra.console.trial073:power off output: Chassis Power Control: Down/Off
2026-02-22T20:54:56.014 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-22T20:54:56.021 DEBUG:teuthology.orchestra.console.trial114:pexpect command: ipmitool -H trial114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-22T20:54:56.031 DEBUG:teuthology.orchestra.console.trial172:pexpect command: ipmitool -H trial172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-22T20:54:56.042 DEBUG:teuthology.orchestra.console.trial073:pexpect command: ipmitool -H trial073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-22T20:54:56.123 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is on
2026-02-22T20:54:56.130 DEBUG:teuthology.orchestra.console.trial114:check power output: Chassis Power is on
2026-02-22T20:54:56.139 DEBUG:teuthology.orchestra.console.trial172:check power output: Chassis Power is on
2026-02-22T20:54:56.151 DEBUG:teuthology.orchestra.console.trial073:check power output: Chassis Power is on
2026-02-22T20:55:00.128 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-22T20:55:00.135 DEBUG:teuthology.orchestra.console.trial114:pexpect command: ipmitool -H trial114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-22T20:55:00.143 DEBUG:teuthology.orchestra.console.trial172:pexpect command: ipmitool -H trial172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-22T20:55:00.151 DEBUG:teuthology.orchestra.console.trial073:pexpect command: ipmitool -H trial073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-22T20:55:00.237 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is off
2026-02-22T20:55:00.237 INFO:teuthology.orchestra.console.trial069:Power off completed
2026-02-22T20:55:00.244 DEBUG:teuthology.orchestra.console.trial114:check power output: Chassis Power is off
2026-02-22T20:55:00.244 INFO:teuthology.orchestra.console.trial114:Power off completed
2026-02-22T20:55:00.251 DEBUG:teuthology.orchestra.console.trial172:check power output: Chassis Power is off
2026-02-22T20:55:00.251 INFO:teuthology.orchestra.console.trial172:Power off completed
2026-02-22T20:55:00.261 DEBUG:teuthology.orchestra.console.trial073:check power output: Chassis Power is off
2026-02-22T20:55:00.261 INFO:teuthology.orchestra.console.trial073:Power off completed
2026-02-22T20:55:00.527 INFO:teuthology.lock.ops:unlocked: trial069.front.sepia.ceph.com
2026-02-22T20:55:00.535 INFO:teuthology.lock.ops:unlocked: trial172.front.sepia.ceph.com
2026-02-22T20:55:00.539 INFO:teuthology.lock.ops:unlocked: trial114.front.sepia.ceph.com
2026-02-22T20:55:00.544 INFO:teuthology.lock.ops:unlocked: trial073.front.sepia.ceph.com