2026-02-19T13:37:57.164 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-19T13:37:57.165 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T13:37:57.240 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T13:37:57.548 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x728e65282270>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x728e64a6d6c0>, signals=[15])
2026-02-19T13:37:57.548 INFO:teuthology.lock.ops:Start node 'trial030.front.sepia.ceph.com' reimaging
2026-02-19T13:37:57.548 INFO:teuthology.lock.ops:Updating [trial030.front.sepia.ceph.com]: reset os type and version on server
2026-02-19T13:37:57.549 INFO:teuthology.lock.ops:Updating trial030.front.sepia.ceph.com on lock server
2026-02-19T13:37:57.605 INFO:teuthology.lock.ops:Start node 'trial044.front.sepia.ceph.com' reimaging
2026-02-19T13:37:57.605 INFO:teuthology.lock.ops:Updating [trial044.front.sepia.ceph.com]: reset os type and version on server
2026-02-19T13:37:57.606 INFO:teuthology.lock.ops:Updating trial044.front.sepia.ceph.com on lock server
2026-02-19T13:37:57.665 INFO:teuthology.lock.ops:Start node 'trial121.front.sepia.ceph.com' reimaging
2026-02-19T13:37:57.665 INFO:teuthology.lock.ops:Updating [trial121.front.sepia.ceph.com]: reset os type and version on server
2026-02-19T13:37:57.665 INFO:teuthology.lock.ops:Updating trial121.front.sepia.ceph.com on lock server
2026-02-19T13:37:57.761 INFO:teuthology.lock.ops:Start node 'trial150.front.sepia.ceph.com' reimaging
2026-02-19T13:37:57.761 INFO:teuthology.lock.ops:Updating [trial150.front.sepia.ceph.com]: reset os type and version on server
2026-02-19T13:37:57.761 INFO:teuthology.lock.ops:Updating trial150.front.sepia.ceph.com on lock server
2026-02-19T13:37:57.946 DEBUG:teuthology.provision.fog.trial044:Requesting image trial_rocky_10.1 (ID 4)
2026-02-19T13:37:57.946 DEBUG:teuthology.provision.fog.trial030:Requesting image trial_rocky_10.1 (ID 4)
2026-02-19T13:37:58.002 INFO:teuthology.provision.fog.trial044:Scheduling deploy of rocky 10.1
2026-02-19T13:37:58.004 INFO:teuthology.provision.fog.trial030:Scheduling deploy of rocky 10.1
2026-02-19T13:37:58.030 DEBUG:teuthology.provision.fog.trial150:Requesting image trial_rocky_10.1 (ID 4)
2026-02-19T13:37:58.043 DEBUG:teuthology.provision.fog.trial121:Requesting image trial_rocky_10.1 (ID 4)
2026-02-19T13:37:58.068 INFO:teuthology.provision.fog.trial121:Scheduling deploy of rocky 10.1
2026-02-19T13:37:58.084 INFO:teuthology.provision.fog.trial150:Scheduling deploy of rocky 10.1
2026-02-19T13:38:00.179 INFO:teuthology.orchestra.console.trial121:Power off
2026-02-19T13:38:00.179 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-19T13:38:00.238 INFO:teuthology.orchestra.console.trial044:Power off
2026-02-19T13:38:00.238 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-19T13:38:00.250 INFO:teuthology.orchestra.console.trial030:Power off
2026-02-19T13:38:00.250 DEBUG:teuthology.orchestra.console.trial030:pexpect command: ipmitool -H trial030.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-19T13:38:00.257 DEBUG:teuthology.orchestra.console.trial121:power off output: Chassis Power Control: Down/Off
2026-02-19T13:38:00.262 INFO:teuthology.orchestra.console.trial150:Power off
2026-02-19T13:38:00.262 DEBUG:teuthology.orchestra.console.trial150:pexpect command: ipmitool -H trial150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-19T13:38:00.277 DEBUG:teuthology.orchestra.console.trial044:power off output: Chassis Power Control: Down/Off
2026-02-19T13:38:00.288 DEBUG:teuthology.orchestra.console.trial030:power off output: Chassis Power Control: Down/Off
2026-02-19T13:38:00.299 DEBUG:teuthology.orchestra.console.trial150:power off output: Chassis Power Control: Down/Off
2026-02-19T13:38:04.262 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T13:38:04.278 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T13:38:04.289 DEBUG:teuthology.orchestra.console.trial030:pexpect command: ipmitool -H trial030.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T13:38:04.300 DEBUG:teuthology.orchestra.console.trial150:pexpect command: ipmitool -H trial150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T13:38:04.372 DEBUG:teuthology.orchestra.console.trial121:check power output: Chassis Power is off
2026-02-19T13:38:04.372 INFO:teuthology.orchestra.console.trial121:Power off completed
2026-02-19T13:38:04.386 DEBUG:teuthology.orchestra.console.trial044:check power output: Chassis Power is off
2026-02-19T13:38:04.386 INFO:teuthology.orchestra.console.trial044:Power off completed
2026-02-19T13:38:04.399 DEBUG:teuthology.orchestra.console.trial030:check power output: Chassis Power is off
2026-02-19T13:38:04.399 INFO:teuthology.orchestra.console.trial030:Power off completed
2026-02-19T13:38:04.410 DEBUG:teuthology.orchestra.console.trial150:check power output: Chassis Power is off
2026-02-19T13:38:04.410 INFO:teuthology.orchestra.console.trial150:Power off completed
2026-02-19T13:38:04.473 INFO:teuthology.orchestra.console.trial121:Power on
2026-02-19T13:38:04.474 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-19T13:38:04.487 INFO:teuthology.orchestra.console.trial044:Power on
2026-02-19T13:38:04.487 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-19T13:38:04.499 INFO:teuthology.orchestra.console.trial030:Power on
2026-02-19T13:38:04.500 DEBUG:teuthology.orchestra.console.trial030:pexpect command: ipmitool -H trial030.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-19T13:38:04.511 DEBUG:teuthology.orchestra.console.trial121:power on output: Chassis Power Control: Up/On
2026-02-19T13:38:04.511 INFO:teuthology.orchestra.console.trial150:Power on
2026-02-19T13:38:04.511 DEBUG:teuthology.orchestra.console.trial150:pexpect command: ipmitool -H trial150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-19T13:38:04.526 DEBUG:teuthology.orchestra.console.trial044:power on output: Chassis Power Control: Up/On
2026-02-19T13:38:04.538 DEBUG:teuthology.orchestra.console.trial030:power on output: Chassis Power Control: Up/On
2026-02-19T13:38:04.550 DEBUG:teuthology.orchestra.console.trial150:power on output: Chassis Power Control: Up/On
2026-02-19T13:38:08.515 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T13:38:08.527 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T13:38:08.539 DEBUG:teuthology.orchestra.console.trial030:pexpect command: ipmitool -H trial030.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T13:38:08.551 DEBUG:teuthology.orchestra.console.trial150:pexpect command: ipmitool -H trial150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T13:38:08.623 DEBUG:teuthology.orchestra.console.trial121:check power output: Chassis Power is on
2026-02-19T13:38:08.623 INFO:teuthology.orchestra.console.trial121:Power on completed
2026-02-19T13:38:08.635 DEBUG:teuthology.orchestra.console.trial044:check power output: Chassis Power is off
2026-02-19T13:38:08.647 DEBUG:teuthology.orchestra.console.trial030:check power output: Chassis Power is off
2026-02-19T13:38:08.660 DEBUG:teuthology.orchestra.console.trial150:check power output: Chassis Power is off
2026-02-19T13:38:08.724 INFO:teuthology.provision.fog.trial121:Waiting for deploy to finish
2026-02-19T13:38:12.639 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T13:38:12.647 DEBUG:teuthology.orchestra.console.trial030:pexpect command: ipmitool -H trial030.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T13:38:12.661 DEBUG:teuthology.orchestra.console.trial150:pexpect command: ipmitool -H trial150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T13:38:12.747 DEBUG:teuthology.orchestra.console.trial044:check power output: Chassis Power is on
2026-02-19T13:38:12.748 INFO:teuthology.orchestra.console.trial044:Power on completed
2026-02-19T13:38:12.755 DEBUG:teuthology.orchestra.console.trial030:check power output: Chassis Power is on
2026-02-19T13:38:12.755 INFO:teuthology.orchestra.console.trial030:Power on completed
2026-02-19T13:38:12.770 DEBUG:teuthology.orchestra.console.trial150:check power output: Chassis Power is on
2026-02-19T13:38:12.770 INFO:teuthology.orchestra.console.trial150:Power on completed
2026-02-19T13:38:12.849 INFO:teuthology.provision.fog.trial044:Waiting for deploy to finish
2026-02-19T13:38:12.856 INFO:teuthology.provision.fog.trial030:Waiting for deploy to finish
2026-02-19T13:38:12.870 INFO:teuthology.provision.fog.trial150:Waiting for deploy to finish
2026-02-19T13:40:00.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:00.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial030.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:00.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:04.032 WARNING:teuthology.provision.fog.trial150:[Errno None] Unable to connect to port 22 on 10.20.193.150
2026-02-19T13:40:04.032 WARNING:teuthology.provision.fog.trial030:[Errno None] Unable to connect to port 22 on 10.20.193.30
2026-02-19T13:40:04.096 WARNING:teuthology.provision.fog.trial044:[Errno None] Unable to connect to port 22 on 10.20.193.44
2026-02-19T13:40:10.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:10.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial030.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:10.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:12.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:13.120 WARNING:teuthology.provision.fog.trial150:[Errno None] Unable to connect to port 22 on 10.20.193.150
2026-02-19T13:40:13.120 WARNING:teuthology.provision.fog.trial030:[Errno None] Unable to connect to port 22 on 10.20.193.30
2026-02-19T13:40:13.183 WARNING:teuthology.provision.fog.trial044:[Errno None] Unable to connect to port 22 on 10.20.193.44
2026-02-19T13:40:15.360 WARNING:teuthology.provision.fog.trial121:[Errno None] Unable to connect to port 22 on 10.20.193.121
2026-02-19T13:40:19.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:19.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial030.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:19.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:21.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:22.208 WARNING:teuthology.provision.fog.trial030:[Errno None] Unable to connect to port 22 on 10.20.193.30
2026-02-19T13:40:22.208 WARNING:teuthology.provision.fog.trial150:[Errno None] Unable to connect to port 22 on 10.20.193.150
2026-02-19T13:40:22.272 WARNING:teuthology.provision.fog.trial044:[Errno None] Unable to connect to port 22 on 10.20.193.44
2026-02-19T13:40:24.448 WARNING:teuthology.provision.fog.trial121:[Errno None] Unable to connect to port 22 on 10.20.193.121
2026-02-19T13:40:28.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial030.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:28.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:28.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:30.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:31.295 WARNING:teuthology.provision.fog.trial150:[Errno None] Unable to connect to port 22 on 10.20.193.150
2026-02-19T13:40:31.296 WARNING:teuthology.provision.fog.trial030:[Errno None] Unable to connect to port 22 on 10.20.193.30
2026-02-19T13:40:31.359 WARNING:teuthology.provision.fog.trial044:[Errno None] Unable to connect to port 22 on 10.20.193.44
2026-02-19T13:40:33.536 WARNING:teuthology.provision.fog.trial121:[Errno None] Unable to connect to port 22 on 10.20.193.121
2026-02-19T13:40:37.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:37.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial030.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:37.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:39.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:40.383 WARNING:teuthology.provision.fog.trial150:[Errno None] Unable to connect to port 22 on 10.20.193.150
2026-02-19T13:40:40.384 WARNING:teuthology.provision.fog.trial030:[Errno None] Unable to connect to port 22 on 10.20.193.30
2026-02-19T13:40:40.448 WARNING:teuthology.provision.fog.trial044:[Errno None] Unable to connect to port 22 on 10.20.193.44
2026-02-19T13:40:42.624 WARNING:teuthology.provision.fog.trial121:[Errno None] Unable to connect to port 22 on 10.20.193.121
2026-02-19T13:40:46.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:46.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial030.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:46.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:40:48.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:41:22.589 ERROR:teuthology.orchestra.connection:Error authenticating with trial030.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-19T13:41:22.608 ERROR:teuthology.orchestra.connection:Error authenticating with trial150.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-19T13:41:22.794 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-19T13:41:22.795 DEBUG:teuthology.orchestra.run.trial044:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-19T13:41:24.611 ERROR:teuthology.orchestra.connection:Error authenticating with trial121.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-19T13:41:26.745 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-19T13:41:26.745 DEBUG:teuthology.orchestra.run.trial030:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-19T13:41:26.754 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-19T13:41:26.754 DEBUG:teuthology.orchestra.run.trial150:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-19T13:41:26.952 INFO:teuthology.provision.fog.trial150:Node is ready
2026-02-19T13:41:26.953 DEBUG:teuthology.orchestra.run.trial150:> hostname
2026-02-19T13:41:27.014 INFO:teuthology.orchestra.run.trial150.stdout:trial150.front.sepia.ceph.com
2026-02-19T13:41:27.014 DEBUG:teuthology.orchestra.run.trial150:> grep trial150.front.sepia.ceph.com /etc/hosts
2026-02-19T13:41:27.076 INFO:teuthology.orchestra.run.trial150.stdout:10.20.193.150 trial150.front.sepia.ceph.com trial150
2026-02-19T13:41:27.077 DEBUG:teuthology.orchestra.run.trial150:> sudo hostname trial150
2026-02-19T13:41:27.153 DEBUG:teuthology.orchestra.run.trial150:> sudo sed -i -e 's/trial150.front.sepia.ceph.com/trial150/g' /etc/hosts
2026-02-19T13:41:27.223 DEBUG:teuthology.orchestra.run.trial150:> sudo sed -i -e 's/10.20.193.150/10.20.193.150/g' /etc/hosts
2026-02-19T13:41:27.295 DEBUG:teuthology.orchestra.run.trial150:> sudo sed -i -e 's/trial150.front.sepia.ceph.com/trial150/g' /etc/hostname
2026-02-19T13:41:27.365 DEBUG:teuthology.orchestra.run.trial150:> sudo hostname trial150
2026-02-19T13:41:27.435 DEBUG:teuthology.orchestra.run.trial150:> cat /etc/os-release
2026-02-19T13:41:27.496 INFO:teuthology.orchestra.run.trial150.stdout:NAME="Rocky Linux"
2026-02-19T13:41:27.496 INFO:teuthology.orchestra.run.trial150.stdout:VERSION="10.1 (Red Quartz)"
2026-02-19T13:41:27.497 INFO:teuthology.orchestra.run.trial150.stdout:ID="rocky"
2026-02-19T13:41:27.497 INFO:teuthology.orchestra.run.trial150.stdout:ID_LIKE="rhel centos fedora"
2026-02-19T13:41:27.497 INFO:teuthology.orchestra.run.trial150.stdout:VERSION_ID="10.1"
2026-02-19T13:41:27.497 INFO:teuthology.orchestra.run.trial150.stdout:PLATFORM_ID="platform:el10"
2026-02-19T13:41:27.497 INFO:teuthology.orchestra.run.trial150.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-19T13:41:27.497 INFO:teuthology.orchestra.run.trial150.stdout:ANSI_COLOR="0;32"
2026-02-19T13:41:27.497 INFO:teuthology.orchestra.run.trial150.stdout:LOGO="fedora-logo-icon"
2026-02-19T13:41:27.497 INFO:teuthology.orchestra.run.trial150.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-19T13:41:27.497 INFO:teuthology.orchestra.run.trial150.stdout:HOME_URL="https://rockylinux.org/"
2026-02-19T13:41:27.497 INFO:teuthology.orchestra.run.trial150.stdout:VENDOR_NAME="RESF"
2026-02-19T13:41:27.497 INFO:teuthology.orchestra.run.trial150.stdout:VENDOR_URL="https://resf.org/"
2026-02-19T13:41:27.497 INFO:teuthology.orchestra.run.trial150.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-19T13:41:27.498 INFO:teuthology.orchestra.run.trial150.stdout:SUPPORT_END="2035-05-31"
2026-02-19T13:41:27.498 INFO:teuthology.orchestra.run.trial150.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-19T13:41:27.498 INFO:teuthology.orchestra.run.trial150.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T13:41:27.498 INFO:teuthology.orchestra.run.trial150.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-19T13:41:27.498 INFO:teuthology.orchestra.run.trial150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T13:41:27.499 INFO:teuthology.provision.fog.trial150:Deploy complete!
2026-02-19T13:41:27.500 DEBUG:teuthology.parallel:result is None
2026-02-19T13:41:28.247 INFO:teuthology.provision.fog.trial044:Node is ready
2026-02-19T13:41:28.248 DEBUG:teuthology.orchestra.run.trial044:> hostname
2026-02-19T13:41:28.265 INFO:teuthology.orchestra.run.trial044.stdout:trial044.front.sepia.ceph.com
2026-02-19T13:41:28.266 DEBUG:teuthology.orchestra.run.trial044:> grep trial044.front.sepia.ceph.com /etc/hosts
2026-02-19T13:41:28.323 INFO:teuthology.orchestra.run.trial044.stdout:10.20.193.44 trial044.front.sepia.ceph.com trial044
2026-02-19T13:41:28.324 DEBUG:teuthology.orchestra.run.trial044:> sudo hostname trial044
2026-02-19T13:41:28.397 DEBUG:teuthology.orchestra.run.trial044:> sudo sed -i -e 's/trial044.front.sepia.ceph.com/trial044/g' /etc/hosts
2026-02-19T13:41:28.464 DEBUG:teuthology.orchestra.run.trial044:> sudo sed -i -e 's/10.20.193.44/10.20.193.44/g' /etc/hosts
2026-02-19T13:41:28.532 DEBUG:teuthology.orchestra.run.trial044:> sudo sed -i -e 's/trial044.front.sepia.ceph.com/trial044/g' /etc/hostname
2026-02-19T13:41:28.599 DEBUG:teuthology.orchestra.run.trial044:> sudo hostname trial044
2026-02-19T13:41:28.719 ERROR:teuthology.orchestra.connection:Error authenticating with trial121.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-19T13:41:28.735 DEBUG:teuthology.orchestra.run.trial044:> cat /etc/os-release
2026-02-19T13:41:28.791 INFO:teuthology.orchestra.run.trial044.stdout:NAME="Rocky Linux"
2026-02-19T13:41:28.791 INFO:teuthology.orchestra.run.trial044.stdout:VERSION="10.1 (Red Quartz)"
2026-02-19T13:41:28.791 INFO:teuthology.orchestra.run.trial044.stdout:ID="rocky"
2026-02-19T13:41:28.791 INFO:teuthology.orchestra.run.trial044.stdout:ID_LIKE="rhel centos fedora"
2026-02-19T13:41:28.791 INFO:teuthology.orchestra.run.trial044.stdout:VERSION_ID="10.1"
2026-02-19T13:41:28.791 INFO:teuthology.orchestra.run.trial044.stdout:PLATFORM_ID="platform:el10"
2026-02-19T13:41:28.791 INFO:teuthology.orchestra.run.trial044.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-19T13:41:28.791 INFO:teuthology.orchestra.run.trial044.stdout:ANSI_COLOR="0;32"
2026-02-19T13:41:28.791 INFO:teuthology.orchestra.run.trial044.stdout:LOGO="fedora-logo-icon"
2026-02-19T13:41:28.791 INFO:teuthology.orchestra.run.trial044.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-19T13:41:28.791 INFO:teuthology.orchestra.run.trial044.stdout:HOME_URL="https://rockylinux.org/"
2026-02-19T13:41:28.791 INFO:teuthology.orchestra.run.trial044.stdout:VENDOR_NAME="RESF"
2026-02-19T13:41:28.791 INFO:teuthology.orchestra.run.trial044.stdout:VENDOR_URL="https://resf.org/"
2026-02-19T13:41:28.791 INFO:teuthology.orchestra.run.trial044.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-19T13:41:28.791 INFO:teuthology.orchestra.run.trial044.stdout:SUPPORT_END="2035-05-31"
2026-02-19T13:41:28.792 INFO:teuthology.orchestra.run.trial044.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-19T13:41:28.792 INFO:teuthology.orchestra.run.trial044.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T13:41:28.792 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-19T13:41:28.792 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T13:41:28.792 INFO:teuthology.provision.fog.trial044:Deploy complete!
2026-02-19T13:41:28.792 DEBUG:teuthology.parallel:result is None
2026-02-19T13:41:31.655 INFO:teuthology.provision.fog.trial030:Node is ready
2026-02-19T13:41:31.655 DEBUG:teuthology.orchestra.run.trial030:> hostname
2026-02-19T13:41:31.673 INFO:teuthology.orchestra.run.trial030.stdout:trial030.front.sepia.ceph.com
2026-02-19T13:41:31.674 DEBUG:teuthology.orchestra.run.trial030:> grep trial030.front.sepia.ceph.com /etc/hosts
2026-02-19T13:41:31.732 INFO:teuthology.orchestra.run.trial030.stdout:10.20.193.30 trial030.front.sepia.ceph.com trial030
2026-02-19T13:41:31.732 DEBUG:teuthology.orchestra.run.trial030:> sudo hostname trial030
2026-02-19T13:41:31.805 DEBUG:teuthology.orchestra.run.trial030:> sudo sed -i -e 's/trial030.front.sepia.ceph.com/trial030/g' /etc/hosts
2026-02-19T13:41:31.874 DEBUG:teuthology.orchestra.run.trial030:> sudo sed -i -e 's/10.20.193.30/10.20.193.30/g' /etc/hosts
2026-02-19T13:41:31.941 DEBUG:teuthology.orchestra.run.trial030:> sudo sed -i -e 's/trial030.front.sepia.ceph.com/trial030/g' /etc/hostname
2026-02-19T13:41:32.008 DEBUG:teuthology.orchestra.run.trial030:> sudo hostname trial030
2026-02-19T13:41:32.076 DEBUG:teuthology.orchestra.run.trial030:> cat /etc/os-release
2026-02-19T13:41:32.134 INFO:teuthology.orchestra.run.trial030.stdout:NAME="Rocky Linux"
2026-02-19T13:41:32.134 INFO:teuthology.orchestra.run.trial030.stdout:VERSION="10.1 (Red Quartz)"
2026-02-19T13:41:32.134 INFO:teuthology.orchestra.run.trial030.stdout:ID="rocky"
2026-02-19T13:41:32.135 INFO:teuthology.orchestra.run.trial030.stdout:ID_LIKE="rhel centos fedora"
2026-02-19T13:41:32.135 INFO:teuthology.orchestra.run.trial030.stdout:VERSION_ID="10.1"
2026-02-19T13:41:32.135 INFO:teuthology.orchestra.run.trial030.stdout:PLATFORM_ID="platform:el10"
2026-02-19T13:41:32.135 INFO:teuthology.orchestra.run.trial030.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-19T13:41:32.135 INFO:teuthology.orchestra.run.trial030.stdout:ANSI_COLOR="0;32"
2026-02-19T13:41:32.135 INFO:teuthology.orchestra.run.trial030.stdout:LOGO="fedora-logo-icon"
2026-02-19T13:41:32.135 INFO:teuthology.orchestra.run.trial030.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-19T13:41:32.135 INFO:teuthology.orchestra.run.trial030.stdout:HOME_URL="https://rockylinux.org/"
2026-02-19T13:41:32.135 INFO:teuthology.orchestra.run.trial030.stdout:VENDOR_NAME="RESF"
2026-02-19T13:41:32.135 INFO:teuthology.orchestra.run.trial030.stdout:VENDOR_URL="https://resf.org/"
2026-02-19T13:41:32.135 INFO:teuthology.orchestra.run.trial030.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-19T13:41:32.135 INFO:teuthology.orchestra.run.trial030.stdout:SUPPORT_END="2035-05-31"
2026-02-19T13:41:32.136 INFO:teuthology.orchestra.run.trial030.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-19T13:41:32.136 INFO:teuthology.orchestra.run.trial030.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T13:41:32.136 INFO:teuthology.orchestra.run.trial030.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-19T13:41:32.136 INFO:teuthology.orchestra.run.trial030.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T13:41:32.136 INFO:teuthology.provision.fog.trial030:Deploy complete!
2026-02-19T13:41:32.137 DEBUG:teuthology.parallel:result is None
2026-02-19T13:41:35.788 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-19T13:41:35.788 DEBUG:teuthology.orchestra.run.trial121:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-19T13:41:36.008 INFO:teuthology.provision.fog.trial121:Node is ready
2026-02-19T13:41:36.008 DEBUG:teuthology.orchestra.run.trial121:> hostname
2026-02-19T13:41:36.065 INFO:teuthology.orchestra.run.trial121.stdout:trial121.front.sepia.ceph.com
2026-02-19T13:41:36.066 DEBUG:teuthology.orchestra.run.trial121:> grep trial121.front.sepia.ceph.com /etc/hosts
2026-02-19T13:41:36.124 INFO:teuthology.orchestra.run.trial121.stdout:10.20.193.121 trial121.front.sepia.ceph.com trial121
2026-02-19T13:41:36.124 DEBUG:teuthology.orchestra.run.trial121:> sudo hostname trial121
2026-02-19T13:41:36.195 DEBUG:teuthology.orchestra.run.trial121:> sudo sed -i -e 's/trial121.front.sepia.ceph.com/trial121/g' /etc/hosts
2026-02-19T13:41:36.261 DEBUG:teuthology.orchestra.run.trial121:> sudo sed -i -e 's/10.20.193.121/10.20.193.121/g' /etc/hosts
2026-02-19T13:41:36.328 DEBUG:teuthology.orchestra.run.trial121:> sudo sed -i -e 's/trial121.front.sepia.ceph.com/trial121/g' /etc/hostname
2026-02-19T13:41:36.394 DEBUG:teuthology.orchestra.run.trial121:> sudo hostname trial121
2026-02-19T13:41:36.460 DEBUG:teuthology.orchestra.run.trial121:> cat /etc/os-release
2026-02-19T13:41:36.519 INFO:teuthology.orchestra.run.trial121.stdout:NAME="Rocky Linux"
2026-02-19T13:41:36.519 INFO:teuthology.orchestra.run.trial121.stdout:VERSION="10.1 (Red Quartz)"
2026-02-19T13:41:36.519 INFO:teuthology.orchestra.run.trial121.stdout:ID="rocky"
2026-02-19T13:41:36.519 INFO:teuthology.orchestra.run.trial121.stdout:ID_LIKE="rhel centos fedora"
2026-02-19T13:41:36.519 INFO:teuthology.orchestra.run.trial121.stdout:VERSION_ID="10.1"
2026-02-19T13:41:36.520 INFO:teuthology.orchestra.run.trial121.stdout:PLATFORM_ID="platform:el10"
2026-02-19T13:41:36.520 INFO:teuthology.orchestra.run.trial121.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-19T13:41:36.520 INFO:teuthology.orchestra.run.trial121.stdout:ANSI_COLOR="0;32"
2026-02-19T13:41:36.520 INFO:teuthology.orchestra.run.trial121.stdout:LOGO="fedora-logo-icon"
2026-02-19T13:41:36.520 INFO:teuthology.orchestra.run.trial121.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-19T13:41:36.520 INFO:teuthology.orchestra.run.trial121.stdout:HOME_URL="https://rockylinux.org/"
2026-02-19T13:41:36.520 INFO:teuthology.orchestra.run.trial121.stdout:VENDOR_NAME="RESF"
2026-02-19T13:41:36.520 INFO:teuthology.orchestra.run.trial121.stdout:VENDOR_URL="https://resf.org/"
2026-02-19T13:41:36.520 INFO:teuthology.orchestra.run.trial121.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-19T13:41:36.520 INFO:teuthology.orchestra.run.trial121.stdout:SUPPORT_END="2035-05-31"
2026-02-19T13:41:36.520 INFO:teuthology.orchestra.run.trial121.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-19T13:41:36.521 INFO:teuthology.orchestra.run.trial121.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T13:41:36.521 INFO:teuthology.orchestra.run.trial121.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-19T13:41:36.521 INFO:teuthology.orchestra.run.trial121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T13:41:36.521 INFO:teuthology.provision.fog.trial121:Deploy complete!
2026-02-19T13:41:36.521 DEBUG:teuthology.parallel:result is None
2026-02-19T13:41:37.172 INFO:teuthology.lock.ops:Checking trial030.front.sepia.ceph.com
2026-02-19T13:41:37.172 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-19T13:41:37.280 INFO:teuthology.lock.ops:Checking trial044.front.sepia.ceph.com
2026-02-19T13:41:37.280 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-19T13:41:37.342 INFO:teuthology.lock.ops:Checking trial121.front.sepia.ceph.com
2026-02-19T13:41:37.342 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-19T13:41:37.400 INFO:teuthology.lock.ops:Checking trial150.front.sepia.ceph.com
2026-02-19T13:41:37.400 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-19T13:41:37.456 INFO:teuthology.lock.ops:Updating [trial030.front.sepia.ceph.com]: set os type and version on server
2026-02-19T13:41:37.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial030.front.sepia.ceph.com'
2026-02-19T13:41:37.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial030.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:41:37.519 DEBUG:teuthology.orchestra.run.trial030:> true
2026-02-19T13:41:37.592 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial030.front.sepia.ceph.com'
2026-02-19T13:41:37.592 DEBUG:teuthology.orchestra.run.trial030:> uname -m
2026-02-19T13:41:37.649 INFO:teuthology.orchestra.run.trial030.stdout:x86_64
2026-02-19T13:41:37.650 DEBUG:teuthology.orchestra.run.trial030:> cat /etc/os-release
2026-02-19T13:41:37.706 INFO:teuthology.orchestra.run.trial030.stdout:NAME="Rocky Linux"
2026-02-19T13:41:37.706 INFO:teuthology.orchestra.run.trial030.stdout:VERSION="10.1 (Red Quartz)"
2026-02-19T13:41:37.706 INFO:teuthology.orchestra.run.trial030.stdout:ID="rocky"
2026-02-19T13:41:37.707 INFO:teuthology.orchestra.run.trial030.stdout:ID_LIKE="rhel centos fedora"
2026-02-19T13:41:37.707 INFO:teuthology.orchestra.run.trial030.stdout:VERSION_ID="10.1"
2026-02-19T13:41:37.707 INFO:teuthology.orchestra.run.trial030.stdout:PLATFORM_ID="platform:el10"
2026-02-19T13:41:37.707 INFO:teuthology.orchestra.run.trial030.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-19T13:41:37.707 INFO:teuthology.orchestra.run.trial030.stdout:ANSI_COLOR="0;32"
2026-02-19T13:41:37.707 INFO:teuthology.orchestra.run.trial030.stdout:LOGO="fedora-logo-icon"
2026-02-19T13:41:37.707 INFO:teuthology.orchestra.run.trial030.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-19T13:41:37.707 INFO:teuthology.orchestra.run.trial030.stdout:HOME_URL="https://rockylinux.org/"
2026-02-19T13:41:37.707 INFO:teuthology.orchestra.run.trial030.stdout:VENDOR_NAME="RESF"
2026-02-19T13:41:37.707 INFO:teuthology.orchestra.run.trial030.stdout:VENDOR_URL="https://resf.org/"
2026-02-19T13:41:37.708 INFO:teuthology.orchestra.run.trial030.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-19T13:41:37.708 INFO:teuthology.orchestra.run.trial030.stdout:SUPPORT_END="2035-05-31"
2026-02-19T13:41:37.708 INFO:teuthology.orchestra.run.trial030.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-19T13:41:37.708 INFO:teuthology.orchestra.run.trial030.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T13:41:37.708 INFO:teuthology.orchestra.run.trial030.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-19T13:41:37.708 INFO:teuthology.orchestra.run.trial030.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T13:41:37.709 INFO:teuthology.lock.ops:Updating trial030.front.sepia.ceph.com on lock server
2026-02-19T13:41:37.814 INFO:teuthology.lock.ops:Updating [trial044.front.sepia.ceph.com]: set os type and version on server
2026-02-19T13:41:37.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial044.front.sepia.ceph.com'
2026-02-19T13:41:37.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:41:37.883 DEBUG:teuthology.orchestra.run.trial044:> true
2026-02-19T13:41:37.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial044.front.sepia.ceph.com'
2026-02-19T13:41:37.961 DEBUG:teuthology.orchestra.run.trial044:> uname -m
2026-02-19T13:41:38.019 INFO:teuthology.orchestra.run.trial044.stdout:x86_64
2026-02-19T13:41:38.019 DEBUG:teuthology.orchestra.run.trial044:> cat /etc/os-release
2026-02-19T13:41:38.077 INFO:teuthology.orchestra.run.trial044.stdout:NAME="Rocky Linux"
2026-02-19T13:41:38.077 INFO:teuthology.orchestra.run.trial044.stdout:VERSION="10.1 (Red Quartz)"
2026-02-19T13:41:38.077 INFO:teuthology.orchestra.run.trial044.stdout:ID="rocky"
2026-02-19T13:41:38.077 INFO:teuthology.orchestra.run.trial044.stdout:ID_LIKE="rhel centos fedora"
2026-02-19T13:41:38.078 INFO:teuthology.orchestra.run.trial044.stdout:VERSION_ID="10.1"
2026-02-19T13:41:38.078 INFO:teuthology.orchestra.run.trial044.stdout:PLATFORM_ID="platform:el10"
2026-02-19T13:41:38.078 INFO:teuthology.orchestra.run.trial044.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-19T13:41:38.078 INFO:teuthology.orchestra.run.trial044.stdout:ANSI_COLOR="0;32"
2026-02-19T13:41:38.078 INFO:teuthology.orchestra.run.trial044.stdout:LOGO="fedora-logo-icon"
2026-02-19T13:41:38.078 INFO:teuthology.orchestra.run.trial044.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-19T13:41:38.078 INFO:teuthology.orchestra.run.trial044.stdout:HOME_URL="https://rockylinux.org/"
2026-02-19T13:41:38.078 INFO:teuthology.orchestra.run.trial044.stdout:VENDOR_NAME="RESF"
2026-02-19T13:41:38.078 INFO:teuthology.orchestra.run.trial044.stdout:VENDOR_URL="https://resf.org/"
2026-02-19T13:41:38.078 INFO:teuthology.orchestra.run.trial044.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-19T13:41:38.078 INFO:teuthology.orchestra.run.trial044.stdout:SUPPORT_END="2035-05-31"
2026-02-19T13:41:38.079 INFO:teuthology.orchestra.run.trial044.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-19T13:41:38.079 INFO:teuthology.orchestra.run.trial044.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T13:41:38.079 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-19T13:41:38.079 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T13:41:38.079 INFO:teuthology.lock.ops:Updating trial044.front.sepia.ceph.com on lock server
2026-02-19T13:41:38.182 INFO:teuthology.lock.ops:Updating [trial121.front.sepia.ceph.com]: set os type and version on server
2026-02-19T13:41:38.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial121.front.sepia.ceph.com'
2026-02-19T13:41:38.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:41:38.251 DEBUG:teuthology.orchestra.run.trial121:> true
2026-02-19T13:41:38.329 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial121.front.sepia.ceph.com'
2026-02-19T13:41:38.329 DEBUG:teuthology.orchestra.run.trial121:> uname -m
2026-02-19T13:41:38.386 INFO:teuthology.orchestra.run.trial121.stdout:x86_64
2026-02-19T13:41:38.386 DEBUG:teuthology.orchestra.run.trial121:> cat /etc/os-release
2026-02-19T13:41:38.445 INFO:teuthology.orchestra.run.trial121.stdout:NAME="Rocky Linux"
2026-02-19T13:41:38.445 INFO:teuthology.orchestra.run.trial121.stdout:VERSION="10.1 (Red Quartz)"
2026-02-19T13:41:38.445 INFO:teuthology.orchestra.run.trial121.stdout:ID="rocky"
2026-02-19T13:41:38.445 INFO:teuthology.orchestra.run.trial121.stdout:ID_LIKE="rhel centos fedora"
2026-02-19T13:41:38.445 INFO:teuthology.orchestra.run.trial121.stdout:VERSION_ID="10.1"
2026-02-19T13:41:38.446 INFO:teuthology.orchestra.run.trial121.stdout:PLATFORM_ID="platform:el10"
2026-02-19T13:41:38.446 INFO:teuthology.orchestra.run.trial121.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-19T13:41:38.446 INFO:teuthology.orchestra.run.trial121.stdout:ANSI_COLOR="0;32"
2026-02-19T13:41:38.446 INFO:teuthology.orchestra.run.trial121.stdout:LOGO="fedora-logo-icon"
2026-02-19T13:41:38.446 INFO:teuthology.orchestra.run.trial121.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-19T13:41:38.446 INFO:teuthology.orchestra.run.trial121.stdout:HOME_URL="https://rockylinux.org/"
2026-02-19T13:41:38.446 INFO:teuthology.orchestra.run.trial121.stdout:VENDOR_NAME="RESF"
2026-02-19T13:41:38.446 INFO:teuthology.orchestra.run.trial121.stdout:VENDOR_URL="https://resf.org/"
2026-02-19T13:41:38.446 INFO:teuthology.orchestra.run.trial121.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-19T13:41:38.446 INFO:teuthology.orchestra.run.trial121.stdout:SUPPORT_END="2035-05-31"
2026-02-19T13:41:38.446 INFO:teuthology.orchestra.run.trial121.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-19T13:41:38.446 INFO:teuthology.orchestra.run.trial121.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T13:41:38.447 INFO:teuthology.orchestra.run.trial121.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-19T13:41:38.447 INFO:teuthology.orchestra.run.trial121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T13:41:38.447 INFO:teuthology.lock.ops:Updating trial121.front.sepia.ceph.com on lock server
2026-02-19T13:41:38.550 INFO:teuthology.lock.ops:Updating [trial150.front.sepia.ceph.com]: set os type and version on server
2026-02-19T13:41:38.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial150.front.sepia.ceph.com'
2026-02-19T13:41:38.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T13:41:38.618 DEBUG:teuthology.orchestra.run.trial150:> true
2026-02-19T13:41:38.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial150.front.sepia.ceph.com'
2026-02-19T13:41:38.802 DEBUG:teuthology.orchestra.run.trial150:> uname -m
2026-02-19T13:41:38.860 INFO:teuthology.orchestra.run.trial150.stdout:x86_64
2026-02-19T13:41:38.861 DEBUG:teuthology.orchestra.run.trial150:> cat /etc/os-release
2026-02-19T13:41:38.920 INFO:teuthology.orchestra.run.trial150.stdout:NAME="Rocky Linux"
2026-02-19T13:41:38.920 INFO:teuthology.orchestra.run.trial150.stdout:VERSION="10.1 (Red Quartz)"
2026-02-19T13:41:38.920 INFO:teuthology.orchestra.run.trial150.stdout:ID="rocky"
2026-02-19T13:41:38.920 INFO:teuthology.orchestra.run.trial150.stdout:ID_LIKE="rhel centos fedora"
2026-02-19T13:41:38.920 INFO:teuthology.orchestra.run.trial150.stdout:VERSION_ID="10.1"
2026-02-19T13:41:38.920 INFO:teuthology.orchestra.run.trial150.stdout:PLATFORM_ID="platform:el10"
2026-02-19T13:41:38.920 INFO:teuthology.orchestra.run.trial150.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-19T13:41:38.920 INFO:teuthology.orchestra.run.trial150.stdout:ANSI_COLOR="0;32"
2026-02-19T13:41:38.920 INFO:teuthology.orchestra.run.trial150.stdout:LOGO="fedora-logo-icon"
2026-02-19T13:41:38.921 INFO:teuthology.orchestra.run.trial150.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-19T13:41:38.921 INFO:teuthology.orchestra.run.trial150.stdout:HOME_URL="https://rockylinux.org/"
2026-02-19T13:41:38.921 INFO:teuthology.orchestra.run.trial150.stdout:VENDOR_NAME="RESF"
2026-02-19T13:41:38.921 INFO:teuthology.orchestra.run.trial150.stdout:VENDOR_URL="https://resf.org/"
2026-02-19T13:41:38.921 INFO:teuthology.orchestra.run.trial150.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-19T13:41:38.921 INFO:teuthology.orchestra.run.trial150.stdout:SUPPORT_END="2035-05-31"
2026-02-19T13:41:38.921 INFO:teuthology.orchestra.run.trial150.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-19T13:41:38.921 INFO:teuthology.orchestra.run.trial150.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T13:41:38.921 INFO:teuthology.orchestra.run.trial150.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-19T13:41:38.921 INFO:teuthology.orchestra.run.trial150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T13:41:38.922 INFO:teuthology.lock.ops:Updating trial150.front.sepia.ceph.com on lock server
2026-02-19T13:41:39.024 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T13:41:39.121 INFO:teuthology.dispatcher.supervisor:Running job 58841
2026-02-19T13:41:39.121 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_nmordech@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/nmordech-2026-02-19_12:10:46-rados-wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle-distro-default-trial/58841 --name nmordech-2026-02-19_12:10:46-rados-wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle-distro-default-trial --description rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-4} ec_optimizations/ec_optimizations_on mon_election/connectivity msgr-failures/osd-delay objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{512K} write$/{v1/{compr$/{no$/{no}} v1}}}} rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rpm_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=6-m=3} -- /home/teuthworker/mnt/teuthology/nmordech-2026-02-19_12:10:46-rados-wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle-distro-default-trial/58841/orig.config.yaml
2026-02-19T13:41:39.122 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/nmordech-2026-02-19_12:10:46-rados-wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle-distro-default-trial/58841
2026-02-19T13:41:39.122 INFO:teuthology.dispatcher.supervisor:Job PID: 2856243
2026-02-19T13:41:39.122 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-19T13:43:39.222 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T13:45:39.425 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T13:47:39.642 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T13:49:39.866 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T13:51:40.061 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T13:53:40.227 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T13:55:40.408 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T13:57:40.581 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T13:59:40.716 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T14:01:40.901 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T14:01:40.986 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-19T14:01:41.215 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-19T14:01:42.197 INFO:teuthology.orchestra.console.trial150:Power off
2026-02-19T14:01:42.197 DEBUG:teuthology.orchestra.console.trial150:pexpect command: ipmitool -H trial150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-19T14:01:42.212 INFO:teuthology.orchestra.console.trial121:Power off
2026-02-19T14:01:42.212 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-19T14:01:42.219 INFO:teuthology.orchestra.console.trial044:Power off
2026-02-19T14:01:42.219 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-19T14:01:42.272 DEBUG:teuthology.orchestra.console.trial044:power off output: Chassis Power Control: Down/Off
2026-02-19T14:01:42.273 DEBUG:teuthology.orchestra.console.trial121:power off output: Chassis Power Control: Down/Off
2026-02-19T14:01:42.273 DEBUG:teuthology.orchestra.console.trial150:power off output: Chassis Power Control: Down/Off
2026-02-19T14:01:42.289 INFO:teuthology.orchestra.console.trial030:Power off
2026-02-19T14:01:42.289 DEBUG:teuthology.orchestra.console.trial030:pexpect command: ipmitool -H trial030.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-19T14:01:42.328 DEBUG:teuthology.orchestra.console.trial030:power off output: Chassis Power Control: Down/Off
2026-02-19T14:01:46.278 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T14:01:46.284 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T14:01:46.291 DEBUG:teuthology.orchestra.console.trial150:pexpect command: ipmitool -H trial150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T14:01:46.329 DEBUG:teuthology.orchestra.console.trial030:pexpect command: ipmitool -H trial030.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T14:01:46.387 DEBUG:teuthology.orchestra.console.trial044:check power output: Chassis Power is on
2026-02-19T14:01:46.393 DEBUG:teuthology.orchestra.console.trial121:check power output: Chassis Power is on
2026-02-19T14:01:46.400 DEBUG:teuthology.orchestra.console.trial150:check power output: Chassis Power is on
2026-02-19T14:01:46.437 DEBUG:teuthology.orchestra.console.trial030:check power output: Chassis Power is on
2026-02-19T14:01:50.392 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T14:01:50.399 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T14:01:50.407 DEBUG:teuthology.orchestra.console.trial150:pexpect command: ipmitool -H trial150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T14:01:50.438 DEBUG:teuthology.orchestra.console.trial030:pexpect command: ipmitool -H trial030.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T14:01:50.500 DEBUG:teuthology.orchestra.console.trial044:check power output: Chassis Power is off
2026-02-19T14:01:50.501 INFO:teuthology.orchestra.console.trial044:Power off completed
2026-02-19T14:01:50.508 DEBUG:teuthology.orchestra.console.trial121:check power output: Chassis Power is off
2026-02-19T14:01:50.508 INFO:teuthology.orchestra.console.trial121:Power off completed
2026-02-19T14:01:50.515 DEBUG:teuthology.orchestra.console.trial150:check power output: Chassis Power is off
2026-02-19T14:01:50.515 INFO:teuthology.orchestra.console.trial150:Power off completed
2026-02-19T14:01:50.546 DEBUG:teuthology.orchestra.console.trial030:check power output: Chassis Power is off
2026-02-19T14:01:50.546 INFO:teuthology.orchestra.console.trial030:Power off completed
2026-02-19T14:01:50.794 INFO:teuthology.lock.ops:unlocked: trial044.front.sepia.ceph.com
2026-02-19T14:01:50.801 INFO:teuthology.lock.ops:unlocked: trial150.front.sepia.ceph.com
2026-02-19T14:01:50.811 INFO:teuthology.lock.ops:unlocked: trial030.front.sepia.ceph.com
2026-02-19T14:01:50.813 INFO:teuthology.lock.ops:unlocked: trial121.front.sepia.ceph.com