2026-02-23T08:13:32.391 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-23T08:13:32.391 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T08:13:32.464 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T08:13:32.870 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7e639d074900>, signals=[15]) 2026-02-23T08:13:32.870 INFO:teuthology.lock.ops:Start node 'trial009.front.sepia.ceph.com' reimaging 2026-02-23T08:13:32.870 INFO:teuthology.lock.ops:Updating [trial009.front.sepia.ceph.com]: reset os type and version on server 2026-02-23T08:13:32.870 INFO:teuthology.lock.ops:Updating trial009.front.sepia.ceph.com on lock server 2026-02-23T08:13:32.928 INFO:teuthology.lock.ops:Start node 'trial028.front.sepia.ceph.com' reimaging 2026-02-23T08:13:32.928 INFO:teuthology.lock.ops:Updating [trial028.front.sepia.ceph.com]: reset os type and version on server 2026-02-23T08:13:32.928 INFO:teuthology.lock.ops:Updating trial028.front.sepia.ceph.com on lock server 2026-02-23T08:13:32.987 INFO:teuthology.lock.ops:Start node 'trial093.front.sepia.ceph.com' reimaging 2026-02-23T08:13:32.987 INFO:teuthology.lock.ops:Updating [trial093.front.sepia.ceph.com]: reset os type and version on server 2026-02-23T08:13:32.987 INFO:teuthology.lock.ops:Updating trial093.front.sepia.ceph.com on lock server 2026-02-23T08:13:33.084 INFO:teuthology.lock.ops:Start node 'trial162.front.sepia.ceph.com' reimaging 2026-02-23T08:13:33.084 INFO:teuthology.lock.ops:Updating [trial162.front.sepia.ceph.com]: reset os type and version on server 2026-02-23T08:13:33.084 INFO:teuthology.lock.ops:Updating trial162.front.sepia.ceph.com on lock server 2026-02-23T08:13:33.268 DEBUG:teuthology.provision.fog.trial009:Requesting image trial_rocky_10.1 (ID 4) 2026-02-23T08:13:33.269 DEBUG:teuthology.provision.fog.trial028:Requesting image trial_rocky_10.1 (ID 4) 2026-02-23T08:13:33.321 INFO:teuthology.provision.fog.trial028:Scheduling deploy of rocky 10.1 2026-02-23T08:13:33.323 INFO:teuthology.provision.fog.trial009:Scheduling deploy of rocky 10.1 2026-02-23T08:13:33.363 DEBUG:teuthology.provision.fog.trial093:Requesting image trial_rocky_10.1 (ID 4) 2026-02-23T08:13:33.375 DEBUG:teuthology.provision.fog.trial162:Requesting image trial_rocky_10.1 (ID 4) 2026-02-23T08:13:33.428 INFO:teuthology.provision.fog.trial162:Scheduling deploy of rocky 10.1 2026-02-23T08:13:33.431 INFO:teuthology.provision.fog.trial093:Scheduling deploy of rocky 10.1 2026-02-23T08:13:35.171 INFO:teuthology.orchestra.console.trial028:Power off 2026-02-23T08:13:35.171 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T08:13:35.184 INFO:teuthology.orchestra.console.trial009:Power off 2026-02-23T08:13:35.184 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T08:13:35.191 INFO:teuthology.orchestra.console.trial093:Power off 2026-02-23T08:13:35.191 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T08:13:35.202 INFO:teuthology.orchestra.console.trial162:Power off 2026-02-23T08:13:35.202 DEBUG:teuthology.orchestra.console.trial162:pexpect command: ipmitool -H trial162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T08:13:35.210 DEBUG:teuthology.orchestra.console.trial028:power off output: Chassis Power Control: Down/Off 2026-02-23T08:13:35.223 DEBUG:teuthology.orchestra.console.trial009:power off output: Chassis Power Control: Down/Off 2026-02-23T08:13:35.228 DEBUG:teuthology.orchestra.console.trial093:power off output: Chassis Power Control: Down/Off 2026-02-23T08:13:35.239 DEBUG:teuthology.orchestra.console.trial162:power off output: Chassis Power Control: Down/Off 2026-02-23T08:13:39.214 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T08:13:39.224 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T08:13:39.230 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T08:13:39.240 DEBUG:teuthology.orchestra.console.trial162:pexpect command: ipmitool -H trial162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T08:13:39.324 DEBUG:teuthology.orchestra.console.trial028:check power output: Chassis Power is off 2026-02-23T08:13:39.324 INFO:teuthology.orchestra.console.trial028:Power off completed 2026-02-23T08:13:39.331 DEBUG:teuthology.orchestra.console.trial009:check power output: Chassis Power is off 2026-02-23T08:13:39.332 INFO:teuthology.orchestra.console.trial009:Power off completed 2026-02-23T08:13:39.337 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is off 2026-02-23T08:13:39.338 INFO:teuthology.orchestra.console.trial093:Power off completed 2026-02-23T08:13:39.348 DEBUG:teuthology.orchestra.console.trial162:check power output: Chassis Power is off 2026-02-23T08:13:39.349 INFO:teuthology.orchestra.console.trial162:Power off completed 2026-02-23T08:13:39.425 INFO:teuthology.orchestra.console.trial028:Power on 2026-02-23T08:13:39.426 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-23T08:13:39.437 INFO:teuthology.orchestra.console.trial009:Power on 2026-02-23T08:13:39.437 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-23T08:13:39.446 INFO:teuthology.orchestra.console.trial093:Power on 2026-02-23T08:13:39.446 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-23T08:13:39.455 INFO:teuthology.orchestra.console.trial162:Power on 2026-02-23T08:13:39.455 DEBUG:teuthology.orchestra.console.trial162:pexpect command: ipmitool -H trial162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-23T08:13:39.466 DEBUG:teuthology.orchestra.console.trial028:power on output: Chassis Power Control: Up/On 2026-02-23T08:13:39.481 DEBUG:teuthology.orchestra.console.trial009:power on output: Chassis Power Control: Up/On 2026-02-23T08:13:39.489 DEBUG:teuthology.orchestra.console.trial093:power on output: Chassis Power Control: Up/On 2026-02-23T08:13:39.492 DEBUG:teuthology.orchestra.console.trial162:power on output: Chassis Power Control: Up/On 2026-02-23T08:13:43.471 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T08:13:43.481 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T08:13:43.490 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T08:13:43.497 DEBUG:teuthology.orchestra.console.trial162:pexpect command: ipmitool -H trial162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T08:13:43.581 DEBUG:teuthology.orchestra.console.trial028:check power output: Chassis Power is on 2026-02-23T08:13:43.581 INFO:teuthology.orchestra.console.trial028:Power on completed 2026-02-23T08:13:43.591 DEBUG:teuthology.orchestra.console.trial009:check power output: Chassis Power is off 2026-02-23T08:13:43.598 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is on 2026-02-23T08:13:43.598 INFO:teuthology.orchestra.console.trial093:Power on completed 2026-02-23T08:13:43.606 DEBUG:teuthology.orchestra.console.trial162:check power output: Chassis Power is on 2026-02-23T08:13:43.606 INFO:teuthology.orchestra.console.trial162:Power on completed 2026-02-23T08:13:43.682 INFO:teuthology.provision.fog.trial028:Waiting for deploy to finish 2026-02-23T08:13:43.699 INFO:teuthology.provision.fog.trial093:Waiting for deploy to finish 2026-02-23T08:13:43.707 INFO:teuthology.provision.fog.trial162:Waiting for deploy to finish 2026-02-23T08:13:47.596 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T08:13:47.704 DEBUG:teuthology.orchestra.console.trial009:check power output: Chassis Power is on 2026-02-23T08:13:47.704 INFO:teuthology.orchestra.console.trial009:Power on completed 2026-02-23T08:13:47.804 INFO:teuthology.provision.fog.trial009:Waiting for deploy to finish 2026-02-23T08:15:31.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:15:31.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:15:32.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:15:34.976 WARNING:teuthology.provision.fog.trial093:[Errno None] Unable to connect to port 22 on 10.20.193.93 2026-02-23T08:15:34.976 WARNING:teuthology.provision.fog.trial028:[Errno None] Unable to connect to port 22 on 10.20.193.28 2026-02-23T08:15:35.233 WARNING:teuthology.provision.fog.trial162:[Errno None] Unable to connect to port 22 on 10.20.193.162 2026-02-23T08:15:35.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:15:38.559 WARNING:teuthology.provision.fog.trial009:[Errno None] Unable to connect to port 22 on 10.20.193.9 2026-02-23T08:15:40.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:15:40.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:15:41.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:15:44.064 WARNING:teuthology.provision.fog.trial028:[Errno None] Unable to connect to port 22 on 10.20.193.28 2026-02-23T08:15:44.064 WARNING:teuthology.provision.fog.trial093:[Errno None] Unable to connect to port 22 on 10.20.193.93 2026-02-23T08:15:44.319 WARNING:teuthology.provision.fog.trial162:[Errno None] Unable to connect to port 22 on 10.20.193.162 2026-02-23T08:15:44.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:15:47.648 WARNING:teuthology.provision.fog.trial009:[Errno None] Unable to connect to port 22 on 10.20.193.9 2026-02-23T08:15:50.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:15:50.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:15:50.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:15:53.152 WARNING:teuthology.provision.fog.trial028:[Errno None] Unable to connect to port 22 on 10.20.193.28 2026-02-23T08:15:53.152 WARNING:teuthology.provision.fog.trial093:[Errno None] Unable to connect to port 22 on 10.20.193.93 2026-02-23T08:15:53.408 WARNING:teuthology.provision.fog.trial162:[Errno None] Unable to connect to port 22 on 10.20.193.162 2026-02-23T08:15:53.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:15:56.736 WARNING:teuthology.provision.fog.trial009:[Errno None] Unable to connect to port 22 on 10.20.193.9 2026-02-23T08:15:59.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:15:59.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:15:59.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:16:02.240 WARNING:teuthology.provision.fog.trial028:[Errno None] Unable to connect to port 22 on 10.20.193.28 2026-02-23T08:16:02.240 WARNING:teuthology.provision.fog.trial093:[Errno None] Unable to connect to port 22 on 10.20.193.93 2026-02-23T08:16:02.496 WARNING:teuthology.provision.fog.trial162:[Errno None] Unable to connect to port 22 on 10.20.193.162 2026-02-23T08:16:02.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:16:05.824 WARNING:teuthology.provision.fog.trial009:[Errno None] Unable to connect to port 22 on 10.20.193.9 2026-02-23T08:16:08.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:16:08.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:16:08.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:16:11.328 WARNING:teuthology.provision.fog.trial028:[Errno None] Unable to connect to port 22 on 10.20.193.28 2026-02-23T08:16:11.328 WARNING:teuthology.provision.fog.trial093:[Errno None] Unable to connect to port 22 on 10.20.193.93 2026-02-23T08:16:11.584 WARNING:teuthology.provision.fog.trial162:[Errno None] Unable to connect to port 22 on 10.20.193.162 2026-02-23T08:16:11.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:16:14.912 WARNING:teuthology.provision.fog.trial009:[Errno None] Unable to connect to port 22 on 10.20.193.9 2026-02-23T08:16:17.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:16:17.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:16:17.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:16:20.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:16:53.285 ERROR:teuthology.orchestra.connection:Error authenticating with trial028.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-23T08:16:53.290 ERROR:teuthology.orchestra.connection:Error authenticating with trial093.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-23T08:16:53.735 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-23T08:16:53.736 DEBUG:teuthology.orchestra.run.trial162:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-23T08:16:56.776 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-23T08:16:56.776 DEBUG:teuthology.orchestra.run.trial009:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-23T08:16:57.431 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-23T08:16:57.431 DEBUG:teuthology.orchestra.run.trial028:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-23T08:16:57.444 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-23T08:16:57.444 DEBUG:teuthology.orchestra.run.trial093:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-23T08:16:57.594 INFO:teuthology.provision.fog.trial028:Node is ready 2026-02-23T08:16:57.595 DEBUG:teuthology.orchestra.run.trial028:> hostname 2026-02-23T08:16:57.639 INFO:teuthology.provision.fog.trial093:Node is ready 2026-02-23T08:16:57.640 DEBUG:teuthology.orchestra.run.trial093:> hostname 2026-02-23T08:16:57.653 INFO:teuthology.orchestra.run.trial028.stdout:trial028.front.sepia.ceph.com 2026-02-23T08:16:57.654 DEBUG:teuthology.orchestra.run.trial028:> grep trial028.front.sepia.ceph.com /etc/hosts 2026-02-23T08:16:57.711 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28 trial028.front.sepia.ceph.com trial028 2026-02-23T08:16:57.711 DEBUG:teuthology.orchestra.run.trial028:> sudo hostname trial028 2026-02-23T08:16:57.713 INFO:teuthology.orchestra.run.trial093.stdout:trial093.front.sepia.ceph.com 2026-02-23T08:16:57.713 DEBUG:teuthology.orchestra.run.trial093:> grep trial093.front.sepia.ceph.com /etc/hosts 2026-02-23T08:16:57.771 INFO:teuthology.orchestra.run.trial093.stdout:10.20.193.93 trial093.front.sepia.ceph.com trial093 2026-02-23T08:16:57.772 DEBUG:teuthology.orchestra.run.trial093:> sudo hostname trial093 2026-02-23T08:16:57.784 DEBUG:teuthology.orchestra.run.trial028:> sudo sed -i -e 's/trial028.front.sepia.ceph.com/trial028/g' /etc/hosts 2026-02-23T08:16:57.845 DEBUG:teuthology.orchestra.run.trial093:> sudo sed -i -e 's/trial093.front.sepia.ceph.com/trial093/g' /etc/hosts 2026-02-23T08:16:57.853 DEBUG:teuthology.orchestra.run.trial028:> sudo sed -i -e 's/10.20.193.28/10.20.193.28/g' /etc/hosts 2026-02-23T08:16:57.912 DEBUG:teuthology.orchestra.run.trial093:> sudo sed -i -e 's/10.20.193.93/10.20.193.93/g' /etc/hosts 2026-02-23T08:16:57.919 DEBUG:teuthology.orchestra.run.trial028:> sudo sed -i -e 's/trial028.front.sepia.ceph.com/trial028/g' /etc/hostname 2026-02-23T08:16:57.979 DEBUG:teuthology.orchestra.run.trial093:> sudo sed -i -e 's/trial093.front.sepia.ceph.com/trial093/g' /etc/hostname 2026-02-23T08:16:57.987 DEBUG:teuthology.orchestra.run.trial028:> sudo hostname trial028 2026-02-23T08:16:58.046 DEBUG:teuthology.orchestra.run.trial093:> sudo hostname trial093 2026-02-23T08:16:58.055 DEBUG:teuthology.orchestra.run.trial028:> cat /etc/os-release 2026-02-23T08:16:58.111 INFO:teuthology.orchestra.run.trial028.stdout:NAME="Rocky Linux" 2026-02-23T08:16:58.112 INFO:teuthology.orchestra.run.trial028.stdout:VERSION="10.1 (Red Quartz)" 2026-02-23T08:16:58.112 INFO:teuthology.orchestra.run.trial028.stdout:ID="rocky" 2026-02-23T08:16:58.112 INFO:teuthology.orchestra.run.trial028.stdout:ID_LIKE="rhel centos fedora" 2026-02-23T08:16:58.112 INFO:teuthology.orchestra.run.trial028.stdout:VERSION_ID="10.1" 2026-02-23T08:16:58.112 INFO:teuthology.orchestra.run.trial028.stdout:PLATFORM_ID="platform:el10" 2026-02-23T08:16:58.112 INFO:teuthology.orchestra.run.trial028.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-23T08:16:58.112 INFO:teuthology.orchestra.run.trial028.stdout:ANSI_COLOR="0;32" 2026-02-23T08:16:58.112 INFO:teuthology.orchestra.run.trial028.stdout:LOGO="fedora-logo-icon" 2026-02-23T08:16:58.112 INFO:teuthology.orchestra.run.trial028.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-23T08:16:58.113 INFO:teuthology.orchestra.run.trial028.stdout:HOME_URL="https://rockylinux.org/" 2026-02-23T08:16:58.113 INFO:teuthology.orchestra.run.trial028.stdout:VENDOR_NAME="RESF" 2026-02-23T08:16:58.113 INFO:teuthology.orchestra.run.trial028.stdout:VENDOR_URL="https://resf.org/" 2026-02-23T08:16:58.113 INFO:teuthology.orchestra.run.trial028.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-23T08:16:58.113 INFO:teuthology.orchestra.run.trial028.stdout:SUPPORT_END="2035-05-31" 2026-02-23T08:16:58.113 INFO:teuthology.orchestra.run.trial028.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-23T08:16:58.113 INFO:teuthology.orchestra.run.trial028.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T08:16:58.113 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-23T08:16:58.113 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T08:16:58.114 INFO:teuthology.provision.fog.trial028:Deploy complete! 2026-02-23T08:16:58.115 DEBUG:teuthology.parallel:result is None 2026-02-23T08:16:58.116 DEBUG:teuthology.orchestra.run.trial093:> cat /etc/os-release 2026-02-23T08:16:58.174 INFO:teuthology.orchestra.run.trial093.stdout:NAME="Rocky Linux" 2026-02-23T08:16:58.174 INFO:teuthology.orchestra.run.trial093.stdout:VERSION="10.1 (Red Quartz)" 2026-02-23T08:16:58.174 INFO:teuthology.orchestra.run.trial093.stdout:ID="rocky" 2026-02-23T08:16:58.174 INFO:teuthology.orchestra.run.trial093.stdout:ID_LIKE="rhel centos fedora" 2026-02-23T08:16:58.174 INFO:teuthology.orchestra.run.trial093.stdout:VERSION_ID="10.1" 2026-02-23T08:16:58.175 INFO:teuthology.orchestra.run.trial093.stdout:PLATFORM_ID="platform:el10" 2026-02-23T08:16:58.175 INFO:teuthology.orchestra.run.trial093.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-23T08:16:58.175 INFO:teuthology.orchestra.run.trial093.stdout:ANSI_COLOR="0;32" 2026-02-23T08:16:58.175 INFO:teuthology.orchestra.run.trial093.stdout:LOGO="fedora-logo-icon" 2026-02-23T08:16:58.175 INFO:teuthology.orchestra.run.trial093.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-23T08:16:58.175 INFO:teuthology.orchestra.run.trial093.stdout:HOME_URL="https://rockylinux.org/" 2026-02-23T08:16:58.175 INFO:teuthology.orchestra.run.trial093.stdout:VENDOR_NAME="RESF" 2026-02-23T08:16:58.175 INFO:teuthology.orchestra.run.trial093.stdout:VENDOR_URL="https://resf.org/" 2026-02-23T08:16:58.175 INFO:teuthology.orchestra.run.trial093.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-23T08:16:58.175 INFO:teuthology.orchestra.run.trial093.stdout:SUPPORT_END="2035-05-31" 2026-02-23T08:16:58.175 INFO:teuthology.orchestra.run.trial093.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-23T08:16:58.176 INFO:teuthology.orchestra.run.trial093.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T08:16:58.176 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-23T08:16:58.176 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T08:16:58.176 INFO:teuthology.provision.fog.trial093:Deploy complete! 2026-02-23T08:16:58.177 DEBUG:teuthology.parallel:result is None 2026-02-23T08:16:58.677 INFO:teuthology.provision.fog.trial162:Node is ready 2026-02-23T08:16:58.677 DEBUG:teuthology.orchestra.run.trial162:> hostname 2026-02-23T08:16:58.694 INFO:teuthology.orchestra.run.trial162.stdout:trial162.front.sepia.ceph.com 2026-02-23T08:16:58.694 DEBUG:teuthology.orchestra.run.trial162:> grep trial162.front.sepia.ceph.com /etc/hosts 2026-02-23T08:16:58.750 INFO:teuthology.orchestra.run.trial162.stdout:10.20.193.162 trial162.front.sepia.ceph.com trial162 2026-02-23T08:16:58.751 DEBUG:teuthology.orchestra.run.trial162:> sudo hostname trial162 2026-02-23T08:16:58.823 DEBUG:teuthology.orchestra.run.trial162:> sudo sed -i -e 's/trial162.front.sepia.ceph.com/trial162/g' /etc/hosts 2026-02-23T08:16:58.892 DEBUG:teuthology.orchestra.run.trial162:> sudo sed -i -e 's/10.20.193.162/10.20.193.162/g' /etc/hosts 2026-02-23T08:16:58.961 DEBUG:teuthology.orchestra.run.trial162:> sudo sed -i -e 's/trial162.front.sepia.ceph.com/trial162/g' /etc/hostname 2026-02-23T08:16:59.026 DEBUG:teuthology.orchestra.run.trial162:> sudo hostname trial162 2026-02-23T08:16:59.094 DEBUG:teuthology.orchestra.run.trial162:> cat /etc/os-release 2026-02-23T08:16:59.151 INFO:teuthology.orchestra.run.trial162.stdout:NAME="Rocky Linux" 2026-02-23T08:16:59.151 INFO:teuthology.orchestra.run.trial162.stdout:VERSION="10.1 (Red Quartz)" 2026-02-23T08:16:59.151 INFO:teuthology.orchestra.run.trial162.stdout:ID="rocky" 2026-02-23T08:16:59.151 INFO:teuthology.orchestra.run.trial162.stdout:ID_LIKE="rhel centos fedora" 2026-02-23T08:16:59.151 INFO:teuthology.orchestra.run.trial162.stdout:VERSION_ID="10.1" 2026-02-23T08:16:59.151 INFO:teuthology.orchestra.run.trial162.stdout:PLATFORM_ID="platform:el10" 2026-02-23T08:16:59.151 INFO:teuthology.orchestra.run.trial162.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-23T08:16:59.152 INFO:teuthology.orchestra.run.trial162.stdout:ANSI_COLOR="0;32" 2026-02-23T08:16:59.152 INFO:teuthology.orchestra.run.trial162.stdout:LOGO="fedora-logo-icon" 2026-02-23T08:16:59.152 INFO:teuthology.orchestra.run.trial162.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-23T08:16:59.152 INFO:teuthology.orchestra.run.trial162.stdout:HOME_URL="https://rockylinux.org/" 2026-02-23T08:16:59.152 INFO:teuthology.orchestra.run.trial162.stdout:VENDOR_NAME="RESF" 2026-02-23T08:16:59.152 INFO:teuthology.orchestra.run.trial162.stdout:VENDOR_URL="https://resf.org/" 2026-02-23T08:16:59.152 INFO:teuthology.orchestra.run.trial162.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-23T08:16:59.152 INFO:teuthology.orchestra.run.trial162.stdout:SUPPORT_END="2035-05-31" 2026-02-23T08:16:59.152 INFO:teuthology.orchestra.run.trial162.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-23T08:16:59.152 INFO:teuthology.orchestra.run.trial162.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T08:16:59.152 INFO:teuthology.orchestra.run.trial162.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-23T08:16:59.153 INFO:teuthology.orchestra.run.trial162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T08:16:59.153 INFO:teuthology.provision.fog.trial162:Deploy complete! 2026-02-23T08:16:59.154 DEBUG:teuthology.parallel:result is None 2026-02-23T08:17:01.980 INFO:teuthology.provision.fog.trial009:Node is ready 2026-02-23T08:17:01.981 DEBUG:teuthology.orchestra.run.trial009:> hostname 2026-02-23T08:17:01.998 INFO:teuthology.orchestra.run.trial009.stdout:trial009.front.sepia.ceph.com 2026-02-23T08:17:01.999 DEBUG:teuthology.orchestra.run.trial009:> grep trial009.front.sepia.ceph.com /etc/hosts 2026-02-23T08:17:02.057 INFO:teuthology.orchestra.run.trial009.stdout:10.20.193.9 trial009.front.sepia.ceph.com trial009 2026-02-23T08:17:02.057 DEBUG:teuthology.orchestra.run.trial009:> sudo hostname trial009 2026-02-23T08:17:02.130 DEBUG:teuthology.orchestra.run.trial009:> sudo sed -i -e 's/trial009.front.sepia.ceph.com/trial009/g' /etc/hosts 2026-02-23T08:17:02.198 DEBUG:teuthology.orchestra.run.trial009:> sudo sed -i -e 's/10.20.193.9/10.20.193.9/g' /etc/hosts 2026-02-23T08:17:02.265 DEBUG:teuthology.orchestra.run.trial009:> sudo sed -i -e 's/trial009.front.sepia.ceph.com/trial009/g' /etc/hostname 2026-02-23T08:17:02.331 DEBUG:teuthology.orchestra.run.trial009:> sudo hostname trial009 2026-02-23T08:17:02.398 DEBUG:teuthology.orchestra.run.trial009:> cat /etc/os-release 2026-02-23T08:17:02.455 INFO:teuthology.orchestra.run.trial009.stdout:NAME="Rocky Linux" 2026-02-23T08:17:02.456 INFO:teuthology.orchestra.run.trial009.stdout:VERSION="10.1 (Red Quartz)" 2026-02-23T08:17:02.456 INFO:teuthology.orchestra.run.trial009.stdout:ID="rocky" 2026-02-23T08:17:02.456 INFO:teuthology.orchestra.run.trial009.stdout:ID_LIKE="rhel centos fedora" 2026-02-23T08:17:02.456 INFO:teuthology.orchestra.run.trial009.stdout:VERSION_ID="10.1" 2026-02-23T08:17:02.456 INFO:teuthology.orchestra.run.trial009.stdout:PLATFORM_ID="platform:el10" 2026-02-23T08:17:02.456 INFO:teuthology.orchestra.run.trial009.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-23T08:17:02.456 INFO:teuthology.orchestra.run.trial009.stdout:ANSI_COLOR="0;32" 2026-02-23T08:17:02.456 INFO:teuthology.orchestra.run.trial009.stdout:LOGO="fedora-logo-icon" 2026-02-23T08:17:02.456 INFO:teuthology.orchestra.run.trial009.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-23T08:17:02.456 INFO:teuthology.orchestra.run.trial009.stdout:HOME_URL="https://rockylinux.org/" 2026-02-23T08:17:02.457 INFO:teuthology.orchestra.run.trial009.stdout:VENDOR_NAME="RESF" 2026-02-23T08:17:02.457 INFO:teuthology.orchestra.run.trial009.stdout:VENDOR_URL="https://resf.org/" 2026-02-23T08:17:02.457 INFO:teuthology.orchestra.run.trial009.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-23T08:17:02.457 INFO:teuthology.orchestra.run.trial009.stdout:SUPPORT_END="2035-05-31" 2026-02-23T08:17:02.457 INFO:teuthology.orchestra.run.trial009.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-23T08:17:02.457 INFO:teuthology.orchestra.run.trial009.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T08:17:02.457 INFO:teuthology.orchestra.run.trial009.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-23T08:17:02.457 INFO:teuthology.orchestra.run.trial009.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T08:17:02.457 INFO:teuthology.provision.fog.trial009:Deploy complete! 2026-02-23T08:17:02.458 DEBUG:teuthology.parallel:result is None 2026-02-23T08:17:03.119 INFO:teuthology.lock.ops:Checking trial009.front.sepia.ceph.com 2026-02-23T08:17:03.119 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-23T08:17:03.178 INFO:teuthology.lock.ops:Checking trial028.front.sepia.ceph.com 2026-02-23T08:17:03.178 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-23T08:17:03.236 INFO:teuthology.lock.ops:Checking trial093.front.sepia.ceph.com 2026-02-23T08:17:03.236 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-23T08:17:03.293 INFO:teuthology.lock.ops:Checking trial162.front.sepia.ceph.com 2026-02-23T08:17:03.293 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-23T08:17:03.349 INFO:teuthology.lock.ops:Updating [trial009.front.sepia.ceph.com]: set os type and version on server 2026-02-23T08:17:03.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial009.front.sepia.ceph.com' 2026-02-23T08:17:03.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:17:03.411 DEBUG:teuthology.orchestra.run.trial009:> true 2026-02-23T08:17:03.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial009.front.sepia.ceph.com' 2026-02-23T08:17:03.495 DEBUG:teuthology.orchestra.run.trial009:> uname -m 2026-02-23T08:17:03.552 INFO:teuthology.orchestra.run.trial009.stdout:x86_64 2026-02-23T08:17:03.552 DEBUG:teuthology.orchestra.run.trial009:> cat /etc/os-release 2026-02-23T08:17:03.609 INFO:teuthology.orchestra.run.trial009.stdout:NAME="Rocky Linux" 2026-02-23T08:17:03.609 INFO:teuthology.orchestra.run.trial009.stdout:VERSION="10.1 (Red Quartz)" 2026-02-23T08:17:03.610 INFO:teuthology.orchestra.run.trial009.stdout:ID="rocky" 2026-02-23T08:17:03.610 INFO:teuthology.orchestra.run.trial009.stdout:ID_LIKE="rhel centos fedora" 2026-02-23T08:17:03.610 INFO:teuthology.orchestra.run.trial009.stdout:VERSION_ID="10.1" 2026-02-23T08:17:03.610 INFO:teuthology.orchestra.run.trial009.stdout:PLATFORM_ID="platform:el10" 2026-02-23T08:17:03.610 INFO:teuthology.orchestra.run.trial009.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-23T08:17:03.610 INFO:teuthology.orchestra.run.trial009.stdout:ANSI_COLOR="0;32" 2026-02-23T08:17:03.610 INFO:teuthology.orchestra.run.trial009.stdout:LOGO="fedora-logo-icon" 2026-02-23T08:17:03.610 INFO:teuthology.orchestra.run.trial009.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-23T08:17:03.610 INFO:teuthology.orchestra.run.trial009.stdout:HOME_URL="https://rockylinux.org/" 2026-02-23T08:17:03.610 INFO:teuthology.orchestra.run.trial009.stdout:VENDOR_NAME="RESF" 2026-02-23T08:17:03.610 INFO:teuthology.orchestra.run.trial009.stdout:VENDOR_URL="https://resf.org/" 2026-02-23T08:17:03.611 INFO:teuthology.orchestra.run.trial009.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-23T08:17:03.611 INFO:teuthology.orchestra.run.trial009.stdout:SUPPORT_END="2035-05-31" 2026-02-23T08:17:03.611 INFO:teuthology.orchestra.run.trial009.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-23T08:17:03.611 INFO:teuthology.orchestra.run.trial009.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T08:17:03.611 INFO:teuthology.orchestra.run.trial009.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-23T08:17:03.611 INFO:teuthology.orchestra.run.trial009.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T08:17:03.612 INFO:teuthology.lock.ops:Updating trial009.front.sepia.ceph.com on lock server 2026-02-23T08:17:03.714 INFO:teuthology.lock.ops:Updating [trial028.front.sepia.ceph.com]: set os type and version on server 2026-02-23T08:17:03.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-23T08:17:03.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:17:03.784 DEBUG:teuthology.orchestra.run.trial028:> true 2026-02-23T08:17:03.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-23T08:17:03.873 DEBUG:teuthology.orchestra.run.trial028:> uname -m 2026-02-23T08:17:03.930 INFO:teuthology.orchestra.run.trial028.stdout:x86_64 2026-02-23T08:17:03.930 DEBUG:teuthology.orchestra.run.trial028:> cat /etc/os-release 2026-02-23T08:17:03.989 INFO:teuthology.orchestra.run.trial028.stdout:NAME="Rocky Linux" 2026-02-23T08:17:03.989 INFO:teuthology.orchestra.run.trial028.stdout:VERSION="10.1 (Red Quartz)" 2026-02-23T08:17:03.989 INFO:teuthology.orchestra.run.trial028.stdout:ID="rocky" 2026-02-23T08:17:03.989 INFO:teuthology.orchestra.run.trial028.stdout:ID_LIKE="rhel centos fedora" 2026-02-23T08:17:03.989 INFO:teuthology.orchestra.run.trial028.stdout:VERSION_ID="10.1" 2026-02-23T08:17:03.989 INFO:teuthology.orchestra.run.trial028.stdout:PLATFORM_ID="platform:el10" 2026-02-23T08:17:03.989 INFO:teuthology.orchestra.run.trial028.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-23T08:17:03.989 INFO:teuthology.orchestra.run.trial028.stdout:ANSI_COLOR="0;32" 2026-02-23T08:17:03.990 INFO:teuthology.orchestra.run.trial028.stdout:LOGO="fedora-logo-icon" 2026-02-23T08:17:03.990 INFO:teuthology.orchestra.run.trial028.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-23T08:17:03.990 INFO:teuthology.orchestra.run.trial028.stdout:HOME_URL="https://rockylinux.org/" 2026-02-23T08:17:03.990 INFO:teuthology.orchestra.run.trial028.stdout:VENDOR_NAME="RESF" 2026-02-23T08:17:03.990 INFO:teuthology.orchestra.run.trial028.stdout:VENDOR_URL="https://resf.org/" 2026-02-23T08:17:03.990 INFO:teuthology.orchestra.run.trial028.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-23T08:17:03.990 INFO:teuthology.orchestra.run.trial028.stdout:SUPPORT_END="2035-05-31" 2026-02-23T08:17:03.990 INFO:teuthology.orchestra.run.trial028.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-23T08:17:03.990 INFO:teuthology.orchestra.run.trial028.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T08:17:03.990 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-23T08:17:03.990 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T08:17:03.991 INFO:teuthology.lock.ops:Updating trial028.front.sepia.ceph.com on lock server 2026-02-23T08:17:04.096 INFO:teuthology.lock.ops:Updating [trial093.front.sepia.ceph.com]: set os type and version on server 2026-02-23T08:17:04.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial093.front.sepia.ceph.com' 2026-02-23T08:17:04.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:17:04.168 DEBUG:teuthology.orchestra.run.trial093:> true 2026-02-23T08:17:04.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial093.front.sepia.ceph.com' 2026-02-23T08:17:04.243 DEBUG:teuthology.orchestra.run.trial093:> uname -m 2026-02-23T08:17:04.300 INFO:teuthology.orchestra.run.trial093.stdout:x86_64 2026-02-23T08:17:04.300 DEBUG:teuthology.orchestra.run.trial093:> cat /etc/os-release 2026-02-23T08:17:04.356 INFO:teuthology.orchestra.run.trial093.stdout:NAME="Rocky Linux" 2026-02-23T08:17:04.356 INFO:teuthology.orchestra.run.trial093.stdout:VERSION="10.1 (Red Quartz)" 2026-02-23T08:17:04.356 INFO:teuthology.orchestra.run.trial093.stdout:ID="rocky" 2026-02-23T08:17:04.356 INFO:teuthology.orchestra.run.trial093.stdout:ID_LIKE="rhel centos fedora" 2026-02-23T08:17:04.356 INFO:teuthology.orchestra.run.trial093.stdout:VERSION_ID="10.1" 2026-02-23T08:17:04.357 INFO:teuthology.orchestra.run.trial093.stdout:PLATFORM_ID="platform:el10" 2026-02-23T08:17:04.357 INFO:teuthology.orchestra.run.trial093.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-23T08:17:04.357 INFO:teuthology.orchestra.run.trial093.stdout:ANSI_COLOR="0;32" 2026-02-23T08:17:04.357 INFO:teuthology.orchestra.run.trial093.stdout:LOGO="fedora-logo-icon" 2026-02-23T08:17:04.357 INFO:teuthology.orchestra.run.trial093.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-23T08:17:04.357 INFO:teuthology.orchestra.run.trial093.stdout:HOME_URL="https://rockylinux.org/" 2026-02-23T08:17:04.357 INFO:teuthology.orchestra.run.trial093.stdout:VENDOR_NAME="RESF" 2026-02-23T08:17:04.357 INFO:teuthology.orchestra.run.trial093.stdout:VENDOR_URL="https://resf.org/" 2026-02-23T08:17:04.357 INFO:teuthology.orchestra.run.trial093.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-23T08:17:04.357 INFO:teuthology.orchestra.run.trial093.stdout:SUPPORT_END="2035-05-31" 2026-02-23T08:17:04.357 INFO:teuthology.orchestra.run.trial093.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-23T08:17:04.357 INFO:teuthology.orchestra.run.trial093.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T08:17:04.357 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-23T08:17:04.357 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T08:17:04.357 INFO:teuthology.lock.ops:Updating trial093.front.sepia.ceph.com on lock server 2026-02-23T08:17:04.421 INFO:teuthology.lock.ops:Updating [trial162.front.sepia.ceph.com]: set os type and version on server 2026-02-23T08:17:04.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial162.front.sepia.ceph.com' 2026-02-23T08:17:04.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T08:17:04.482 DEBUG:teuthology.orchestra.run.trial162:> true 2026-02-23T08:17:04.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial162.front.sepia.ceph.com' 2026-02-23T08:17:04.567 DEBUG:teuthology.orchestra.run.trial162:> uname -m 2026-02-23T08:17:04.624 INFO:teuthology.orchestra.run.trial162.stdout:x86_64 2026-02-23T08:17:04.624 DEBUG:teuthology.orchestra.run.trial162:> cat /etc/os-release 2026-02-23T08:17:04.681 INFO:teuthology.orchestra.run.trial162.stdout:NAME="Rocky Linux" 2026-02-23T08:17:04.681 INFO:teuthology.orchestra.run.trial162.stdout:VERSION="10.1 (Red Quartz)" 2026-02-23T08:17:04.681 INFO:teuthology.orchestra.run.trial162.stdout:ID="rocky" 2026-02-23T08:17:04.682 INFO:teuthology.orchestra.run.trial162.stdout:ID_LIKE="rhel centos fedora" 2026-02-23T08:17:04.682 INFO:teuthology.orchestra.run.trial162.stdout:VERSION_ID="10.1" 2026-02-23T08:17:04.682 INFO:teuthology.orchestra.run.trial162.stdout:PLATFORM_ID="platform:el10" 2026-02-23T08:17:04.682 INFO:teuthology.orchestra.run.trial162.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-23T08:17:04.682 INFO:teuthology.orchestra.run.trial162.stdout:ANSI_COLOR="0;32" 2026-02-23T08:17:04.682 INFO:teuthology.orchestra.run.trial162.stdout:LOGO="fedora-logo-icon" 2026-02-23T08:17:04.682 INFO:teuthology.orchestra.run.trial162.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-23T08:17:04.682 INFO:teuthology.orchestra.run.trial162.stdout:HOME_URL="https://rockylinux.org/" 2026-02-23T08:17:04.682 INFO:teuthology.orchestra.run.trial162.stdout:VENDOR_NAME="RESF" 2026-02-23T08:17:04.682 INFO:teuthology.orchestra.run.trial162.stdout:VENDOR_URL="https://resf.org/" 2026-02-23T08:17:04.682 INFO:teuthology.orchestra.run.trial162.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-23T08:17:04.682 INFO:teuthology.orchestra.run.trial162.stdout:SUPPORT_END="2035-05-31" 2026-02-23T08:17:04.682 INFO:teuthology.orchestra.run.trial162.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-23T08:17:04.683 INFO:teuthology.orchestra.run.trial162.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T08:17:04.683 INFO:teuthology.orchestra.run.trial162.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-23T08:17:04.683 INFO:teuthology.orchestra.run.trial162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T08:17:04.683 INFO:teuthology.lock.ops:Updating trial162.front.sepia.ceph.com on lock server 2026-02-23T08:17:04.784 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T08:17:04.883 INFO:teuthology.dispatcher.supervisor:Running job 65649 2026-02-23T08:17:04.883 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_skanta@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/skanta-2026-02-23_07:12:59-rados-wip-bharath8-testing-2026-02-22-0716-distro-default-trial/65649 --name skanta-2026-02-23_07:12:59-rados-wip-bharath8-testing-2026-02-22-0716-distro-default-trial --description rados/thrash-erasure-code-crush-4-nodes/{arch/x86_64 ceph clusters/{fixed-4} ec_optimizations/ec_optimizations_on mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/{bluestore/{alloc$/{stupid} base mem$/{normal-1} onode-segment$/{512K} write$/{random/{compr$/{no$/{no}} random}}}} rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rpm_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=2-crush} -- /home/teuthworker/mnt/teuthology/skanta-2026-02-23_07:12:59-rados-wip-bharath8-testing-2026-02-22-0716-distro-default-trial/65649/orig.config.yaml 2026-02-23T08:17:04.884 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/skanta-2026-02-23_07:12:59-rados-wip-bharath8-testing-2026-02-22-0716-distro-default-trial/65649 2026-02-23T08:17:04.884 INFO:teuthology.dispatcher.supervisor:Job PID: 3236597 2026-02-23T08:17:04.884 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-23T08:19:04.984 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T08:21:05.165 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T08:23:05.387 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T08:25:05.557 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T08:27:05.690 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T08:29:05.892 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T08:31:10.675 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T08:33:10.766 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T08:35:10.993 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T08:35:11.079 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2026-02-23T08:35:11.309 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-23T08:35:12.260 INFO:teuthology.orchestra.console.trial009:Power off 2026-02-23T08:35:12.260 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T08:35:12.268 INFO:teuthology.orchestra.console.trial028:Power off 2026-02-23T08:35:12.268 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T08:35:12.276 INFO:teuthology.orchestra.console.trial093:Power off 2026-02-23T08:35:12.277 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T08:35:12.297 INFO:teuthology.orchestra.console.trial162:Power off 2026-02-23T08:35:12.297 DEBUG:teuthology.orchestra.console.trial162:pexpect command: ipmitool -H trial162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T08:35:12.303 DEBUG:teuthology.orchestra.console.trial009:power off output: Chassis Power Control: Down/Off 2026-02-23T08:35:12.309 DEBUG:teuthology.orchestra.console.trial028:power off output: Chassis Power Control: Down/Off 2026-02-23T08:35:12.314 DEBUG:teuthology.orchestra.console.trial093:power off output: Chassis Power Control: Down/Off 2026-02-23T08:35:12.336 DEBUG:teuthology.orchestra.console.trial162:power off output: Chassis Power Control: Down/Off 2026-02-23T08:35:16.308 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T08:35:16.315 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T08:35:16.322 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T08:35:16.337 DEBUG:teuthology.orchestra.console.trial162:pexpect command: ipmitool -H trial162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T08:35:16.417 DEBUG:teuthology.orchestra.console.trial009:check power output: Chassis Power is on 2026-02-23T08:35:16.423 DEBUG:teuthology.orchestra.console.trial028:check power output: Chassis Power is on 2026-02-23T08:35:16.428 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is on 2026-02-23T08:35:16.443 DEBUG:teuthology.orchestra.console.trial162:check power output: Chassis Power is on 2026-02-23T08:35:20.421 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T08:35:20.431 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T08:35:20.440 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T08:35:20.447 DEBUG:teuthology.orchestra.console.trial162:pexpect command: ipmitool -H trial162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T08:35:20.533 DEBUG:teuthology.orchestra.console.trial009:check power output: Chassis Power is off 2026-02-23T08:35:20.533 INFO:teuthology.orchestra.console.trial009:Power off completed 2026-02-23T08:35:20.542 DEBUG:teuthology.orchestra.console.trial028:check power output: Chassis Power is off 2026-02-23T08:35:20.542 INFO:teuthology.orchestra.console.trial028:Power off completed 2026-02-23T08:35:20.549 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is off 2026-02-23T08:35:20.549 INFO:teuthology.orchestra.console.trial093:Power off completed 2026-02-23T08:35:20.556 DEBUG:teuthology.orchestra.console.trial162:check power output: Chassis Power is off 2026-02-23T08:35:20.556 INFO:teuthology.orchestra.console.trial162:Power off completed 2026-02-23T08:35:20.880 INFO:teuthology.lock.ops:unlocked: trial009.front.sepia.ceph.com 2026-02-23T08:35:20.888 INFO:teuthology.lock.ops:unlocked: trial093.front.sepia.ceph.com 2026-02-23T08:35:20.892 INFO:teuthology.lock.ops:unlocked: trial028.front.sepia.ceph.com 2026-02-23T08:35:20.896 INFO:teuthology.lock.ops:unlocked: trial162.front.sepia.ceph.com