2026-02-24T13:41:58.379 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-24T13:41:58.379 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T13:41:58.489 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T13:41:58.814 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7893a33b31a0>, signals=[15]) 2026-02-24T13:41:58.814 INFO:teuthology.lock.ops:Start node 'trial006.front.sepia.ceph.com' reimaging 2026-02-24T13:41:58.814 INFO:teuthology.lock.ops:Updating [trial006.front.sepia.ceph.com]: reset os type and version on server 2026-02-24T13:41:58.814 INFO:teuthology.lock.ops:Updating trial006.front.sepia.ceph.com on lock server 2026-02-24T13:41:58.872 INFO:teuthology.lock.ops:Start node 'trial112.front.sepia.ceph.com' reimaging 2026-02-24T13:41:58.872 INFO:teuthology.lock.ops:Updating [trial112.front.sepia.ceph.com]: reset os type and version on server 2026-02-24T13:41:58.872 INFO:teuthology.lock.ops:Updating trial112.front.sepia.ceph.com on lock server 2026-02-24T13:41:58.931 INFO:teuthology.lock.ops:Start node 'trial116.front.sepia.ceph.com' reimaging 2026-02-24T13:41:58.931 INFO:teuthology.lock.ops:Updating [trial116.front.sepia.ceph.com]: reset os type and version on server 2026-02-24T13:41:58.931 INFO:teuthology.lock.ops:Updating trial116.front.sepia.ceph.com on lock server 2026-02-24T13:41:59.027 INFO:teuthology.lock.ops:Start node 'trial178.front.sepia.ceph.com' reimaging 2026-02-24T13:41:59.027 INFO:teuthology.lock.ops:Updating [trial178.front.sepia.ceph.com]: reset os type and version on server 2026-02-24T13:41:59.027 INFO:teuthology.lock.ops:Updating trial178.front.sepia.ceph.com on lock server 2026-02-24T13:41:59.213 DEBUG:teuthology.provision.fog.trial112:Requesting image trial_centos_9.stream (ID 3) 2026-02-24T13:41:59.213 DEBUG:teuthology.provision.fog.trial006:Requesting image trial_centos_9.stream (ID 3) 2026-02-24T13:41:59.308 INFO:teuthology.provision.fog.trial006:Scheduling deploy of centos 9.stream 2026-02-24T13:41:59.310 INFO:teuthology.provision.fog.trial112:Scheduling deploy of centos 9.stream 2026-02-24T13:41:59.320 DEBUG:teuthology.provision.fog.trial178:Requesting image trial_centos_9.stream (ID 3) 2026-02-24T13:41:59.321 DEBUG:teuthology.provision.fog.trial116:Requesting image trial_centos_9.stream (ID 3) 2026-02-24T13:41:59.370 INFO:teuthology.provision.fog.trial116:Scheduling deploy of centos 9.stream 2026-02-24T13:41:59.372 INFO:teuthology.provision.fog.trial178:Scheduling deploy of centos 9.stream 2026-02-24T13:42:01.079 INFO:teuthology.orchestra.console.trial006:Power off 2026-02-24T13:42:01.079 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-24T13:42:01.117 DEBUG:teuthology.orchestra.console.trial006:power off output: Chassis Power Control: Down/Off 2026-02-24T13:42:01.319 INFO:teuthology.orchestra.console.trial112:Power off 2026-02-24T13:42:01.319 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-24T13:42:01.338 INFO:teuthology.orchestra.console.trial178:Power off 2026-02-24T13:42:01.339 DEBUG:teuthology.orchestra.console.trial178:pexpect command: ipmitool -H trial178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-24T13:42:01.350 INFO:teuthology.orchestra.console.trial116:Power off 2026-02-24T13:42:01.350 DEBUG:teuthology.orchestra.console.trial116:pexpect command: ipmitool -H trial116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-24T13:42:01.357 DEBUG:teuthology.orchestra.console.trial112:power off output: Chassis Power Control: Down/Off 2026-02-24T13:42:01.376 DEBUG:teuthology.orchestra.console.trial178:power off output: Chassis Power Control: Down/Off 2026-02-24T13:42:01.386 DEBUG:teuthology.orchestra.console.trial116:power off output: Chassis Power Control: Down/Off 2026-02-24T13:42:05.122 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T13:42:05.231 DEBUG:teuthology.orchestra.console.trial006:check power output: Chassis Power is off 2026-02-24T13:42:05.231 INFO:teuthology.orchestra.console.trial006:Power off completed 2026-02-24T13:42:05.332 INFO:teuthology.orchestra.console.trial006:Power on 2026-02-24T13:42:05.332 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-24T13:42:05.358 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T13:42:05.373 DEBUG:teuthology.orchestra.console.trial006:power on output: Chassis Power Control: Up/On 2026-02-24T13:42:05.377 DEBUG:teuthology.orchestra.console.trial178:pexpect command: ipmitool -H trial178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T13:42:05.386 DEBUG:teuthology.orchestra.console.trial116:pexpect command: ipmitool -H trial116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T13:42:05.468 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is off 2026-02-24T13:42:05.468 INFO:teuthology.orchestra.console.trial112:Power off completed 2026-02-24T13:42:05.486 DEBUG:teuthology.orchestra.console.trial178:check power output: Chassis Power is off 2026-02-24T13:42:05.486 INFO:teuthology.orchestra.console.trial178:Power off completed 2026-02-24T13:42:05.496 DEBUG:teuthology.orchestra.console.trial116:check power output: Chassis Power is off 2026-02-24T13:42:05.496 INFO:teuthology.orchestra.console.trial116:Power off completed 2026-02-24T13:42:05.569 INFO:teuthology.orchestra.console.trial112:Power on 2026-02-24T13:42:05.570 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-24T13:42:05.587 INFO:teuthology.orchestra.console.trial178:Power on 2026-02-24T13:42:05.587 DEBUG:teuthology.orchestra.console.trial178:pexpect command: ipmitool -H trial178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-24T13:42:05.597 INFO:teuthology.orchestra.console.trial116:Power on 2026-02-24T13:42:05.598 DEBUG:teuthology.orchestra.console.trial116:pexpect command: ipmitool -H trial116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-24T13:42:05.610 DEBUG:teuthology.orchestra.console.trial112:power on output: Chassis Power Control: Up/On 2026-02-24T13:42:05.627 DEBUG:teuthology.orchestra.console.trial178:power on output: Chassis Power Control: Up/On 2026-02-24T13:42:05.637 DEBUG:teuthology.orchestra.console.trial116:power on output: Chassis Power Control: Up/On 2026-02-24T13:42:09.376 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T13:42:09.487 DEBUG:teuthology.orchestra.console.trial006:check power output: Chassis Power is off 2026-02-24T13:42:09.611 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T13:42:09.627 DEBUG:teuthology.orchestra.console.trial178:pexpect command: ipmitool -H trial178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T13:42:09.638 DEBUG:teuthology.orchestra.console.trial116:pexpect command: ipmitool -H trial116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T13:42:09.721 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is on 2026-02-24T13:42:09.722 INFO:teuthology.orchestra.console.trial112:Power on completed 2026-02-24T13:42:09.737 DEBUG:teuthology.orchestra.console.trial178:check power output: Chassis Power is on 2026-02-24T13:42:09.738 INFO:teuthology.orchestra.console.trial178:Power on completed 2026-02-24T13:42:09.748 DEBUG:teuthology.orchestra.console.trial116:check power output: Chassis Power is on 2026-02-24T13:42:09.749 INFO:teuthology.orchestra.console.trial116:Power on completed 2026-02-24T13:42:09.823 INFO:teuthology.provision.fog.trial112:Waiting for deploy to finish 2026-02-24T13:42:09.838 INFO:teuthology.provision.fog.trial178:Waiting for deploy to finish 2026-02-24T13:42:09.850 INFO:teuthology.provision.fog.trial116:Waiting for deploy to finish 2026-02-24T13:42:13.491 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T13:42:13.600 DEBUG:teuthology.orchestra.console.trial006:check power output: Chassis Power is on 2026-02-24T13:42:13.600 INFO:teuthology.orchestra.console.trial006:Power on completed 2026-02-24T13:42:13.701 INFO:teuthology.provision.fog.trial006:Waiting for deploy to finish 2026-02-24T13:44:01.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:44:13.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:44:13.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:44:28.032 WARNING:teuthology.provision.fog.trial178:[Errno None] Unable to connect to port 22 on 10.20.193.178 2026-02-24T13:44:28.097 WARNING:teuthology.provision.fog.trial112:[Errno None] Unable to connect to port 22 on 10.20.193.112 2026-02-24T13:44:29.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:44:32.256 WARNING:teuthology.provision.fog.trial116:[Errno None] Unable to connect to port 22 on 10.20.193.116 2026-02-24T13:44:34.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:44:34.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:44:37.121 WARNING:teuthology.provision.fog.trial178:[Errno None] Unable to connect to port 22 on 10.20.193.178 2026-02-24T13:44:37.183 WARNING:teuthology.provision.fog.trial112:[Errno None] Unable to connect to port 22 on 10.20.193.112 2026-02-24T13:44:38.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:44:41.344 WARNING:teuthology.provision.fog.trial116:[Errno None] Unable to connect to port 22 on 10.20.193.116 2026-02-24T13:44:43.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:44:43.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:44:46.208 WARNING:teuthology.provision.fog.trial178:[Errno None] Unable to connect to port 22 on 10.20.193.178 2026-02-24T13:44:46.271 WARNING:teuthology.provision.fog.trial112:[Errno None] Unable to connect to port 22 on 10.20.193.112 2026-02-24T13:44:47.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:44:50.431 WARNING:teuthology.provision.fog.trial116:[Errno None] Unable to connect to port 22 on 10.20.193.116 2026-02-24T13:44:52.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:44:52.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:44:56.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:44:59.520 WARNING:teuthology.provision.fog.trial116:[Errno None] Unable to connect to port 22 on 10.20.193.116 2026-02-24T13:45:01.520 WARNING:teuthology.provision.fog.trial006:timed out 2026-02-24T13:45:05.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:45:07.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:45:08.608 WARNING:teuthology.provision.fog.trial116:[Errno None] Unable to connect to port 22 on 10.20.193.116 2026-02-24T13:45:14.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:45:14.819 ERROR:teuthology.orchestra.connection:Error authenticating with trial006.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-24T13:45:18.941 ERROR:teuthology.orchestra.connection:Error authenticating with trial006.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-24T13:45:26.021 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-24T13:45:26.022 DEBUG:teuthology.orchestra.run.trial006:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-24T13:45:26.180 INFO:teuthology.provision.fog.trial006:Node is ready 2026-02-24T13:45:26.180 DEBUG:teuthology.orchestra.run.trial006:> hostname 2026-02-24T13:45:26.235 INFO:teuthology.orchestra.run.trial006.stdout:trial006.front.sepia.ceph.com 2026-02-24T13:45:26.235 DEBUG:teuthology.orchestra.run.trial006:> grep trial006.front.sepia.ceph.com /etc/hosts 2026-02-24T13:45:26.292 INFO:teuthology.orchestra.run.trial006.stdout:10.20.193.6 trial006.front.sepia.ceph.com trial006 2026-02-24T13:45:26.292 DEBUG:teuthology.orchestra.run.trial006:> sudo hostname trial006 2026-02-24T13:45:26.363 DEBUG:teuthology.orchestra.run.trial006:> sudo sed -i -e 's/trial006.front.sepia.ceph.com/trial006/g' /etc/hosts 2026-02-24T13:45:26.428 DEBUG:teuthology.orchestra.run.trial006:> sudo sed -i -e 's/10.20.193.6/10.20.193.6/g' /etc/hosts 2026-02-24T13:45:26.491 DEBUG:teuthology.orchestra.run.trial006:> sudo sed -i -e 's/trial006.front.sepia.ceph.com/trial006/g' /etc/hostname 2026-02-24T13:45:26.556 DEBUG:teuthology.orchestra.run.trial006:> sudo hostname trial006 2026-02-24T13:45:26.621 DEBUG:teuthology.orchestra.run.trial006:> cat /etc/os-release 2026-02-24T13:45:26.677 INFO:teuthology.orchestra.run.trial006.stdout:NAME="CentOS Stream" 2026-02-24T13:45:26.677 INFO:teuthology.orchestra.run.trial006.stdout:VERSION="9" 2026-02-24T13:45:26.677 INFO:teuthology.orchestra.run.trial006.stdout:ID="centos" 2026-02-24T13:45:26.677 INFO:teuthology.orchestra.run.trial006.stdout:ID_LIKE="rhel fedora" 2026-02-24T13:45:26.677 INFO:teuthology.orchestra.run.trial006.stdout:VERSION_ID="9" 2026-02-24T13:45:26.677 INFO:teuthology.orchestra.run.trial006.stdout:PLATFORM_ID="platform:el9" 2026-02-24T13:45:26.677 INFO:teuthology.orchestra.run.trial006.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T13:45:26.678 INFO:teuthology.orchestra.run.trial006.stdout:ANSI_COLOR="0;31" 2026-02-24T13:45:26.678 INFO:teuthology.orchestra.run.trial006.stdout:LOGO="fedora-logo-icon" 2026-02-24T13:45:26.678 INFO:teuthology.orchestra.run.trial006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T13:45:26.678 INFO:teuthology.orchestra.run.trial006.stdout:HOME_URL="https://centos.org/" 2026-02-24T13:45:26.678 INFO:teuthology.orchestra.run.trial006.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T13:45:26.678 INFO:teuthology.orchestra.run.trial006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T13:45:26.678 INFO:teuthology.orchestra.run.trial006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T13:45:26.679 INFO:teuthology.provision.fog.trial006:Deploy complete! 2026-02-24T13:45:26.680 DEBUG:teuthology.parallel:result is None 2026-02-24T13:45:28.354 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-24T13:45:28.354 DEBUG:teuthology.orchestra.run.trial178:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-24T13:45:28.356 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-24T13:45:28.356 DEBUG:teuthology.orchestra.run.trial112:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-24T13:45:28.511 INFO:teuthology.provision.fog.trial112:Node is ready 2026-02-24T13:45:28.511 DEBUG:teuthology.orchestra.run.trial112:> hostname 2026-02-24T13:45:28.516 INFO:teuthology.provision.fog.trial178:Node is ready 2026-02-24T13:45:28.517 DEBUG:teuthology.orchestra.run.trial178:> hostname 2026-02-24T13:45:28.567 INFO:teuthology.orchestra.run.trial112.stdout:trial112.front.sepia.ceph.com 2026-02-24T13:45:28.568 DEBUG:teuthology.orchestra.run.trial112:> grep trial112.front.sepia.ceph.com /etc/hosts 2026-02-24T13:45:28.573 INFO:teuthology.orchestra.run.trial178.stdout:trial178.front.sepia.ceph.com 2026-02-24T13:45:28.574 DEBUG:teuthology.orchestra.run.trial178:> grep trial178.front.sepia.ceph.com /etc/hosts 2026-02-24T13:45:28.624 INFO:teuthology.orchestra.run.trial112.stdout:10.20.193.112 trial112.front.sepia.ceph.com trial112 2026-02-24T13:45:28.624 DEBUG:teuthology.orchestra.run.trial112:> sudo hostname trial112 2026-02-24T13:45:28.630 INFO:teuthology.orchestra.run.trial178.stdout:10.20.193.178 trial178.front.sepia.ceph.com trial178 2026-02-24T13:45:28.631 DEBUG:teuthology.orchestra.run.trial178:> sudo hostname trial178 2026-02-24T13:45:28.692 DEBUG:teuthology.orchestra.run.trial112:> sudo sed -i -e 's/trial112.front.sepia.ceph.com/trial112/g' /etc/hosts 2026-02-24T13:45:28.701 DEBUG:teuthology.orchestra.run.trial178:> sudo sed -i -e 's/trial178.front.sepia.ceph.com/trial178/g' /etc/hosts 2026-02-24T13:45:28.757 DEBUG:teuthology.orchestra.run.trial112:> sudo sed -i -e 's/10.20.193.112/10.20.193.112/g' /etc/hosts 2026-02-24T13:45:28.766 DEBUG:teuthology.orchestra.run.trial178:> sudo sed -i -e 's/10.20.193.178/10.20.193.178/g' /etc/hosts 2026-02-24T13:45:28.821 DEBUG:teuthology.orchestra.run.trial112:> sudo sed -i -e 's/trial112.front.sepia.ceph.com/trial112/g' /etc/hostname 2026-02-24T13:45:28.831 DEBUG:teuthology.orchestra.run.trial178:> sudo sed -i -e 's/trial178.front.sepia.ceph.com/trial178/g' /etc/hostname 2026-02-24T13:45:28.886 DEBUG:teuthology.orchestra.run.trial112:> sudo hostname trial112 2026-02-24T13:45:28.896 DEBUG:teuthology.orchestra.run.trial178:> sudo hostname trial178 2026-02-24T13:45:28.948 DEBUG:teuthology.orchestra.run.trial112:> cat /etc/os-release 2026-02-24T13:45:28.959 DEBUG:teuthology.orchestra.run.trial178:> cat /etc/os-release 2026-02-24T13:45:29.005 INFO:teuthology.orchestra.run.trial112.stdout:NAME="CentOS Stream" 2026-02-24T13:45:29.005 INFO:teuthology.orchestra.run.trial112.stdout:VERSION="9" 2026-02-24T13:45:29.005 INFO:teuthology.orchestra.run.trial112.stdout:ID="centos" 2026-02-24T13:45:29.005 INFO:teuthology.orchestra.run.trial112.stdout:ID_LIKE="rhel fedora" 2026-02-24T13:45:29.005 INFO:teuthology.orchestra.run.trial112.stdout:VERSION_ID="9" 2026-02-24T13:45:29.005 INFO:teuthology.orchestra.run.trial112.stdout:PLATFORM_ID="platform:el9" 2026-02-24T13:45:29.005 INFO:teuthology.orchestra.run.trial112.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T13:45:29.006 INFO:teuthology.orchestra.run.trial112.stdout:ANSI_COLOR="0;31" 2026-02-24T13:45:29.006 INFO:teuthology.orchestra.run.trial112.stdout:LOGO="fedora-logo-icon" 2026-02-24T13:45:29.006 INFO:teuthology.orchestra.run.trial112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T13:45:29.006 INFO:teuthology.orchestra.run.trial112.stdout:HOME_URL="https://centos.org/" 2026-02-24T13:45:29.006 INFO:teuthology.orchestra.run.trial112.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T13:45:29.006 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T13:45:29.006 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T13:45:29.007 INFO:teuthology.provision.fog.trial112:Deploy complete! 2026-02-24T13:45:29.008 DEBUG:teuthology.parallel:result is None 2026-02-24T13:45:29.016 INFO:teuthology.orchestra.run.trial178.stdout:NAME="CentOS Stream" 2026-02-24T13:45:29.016 INFO:teuthology.orchestra.run.trial178.stdout:VERSION="9" 2026-02-24T13:45:29.016 INFO:teuthology.orchestra.run.trial178.stdout:ID="centos" 2026-02-24T13:45:29.017 INFO:teuthology.orchestra.run.trial178.stdout:ID_LIKE="rhel fedora" 2026-02-24T13:45:29.017 INFO:teuthology.orchestra.run.trial178.stdout:VERSION_ID="9" 2026-02-24T13:45:29.017 INFO:teuthology.orchestra.run.trial178.stdout:PLATFORM_ID="platform:el9" 2026-02-24T13:45:29.017 INFO:teuthology.orchestra.run.trial178.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T13:45:29.017 INFO:teuthology.orchestra.run.trial178.stdout:ANSI_COLOR="0;31" 2026-02-24T13:45:29.017 INFO:teuthology.orchestra.run.trial178.stdout:LOGO="fedora-logo-icon" 2026-02-24T13:45:29.017 INFO:teuthology.orchestra.run.trial178.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T13:45:29.017 INFO:teuthology.orchestra.run.trial178.stdout:HOME_URL="https://centos.org/" 2026-02-24T13:45:29.017 INFO:teuthology.orchestra.run.trial178.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T13:45:29.018 INFO:teuthology.orchestra.run.trial178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T13:45:29.018 INFO:teuthology.orchestra.run.trial178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T13:45:29.018 INFO:teuthology.provision.fog.trial178:Deploy complete! 2026-02-24T13:45:29.019 DEBUG:teuthology.parallel:result is None 2026-02-24T13:45:50.840 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-24T13:45:50.840 DEBUG:teuthology.orchestra.run.trial116:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-24T13:45:50.999 INFO:teuthology.provision.fog.trial116:Node is ready 2026-02-24T13:45:50.999 DEBUG:teuthology.orchestra.run.trial116:> hostname 2026-02-24T13:45:51.056 INFO:teuthology.orchestra.run.trial116.stdout:trial116.front.sepia.ceph.com 2026-02-24T13:45:51.056 DEBUG:teuthology.orchestra.run.trial116:> grep trial116.front.sepia.ceph.com /etc/hosts 2026-02-24T13:45:51.113 INFO:teuthology.orchestra.run.trial116.stdout:10.20.193.116 trial116.front.sepia.ceph.com trial116 2026-02-24T13:45:51.113 DEBUG:teuthology.orchestra.run.trial116:> sudo hostname trial116 2026-02-24T13:45:51.182 DEBUG:teuthology.orchestra.run.trial116:> sudo sed -i -e 's/trial116.front.sepia.ceph.com/trial116/g' /etc/hosts 2026-02-24T13:45:51.247 DEBUG:teuthology.orchestra.run.trial116:> sudo sed -i -e 's/10.20.193.116/10.20.193.116/g' /etc/hosts 2026-02-24T13:45:51.312 DEBUG:teuthology.orchestra.run.trial116:> sudo sed -i -e 's/trial116.front.sepia.ceph.com/trial116/g' /etc/hostname 2026-02-24T13:45:51.376 DEBUG:teuthology.orchestra.run.trial116:> sudo hostname trial116 2026-02-24T13:45:51.440 DEBUG:teuthology.orchestra.run.trial116:> cat /etc/os-release 2026-02-24T13:45:51.496 INFO:teuthology.orchestra.run.trial116.stdout:NAME="CentOS Stream" 2026-02-24T13:45:51.496 INFO:teuthology.orchestra.run.trial116.stdout:VERSION="9" 2026-02-24T13:45:51.497 INFO:teuthology.orchestra.run.trial116.stdout:ID="centos" 2026-02-24T13:45:51.497 INFO:teuthology.orchestra.run.trial116.stdout:ID_LIKE="rhel fedora" 2026-02-24T13:45:51.497 INFO:teuthology.orchestra.run.trial116.stdout:VERSION_ID="9" 2026-02-24T13:45:51.497 INFO:teuthology.orchestra.run.trial116.stdout:PLATFORM_ID="platform:el9" 2026-02-24T13:45:51.497 INFO:teuthology.orchestra.run.trial116.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T13:45:51.497 INFO:teuthology.orchestra.run.trial116.stdout:ANSI_COLOR="0;31" 2026-02-24T13:45:51.497 INFO:teuthology.orchestra.run.trial116.stdout:LOGO="fedora-logo-icon" 2026-02-24T13:45:51.497 INFO:teuthology.orchestra.run.trial116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T13:45:51.497 INFO:teuthology.orchestra.run.trial116.stdout:HOME_URL="https://centos.org/" 2026-02-24T13:45:51.497 INFO:teuthology.orchestra.run.trial116.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T13:45:51.497 INFO:teuthology.orchestra.run.trial116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T13:45:51.498 INFO:teuthology.orchestra.run.trial116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T13:45:51.498 INFO:teuthology.provision.fog.trial116:Deploy complete! 2026-02-24T13:45:51.499 DEBUG:teuthology.parallel:result is None 2026-02-24T13:45:52.153 INFO:teuthology.lock.ops:Checking trial006.front.sepia.ceph.com 2026-02-24T13:45:52.154 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-24T13:45:52.261 INFO:teuthology.lock.ops:Checking trial112.front.sepia.ceph.com 2026-02-24T13:45:52.261 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-24T13:45:52.324 INFO:teuthology.lock.ops:Checking trial116.front.sepia.ceph.com 2026-02-24T13:45:52.324 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-24T13:45:52.381 INFO:teuthology.lock.ops:Checking trial178.front.sepia.ceph.com 2026-02-24T13:45:52.381 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-24T13:45:52.438 INFO:teuthology.lock.ops:Updating [trial006.front.sepia.ceph.com]: set os type and version on server 2026-02-24T13:45:52.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial006.front.sepia.ceph.com' 2026-02-24T13:45:52.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:45:52.499 DEBUG:teuthology.orchestra.run.trial006:> true 2026-02-24T13:45:52.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial006.front.sepia.ceph.com' 2026-02-24T13:45:52.633 DEBUG:teuthology.orchestra.run.trial006:> uname -m 2026-02-24T13:45:52.689 INFO:teuthology.orchestra.run.trial006.stdout:x86_64 2026-02-24T13:45:52.690 DEBUG:teuthology.orchestra.run.trial006:> cat /etc/os-release 2026-02-24T13:45:52.747 INFO:teuthology.orchestra.run.trial006.stdout:NAME="CentOS Stream" 2026-02-24T13:45:52.747 INFO:teuthology.orchestra.run.trial006.stdout:VERSION="9" 2026-02-24T13:45:52.747 INFO:teuthology.orchestra.run.trial006.stdout:ID="centos" 2026-02-24T13:45:52.747 INFO:teuthology.orchestra.run.trial006.stdout:ID_LIKE="rhel fedora" 2026-02-24T13:45:52.747 INFO:teuthology.orchestra.run.trial006.stdout:VERSION_ID="9" 2026-02-24T13:45:52.748 INFO:teuthology.orchestra.run.trial006.stdout:PLATFORM_ID="platform:el9" 2026-02-24T13:45:52.748 INFO:teuthology.orchestra.run.trial006.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T13:45:52.748 INFO:teuthology.orchestra.run.trial006.stdout:ANSI_COLOR="0;31" 2026-02-24T13:45:52.748 INFO:teuthology.orchestra.run.trial006.stdout:LOGO="fedora-logo-icon" 2026-02-24T13:45:52.748 INFO:teuthology.orchestra.run.trial006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T13:45:52.748 INFO:teuthology.orchestra.run.trial006.stdout:HOME_URL="https://centos.org/" 2026-02-24T13:45:52.748 INFO:teuthology.orchestra.run.trial006.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T13:45:52.748 INFO:teuthology.orchestra.run.trial006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T13:45:52.748 INFO:teuthology.orchestra.run.trial006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T13:45:52.749 INFO:teuthology.lock.ops:Updating trial006.front.sepia.ceph.com on lock server 2026-02-24T13:45:52.854 INFO:teuthology.lock.ops:Updating [trial112.front.sepia.ceph.com]: set os type and version on server 2026-02-24T13:45:52.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-24T13:45:52.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:45:52.924 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-24T13:45:53.053 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-24T13:45:53.054 DEBUG:teuthology.orchestra.run.trial112:> uname -m 2026-02-24T13:45:53.110 INFO:teuthology.orchestra.run.trial112.stdout:x86_64 2026-02-24T13:45:53.111 DEBUG:teuthology.orchestra.run.trial112:> cat /etc/os-release 2026-02-24T13:45:53.166 INFO:teuthology.orchestra.run.trial112.stdout:NAME="CentOS Stream" 2026-02-24T13:45:53.166 INFO:teuthology.orchestra.run.trial112.stdout:VERSION="9" 2026-02-24T13:45:53.166 INFO:teuthology.orchestra.run.trial112.stdout:ID="centos" 2026-02-24T13:45:53.166 INFO:teuthology.orchestra.run.trial112.stdout:ID_LIKE="rhel fedora" 2026-02-24T13:45:53.166 INFO:teuthology.orchestra.run.trial112.stdout:VERSION_ID="9" 2026-02-24T13:45:53.166 INFO:teuthology.orchestra.run.trial112.stdout:PLATFORM_ID="platform:el9" 2026-02-24T13:45:53.166 INFO:teuthology.orchestra.run.trial112.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T13:45:53.167 INFO:teuthology.orchestra.run.trial112.stdout:ANSI_COLOR="0;31" 2026-02-24T13:45:53.167 INFO:teuthology.orchestra.run.trial112.stdout:LOGO="fedora-logo-icon" 2026-02-24T13:45:53.167 INFO:teuthology.orchestra.run.trial112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T13:45:53.167 INFO:teuthology.orchestra.run.trial112.stdout:HOME_URL="https://centos.org/" 2026-02-24T13:45:53.167 INFO:teuthology.orchestra.run.trial112.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T13:45:53.167 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T13:45:53.167 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T13:45:53.168 INFO:teuthology.lock.ops:Updating trial112.front.sepia.ceph.com on lock server 2026-02-24T13:45:53.275 INFO:teuthology.lock.ops:Updating [trial116.front.sepia.ceph.com]: set os type and version on server 2026-02-24T13:45:53.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial116.front.sepia.ceph.com' 2026-02-24T13:45:53.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:45:53.346 DEBUG:teuthology.orchestra.run.trial116:> true 2026-02-24T13:45:53.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial116.front.sepia.ceph.com' 2026-02-24T13:45:53.418 DEBUG:teuthology.orchestra.run.trial116:> uname -m 2026-02-24T13:45:53.474 INFO:teuthology.orchestra.run.trial116.stdout:x86_64 2026-02-24T13:45:53.474 DEBUG:teuthology.orchestra.run.trial116:> cat /etc/os-release 2026-02-24T13:45:53.530 INFO:teuthology.orchestra.run.trial116.stdout:NAME="CentOS Stream" 2026-02-24T13:45:53.530 INFO:teuthology.orchestra.run.trial116.stdout:VERSION="9" 2026-02-24T13:45:53.530 INFO:teuthology.orchestra.run.trial116.stdout:ID="centos" 2026-02-24T13:45:53.530 INFO:teuthology.orchestra.run.trial116.stdout:ID_LIKE="rhel fedora" 2026-02-24T13:45:53.531 INFO:teuthology.orchestra.run.trial116.stdout:VERSION_ID="9" 2026-02-24T13:45:53.531 INFO:teuthology.orchestra.run.trial116.stdout:PLATFORM_ID="platform:el9" 2026-02-24T13:45:53.531 INFO:teuthology.orchestra.run.trial116.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T13:45:53.531 INFO:teuthology.orchestra.run.trial116.stdout:ANSI_COLOR="0;31" 2026-02-24T13:45:53.531 INFO:teuthology.orchestra.run.trial116.stdout:LOGO="fedora-logo-icon" 2026-02-24T13:45:53.531 INFO:teuthology.orchestra.run.trial116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T13:45:53.531 INFO:teuthology.orchestra.run.trial116.stdout:HOME_URL="https://centos.org/" 2026-02-24T13:45:53.531 INFO:teuthology.orchestra.run.trial116.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T13:45:53.531 INFO:teuthology.orchestra.run.trial116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T13:45:53.531 INFO:teuthology.orchestra.run.trial116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T13:45:53.532 INFO:teuthology.lock.ops:Updating trial116.front.sepia.ceph.com on lock server 2026-02-24T13:45:53.636 INFO:teuthology.lock.ops:Updating [trial178.front.sepia.ceph.com]: set os type and version on server 2026-02-24T13:45:53.636 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-24T13:45:53.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T13:45:53.704 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-24T13:45:53.846 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-24T13:45:53.846 DEBUG:teuthology.orchestra.run.trial178:> uname -m 2026-02-24T13:45:53.903 INFO:teuthology.orchestra.run.trial178.stdout:x86_64 2026-02-24T13:45:53.903 DEBUG:teuthology.orchestra.run.trial178:> cat /etc/os-release 2026-02-24T13:45:53.960 INFO:teuthology.orchestra.run.trial178.stdout:NAME="CentOS Stream" 2026-02-24T13:45:53.961 INFO:teuthology.orchestra.run.trial178.stdout:VERSION="9" 2026-02-24T13:45:53.961 INFO:teuthology.orchestra.run.trial178.stdout:ID="centos" 2026-02-24T13:45:53.961 INFO:teuthology.orchestra.run.trial178.stdout:ID_LIKE="rhel fedora" 2026-02-24T13:45:53.961 INFO:teuthology.orchestra.run.trial178.stdout:VERSION_ID="9" 2026-02-24T13:45:53.961 INFO:teuthology.orchestra.run.trial178.stdout:PLATFORM_ID="platform:el9" 2026-02-24T13:45:53.961 INFO:teuthology.orchestra.run.trial178.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T13:45:53.961 INFO:teuthology.orchestra.run.trial178.stdout:ANSI_COLOR="0;31" 2026-02-24T13:45:53.961 INFO:teuthology.orchestra.run.trial178.stdout:LOGO="fedora-logo-icon" 2026-02-24T13:45:53.961 INFO:teuthology.orchestra.run.trial178.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T13:45:53.961 INFO:teuthology.orchestra.run.trial178.stdout:HOME_URL="https://centos.org/" 2026-02-24T13:45:53.962 INFO:teuthology.orchestra.run.trial178.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T13:45:53.962 INFO:teuthology.orchestra.run.trial178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T13:45:53.962 INFO:teuthology.orchestra.run.trial178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T13:45:53.962 INFO:teuthology.lock.ops:Updating trial178.front.sepia.ceph.com on lock server 2026-02-24T13:45:54.068 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T13:45:54.164 INFO:teuthology.dispatcher.supervisor:Running job 67839 2026-02-24T13:45:54.164 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_cjames@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/cjames-2026-02-24_10:01:51-rados-main-distro-default-trial/67839 --name cjames-2026-02-24_10:01:51-rados-main-distro-default-trial --description rados/thrash-erasure-code/{ceph clusters/{fixed-4} ec_direct_reads/ec_direct_reads_on ec_optimizations/ec_optimizations_on fast/normal mon_election/classic msgr-failures/osd-delay objectstore/{bluestore/{alloc$/{btree} base mem$/{low} onode-segment$/{none} write$/{v1/{compr$/{yes$/{zstd}} v1}}}} rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-small-objects} -- /home/teuthworker/mnt/teuthology/cjames-2026-02-24_10:01:51-rados-main-distro-default-trial/67839/orig.config.yaml 2026-02-24T13:45:54.165 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/cjames-2026-02-24_10:01:51-rados-main-distro-default-trial/67839 2026-02-24T13:45:54.165 INFO:teuthology.dispatcher.supervisor:Job PID: 703457 2026-02-24T13:45:54.165 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-24T13:47:54.264 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T13:49:54.465 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T13:51:54.650 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T13:53:54.842 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T13:55:55.025 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T13:57:55.213 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T13:59:55.358 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T14:01:55.533 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T14:03:55.709 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T14:05:55.887 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T14:05:55.971 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-24T14:05:56.223 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-24T14:05:57.177 INFO:teuthology.orchestra.console.trial006:Power off 2026-02-24T14:05:57.177 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-24T14:05:57.235 INFO:teuthology.orchestra.console.trial116:Power off 2026-02-24T14:05:57.235 DEBUG:teuthology.orchestra.console.trial116:pexpect command: ipmitool -H trial116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-24T14:05:57.249 INFO:teuthology.orchestra.console.trial178:Power off 2026-02-24T14:05:57.249 DEBUG:teuthology.orchestra.console.trial178:pexpect command: ipmitool -H trial178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-24T14:05:57.253 DEBUG:teuthology.orchestra.console.trial006:power off output: Chassis Power Control: Down/Off 2026-02-24T14:05:57.259 INFO:teuthology.orchestra.console.trial112:Power off 2026-02-24T14:05:57.259 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-24T14:05:57.280 DEBUG:teuthology.orchestra.console.trial116:power off output: Chassis Power Control: Down/Off 2026-02-24T14:05:57.286 DEBUG:teuthology.orchestra.console.trial178:power off output: Chassis Power Control: Down/Off 2026-02-24T14:05:57.297 DEBUG:teuthology.orchestra.console.trial112:power off output: Chassis Power Control: Down/Off 2026-02-24T14:06:01.258 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T14:06:01.281 DEBUG:teuthology.orchestra.console.trial116:pexpect command: ipmitool -H trial116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T14:06:01.288 DEBUG:teuthology.orchestra.console.trial178:pexpect command: ipmitool -H trial178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T14:06:01.298 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T14:06:01.368 DEBUG:teuthology.orchestra.console.trial006:check power output: Chassis Power is on 2026-02-24T14:06:01.390 DEBUG:teuthology.orchestra.console.trial116:check power output: Chassis Power is on 2026-02-24T14:06:01.395 DEBUG:teuthology.orchestra.console.trial178:check power output: Chassis Power is on 2026-02-24T14:06:01.406 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is on 2026-02-24T14:06:05.373 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T14:06:05.391 DEBUG:teuthology.orchestra.console.trial116:pexpect command: ipmitool -H trial116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T14:06:05.396 DEBUG:teuthology.orchestra.console.trial178:pexpect command: ipmitool -H trial178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T14:06:05.407 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-24T14:06:05.482 DEBUG:teuthology.orchestra.console.trial006:check power output: Chassis Power is off 2026-02-24T14:06:05.483 INFO:teuthology.orchestra.console.trial006:Power off completed 2026-02-24T14:06:05.499 DEBUG:teuthology.orchestra.console.trial116:check power output: Chassis Power is off 2026-02-24T14:06:05.499 INFO:teuthology.orchestra.console.trial116:Power off completed 2026-02-24T14:06:05.505 DEBUG:teuthology.orchestra.console.trial178:check power output: Chassis Power is off 2026-02-24T14:06:05.505 INFO:teuthology.orchestra.console.trial178:Power off completed 2026-02-24T14:06:05.518 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is off 2026-02-24T14:06:05.518 INFO:teuthology.orchestra.console.trial112:Power off completed 2026-02-24T14:06:05.828 INFO:teuthology.lock.ops:unlocked: trial006.front.sepia.ceph.com 2026-02-24T14:06:05.835 INFO:teuthology.lock.ops:unlocked: trial116.front.sepia.ceph.com 2026-02-24T14:06:05.839 INFO:teuthology.lock.ops:unlocked: trial178.front.sepia.ceph.com 2026-02-24T14:06:05.846 INFO:teuthology.lock.ops:unlocked: trial112.front.sepia.ceph.com