2026-02-14T02:02:57.631 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-14T02:02:57.631 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-14T02:02:57.703 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-14T02:02:57.954 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x71ff3cca3100>, signals=[15]) 2026-02-14T02:02:57.954 INFO:teuthology.lock.ops:Start node 'trial032.front.sepia.ceph.com' reimaging 2026-02-14T02:02:57.954 INFO:teuthology.lock.ops:Updating [trial032.front.sepia.ceph.com]: reset os type and version on server 2026-02-14T02:02:57.954 INFO:teuthology.lock.ops:Updating trial032.front.sepia.ceph.com on lock server 2026-02-14T02:02:58.013 INFO:teuthology.lock.ops:Start node 'trial156.front.sepia.ceph.com' reimaging 2026-02-14T02:02:58.013 INFO:teuthology.lock.ops:Updating [trial156.front.sepia.ceph.com]: reset os type and version on server 2026-02-14T02:02:58.013 INFO:teuthology.lock.ops:Updating trial156.front.sepia.ceph.com on lock server 2026-02-14T02:02:58.072 INFO:teuthology.lock.ops:Start node 'trial158.front.sepia.ceph.com' reimaging 2026-02-14T02:02:58.072 INFO:teuthology.lock.ops:Updating [trial158.front.sepia.ceph.com]: reset os type and version on server 2026-02-14T02:02:58.072 INFO:teuthology.lock.ops:Updating trial158.front.sepia.ceph.com on lock server 2026-02-14T02:02:58.307 DEBUG:teuthology.provision.fog.trial156:Requesting image trial_centos_9.stream (ID 3) 2026-02-14T02:02:58.308 DEBUG:teuthology.provision.fog.trial032:Requesting image trial_centos_9.stream (ID 3) 2026-02-14T02:02:58.361 INFO:teuthology.provision.fog.trial156:Scheduling deploy of centos 9.stream 2026-02-14T02:02:58.362 INFO:teuthology.provision.fog.trial032:Scheduling deploy of centos 9.stream 2026-02-14T02:02:58.367 DEBUG:teuthology.provision.fog.trial158:Requesting image trial_centos_9.stream (ID 3) 2026-02-14T02:02:58.419 INFO:teuthology.provision.fog.trial158:Scheduling deploy of centos 9.stream 2026-02-14T02:02:59.566 INFO:teuthology.orchestra.console.trial156:Power off 2026-02-14T02:02:59.566 DEBUG:teuthology.orchestra.console.trial156:pexpect command: ipmitool -H trial156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-14T02:02:59.578 INFO:teuthology.orchestra.console.trial158:Power off 2026-02-14T02:02:59.578 DEBUG:teuthology.orchestra.console.trial158:pexpect command: ipmitool -H trial158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-14T02:02:59.588 INFO:teuthology.orchestra.console.trial032:Power off 2026-02-14T02:02:59.588 DEBUG:teuthology.orchestra.console.trial032:pexpect command: ipmitool -H trial032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-14T02:02:59.605 DEBUG:teuthology.orchestra.console.trial156:power off output: Chassis Power Control: Down/Off 2026-02-14T02:02:59.615 DEBUG:teuthology.orchestra.console.trial158:power off output: Chassis Power Control: Down/Off 2026-02-14T02:02:59.624 DEBUG:teuthology.orchestra.console.trial032:power off output: Chassis Power Control: Down/Off 2026-02-14T02:03:03.609 DEBUG:teuthology.orchestra.console.trial156:pexpect command: ipmitool -H trial156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-14T02:03:03.616 DEBUG:teuthology.orchestra.console.trial158:pexpect command: ipmitool -H trial158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-14T02:03:03.625 DEBUG:teuthology.orchestra.console.trial032:pexpect command: ipmitool -H trial032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-14T02:03:03.719 DEBUG:teuthology.orchestra.console.trial156:check power output: Chassis Power is off 2026-02-14T02:03:03.719 INFO:teuthology.orchestra.console.trial156:Power off completed 2026-02-14T02:03:03.725 DEBUG:teuthology.orchestra.console.trial158:check power output: Chassis Power is off 2026-02-14T02:03:03.725 INFO:teuthology.orchestra.console.trial158:Power off completed 2026-02-14T02:03:03.733 DEBUG:teuthology.orchestra.console.trial032:check power output: Chassis Power is off 2026-02-14T02:03:03.733 INFO:teuthology.orchestra.console.trial032:Power off completed 2026-02-14T02:03:03.820 INFO:teuthology.orchestra.console.trial156:Power on 2026-02-14T02:03:03.821 DEBUG:teuthology.orchestra.console.trial156:pexpect command: ipmitool -H trial156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-14T02:03:03.830 INFO:teuthology.orchestra.console.trial158:Power on 2026-02-14T02:03:03.830 DEBUG:teuthology.orchestra.console.trial158:pexpect command: ipmitool -H trial158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-14T02:03:03.839 INFO:teuthology.orchestra.console.trial032:Power on 2026-02-14T02:03:03.840 DEBUG:teuthology.orchestra.console.trial032:pexpect command: ipmitool -H trial032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-14T02:03:03.862 DEBUG:teuthology.orchestra.console.trial156:power on output: Chassis Power Control: Up/On 2026-02-14T02:03:03.869 DEBUG:teuthology.orchestra.console.trial158:power on output: Chassis Power Control: Up/On 2026-02-14T02:03:03.879 DEBUG:teuthology.orchestra.console.trial032:power on output: Chassis Power Control: Up/On 2026-02-14T02:03:07.867 DEBUG:teuthology.orchestra.console.trial156:pexpect command: ipmitool -H trial156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-14T02:03:07.875 DEBUG:teuthology.orchestra.console.trial158:pexpect command: ipmitool -H trial158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-14T02:03:07.884 DEBUG:teuthology.orchestra.console.trial032:pexpect command: ipmitool -H trial032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-14T02:03:07.978 DEBUG:teuthology.orchestra.console.trial156:check power output: Chassis Power is on 2026-02-14T02:03:07.979 INFO:teuthology.orchestra.console.trial156:Power on completed 2026-02-14T02:03:07.985 DEBUG:teuthology.orchestra.console.trial158:check power output: Chassis Power is on 2026-02-14T02:03:07.986 INFO:teuthology.orchestra.console.trial158:Power on completed 2026-02-14T02:03:07.994 DEBUG:teuthology.orchestra.console.trial032:check power output: Chassis Power is on 2026-02-14T02:03:07.994 INFO:teuthology.orchestra.console.trial032:Power on completed 2026-02-14T02:03:08.080 INFO:teuthology.provision.fog.trial156:Waiting for deploy to finish 2026-02-14T02:03:08.086 INFO:teuthology.provision.fog.trial158:Waiting for deploy to finish 2026-02-14T02:03:08.095 INFO:teuthology.provision.fog.trial032:Waiting for deploy to finish 2026-02-14T02:04:55.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-14T02:04:55.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-14T02:04:55.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-14T02:05:55.561 WARNING:teuthology.provision.fog.trial032:timed out 2026-02-14T02:05:55.583 WARNING:teuthology.provision.fog.trial158:timed out 2026-02-14T02:05:55.587 WARNING:teuthology.provision.fog.trial156:timed out 2026-02-14T02:06:01.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-14T02:06:01.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-14T02:06:01.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-14T02:06:06.891 ERROR:teuthology.orchestra.connection:Error authenticating with trial156.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-14T02:06:08.880 ERROR:teuthology.orchestra.connection:Error authenticating with trial032.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-14T02:06:08.904 ERROR:teuthology.orchestra.connection:Error authenticating with trial158.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-14T02:06:10.972 ERROR:teuthology.orchestra.connection:Error authenticating with trial156.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-14T02:06:13.005 ERROR:teuthology.orchestra.connection:Error authenticating with trial032.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-14T02:06:13.019 ERROR:teuthology.orchestra.connection:Error authenticating with trial158.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-14T02:06:18.039 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-14T02:06:18.039 DEBUG:teuthology.orchestra.run.trial156:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-14T02:06:18.251 INFO:teuthology.provision.fog.trial156:Node is ready 2026-02-14T02:06:18.251 DEBUG:teuthology.orchestra.run.trial156:> hostname 2026-02-14T02:06:18.307 INFO:teuthology.orchestra.run.trial156.stdout:trial156.front.sepia.ceph.com 2026-02-14T02:06:18.308 DEBUG:teuthology.orchestra.run.trial156:> grep trial156.front.sepia.ceph.com /etc/hosts 2026-02-14T02:06:18.364 INFO:teuthology.orchestra.run.trial156.stdout:10.20.193.156 trial156.front.sepia.ceph.com trial156 2026-02-14T02:06:18.364 DEBUG:teuthology.orchestra.run.trial156:> sudo hostname trial156 2026-02-14T02:06:18.432 DEBUG:teuthology.orchestra.run.trial156:> sudo sed -i -e 's/trial156.front.sepia.ceph.com/trial156/g' /etc/hosts 2026-02-14T02:06:18.497 DEBUG:teuthology.orchestra.run.trial156:> sudo sed -i -e 's/10.20.193.156/10.20.193.156/g' /etc/hosts 2026-02-14T02:06:18.561 DEBUG:teuthology.orchestra.run.trial156:> sudo sed -i -e 's/trial156.front.sepia.ceph.com/trial156/g' /etc/hostname 2026-02-14T02:06:18.626 DEBUG:teuthology.orchestra.run.trial156:> sudo hostname trial156 2026-02-14T02:06:18.690 DEBUG:teuthology.orchestra.run.trial156:> cat /etc/os-release 2026-02-14T02:06:18.747 INFO:teuthology.orchestra.run.trial156.stdout:NAME="CentOS Stream" 2026-02-14T02:06:18.747 INFO:teuthology.orchestra.run.trial156.stdout:VERSION="9" 2026-02-14T02:06:18.747 INFO:teuthology.orchestra.run.trial156.stdout:ID="centos" 2026-02-14T02:06:18.747 INFO:teuthology.orchestra.run.trial156.stdout:ID_LIKE="rhel fedora" 2026-02-14T02:06:18.747 INFO:teuthology.orchestra.run.trial156.stdout:VERSION_ID="9" 2026-02-14T02:06:18.747 INFO:teuthology.orchestra.run.trial156.stdout:PLATFORM_ID="platform:el9" 2026-02-14T02:06:18.748 INFO:teuthology.orchestra.run.trial156.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-14T02:06:18.748 INFO:teuthology.orchestra.run.trial156.stdout:ANSI_COLOR="0;31" 2026-02-14T02:06:18.748 INFO:teuthology.orchestra.run.trial156.stdout:LOGO="fedora-logo-icon" 2026-02-14T02:06:18.748 INFO:teuthology.orchestra.run.trial156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-14T02:06:18.748 INFO:teuthology.orchestra.run.trial156.stdout:HOME_URL="https://centos.org/" 2026-02-14T02:06:18.748 INFO:teuthology.orchestra.run.trial156.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-14T02:06:18.748 INFO:teuthology.orchestra.run.trial156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-14T02:06:18.748 INFO:teuthology.orchestra.run.trial156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-14T02:06:18.749 INFO:teuthology.provision.fog.trial156:Deploy complete! 2026-02-14T02:06:18.750 DEBUG:teuthology.parallel:result is None 2026-02-14T02:06:20.117 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-14T02:06:20.117 DEBUG:teuthology.orchestra.run.trial032:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-14T02:06:20.173 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-14T02:06:20.173 DEBUG:teuthology.orchestra.run.trial158:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-14T02:06:20.281 INFO:teuthology.provision.fog.trial032:Node is ready 2026-02-14T02:06:20.282 DEBUG:teuthology.orchestra.run.trial032:> hostname 2026-02-14T02:06:20.324 INFO:teuthology.provision.fog.trial158:Node is ready 2026-02-14T02:06:20.324 DEBUG:teuthology.orchestra.run.trial158:> hostname 2026-02-14T02:06:20.337 INFO:teuthology.orchestra.run.trial032.stdout:trial032.front.sepia.ceph.com 2026-02-14T02:06:20.338 DEBUG:teuthology.orchestra.run.trial032:> grep trial032.front.sepia.ceph.com /etc/hosts 2026-02-14T02:06:20.379 INFO:teuthology.orchestra.run.trial158.stdout:trial158.front.sepia.ceph.com 2026-02-14T02:06:20.380 DEBUG:teuthology.orchestra.run.trial158:> grep trial158.front.sepia.ceph.com /etc/hosts 2026-02-14T02:06:20.393 INFO:teuthology.orchestra.run.trial032.stdout:10.20.193.32 trial032.front.sepia.ceph.com trial032 2026-02-14T02:06:20.393 DEBUG:teuthology.orchestra.run.trial032:> sudo hostname trial032 2026-02-14T02:06:20.437 INFO:teuthology.orchestra.run.trial158.stdout:10.20.193.158 trial158.front.sepia.ceph.com trial158 2026-02-14T02:06:20.437 DEBUG:teuthology.orchestra.run.trial158:> sudo hostname trial158 2026-02-14T02:06:20.461 DEBUG:teuthology.orchestra.run.trial032:> sudo sed -i -e 's/trial032.front.sepia.ceph.com/trial032/g' /etc/hosts 2026-02-14T02:06:20.506 DEBUG:teuthology.orchestra.run.trial158:> sudo sed -i -e 's/trial158.front.sepia.ceph.com/trial158/g' /etc/hosts 2026-02-14T02:06:20.525 DEBUG:teuthology.orchestra.run.trial032:> sudo sed -i -e 's/10.20.193.32/10.20.193.32/g' /etc/hosts 2026-02-14T02:06:20.571 DEBUG:teuthology.orchestra.run.trial158:> sudo sed -i -e 's/10.20.193.158/10.20.193.158/g' /etc/hosts 2026-02-14T02:06:20.589 DEBUG:teuthology.orchestra.run.trial032:> sudo sed -i -e 's/trial032.front.sepia.ceph.com/trial032/g' /etc/hostname 2026-02-14T02:06:20.635 DEBUG:teuthology.orchestra.run.trial158:> sudo sed -i -e 's/trial158.front.sepia.ceph.com/trial158/g' /etc/hostname 2026-02-14T02:06:20.653 DEBUG:teuthology.orchestra.run.trial032:> sudo hostname trial032 2026-02-14T02:06:20.700 DEBUG:teuthology.orchestra.run.trial158:> sudo hostname trial158 2026-02-14T02:06:20.716 DEBUG:teuthology.orchestra.run.trial032:> cat /etc/os-release 2026-02-14T02:06:20.763 DEBUG:teuthology.orchestra.run.trial158:> cat /etc/os-release 2026-02-14T02:06:20.772 INFO:teuthology.orchestra.run.trial032.stdout:NAME="CentOS Stream" 2026-02-14T02:06:20.773 INFO:teuthology.orchestra.run.trial032.stdout:VERSION="9" 2026-02-14T02:06:20.773 INFO:teuthology.orchestra.run.trial032.stdout:ID="centos" 2026-02-14T02:06:20.773 INFO:teuthology.orchestra.run.trial032.stdout:ID_LIKE="rhel fedora" 2026-02-14T02:06:20.773 INFO:teuthology.orchestra.run.trial032.stdout:VERSION_ID="9" 2026-02-14T02:06:20.773 INFO:teuthology.orchestra.run.trial032.stdout:PLATFORM_ID="platform:el9" 2026-02-14T02:06:20.773 INFO:teuthology.orchestra.run.trial032.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-14T02:06:20.773 INFO:teuthology.orchestra.run.trial032.stdout:ANSI_COLOR="0;31" 2026-02-14T02:06:20.773 INFO:teuthology.orchestra.run.trial032.stdout:LOGO="fedora-logo-icon" 2026-02-14T02:06:20.773 INFO:teuthology.orchestra.run.trial032.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-14T02:06:20.774 INFO:teuthology.orchestra.run.trial032.stdout:HOME_URL="https://centos.org/" 2026-02-14T02:06:20.774 INFO:teuthology.orchestra.run.trial032.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-14T02:06:20.774 INFO:teuthology.orchestra.run.trial032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-14T02:06:20.774 INFO:teuthology.orchestra.run.trial032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-14T02:06:20.774 INFO:teuthology.provision.fog.trial032:Deploy complete! 2026-02-14T02:06:20.775 DEBUG:teuthology.parallel:result is None 2026-02-14T02:06:20.818 INFO:teuthology.orchestra.run.trial158.stdout:NAME="CentOS Stream" 2026-02-14T02:06:20.819 INFO:teuthology.orchestra.run.trial158.stdout:VERSION="9" 2026-02-14T02:06:20.819 INFO:teuthology.orchestra.run.trial158.stdout:ID="centos" 2026-02-14T02:06:20.819 INFO:teuthology.orchestra.run.trial158.stdout:ID_LIKE="rhel fedora" 2026-02-14T02:06:20.819 INFO:teuthology.orchestra.run.trial158.stdout:VERSION_ID="9" 2026-02-14T02:06:20.819 INFO:teuthology.orchestra.run.trial158.stdout:PLATFORM_ID="platform:el9" 2026-02-14T02:06:20.819 INFO:teuthology.orchestra.run.trial158.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-14T02:06:20.819 INFO:teuthology.orchestra.run.trial158.stdout:ANSI_COLOR="0;31" 2026-02-14T02:06:20.819 INFO:teuthology.orchestra.run.trial158.stdout:LOGO="fedora-logo-icon" 2026-02-14T02:06:20.819 INFO:teuthology.orchestra.run.trial158.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-14T02:06:20.819 INFO:teuthology.orchestra.run.trial158.stdout:HOME_URL="https://centos.org/" 2026-02-14T02:06:20.820 INFO:teuthology.orchestra.run.trial158.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-14T02:06:20.820 INFO:teuthology.orchestra.run.trial158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-14T02:06:20.820 INFO:teuthology.orchestra.run.trial158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-14T02:06:20.820 INFO:teuthology.provision.fog.trial158:Deploy complete! 2026-02-14T02:06:20.821 DEBUG:teuthology.parallel:result is None 2026-02-14T02:06:21.347 INFO:teuthology.lock.ops:Checking trial032.front.sepia.ceph.com 2026-02-14T02:06:21.348 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-14T02:06:21.454 INFO:teuthology.lock.ops:Checking trial156.front.sepia.ceph.com 2026-02-14T02:06:21.454 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-14T02:06:21.518 INFO:teuthology.lock.ops:Checking trial158.front.sepia.ceph.com 2026-02-14T02:06:21.518 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-14T02:06:21.576 INFO:teuthology.lock.ops:Updating [trial032.front.sepia.ceph.com]: set os type and version on server 2026-02-14T02:06:21.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial032.front.sepia.ceph.com' 2026-02-14T02:06:21.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-14T02:06:21.636 DEBUG:teuthology.orchestra.run.trial032:> true 2026-02-14T02:06:21.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial032.front.sepia.ceph.com' 2026-02-14T02:06:21.710 DEBUG:teuthology.orchestra.run.trial032:> uname -m 2026-02-14T02:06:21.766 INFO:teuthology.orchestra.run.trial032.stdout:x86_64 2026-02-14T02:06:21.766 DEBUG:teuthology.orchestra.run.trial032:> cat /etc/os-release 2026-02-14T02:06:21.822 INFO:teuthology.orchestra.run.trial032.stdout:NAME="CentOS Stream" 2026-02-14T02:06:21.822 INFO:teuthology.orchestra.run.trial032.stdout:VERSION="9" 2026-02-14T02:06:21.822 INFO:teuthology.orchestra.run.trial032.stdout:ID="centos" 2026-02-14T02:06:21.822 INFO:teuthology.orchestra.run.trial032.stdout:ID_LIKE="rhel fedora" 2026-02-14T02:06:21.822 INFO:teuthology.orchestra.run.trial032.stdout:VERSION_ID="9" 2026-02-14T02:06:21.822 INFO:teuthology.orchestra.run.trial032.stdout:PLATFORM_ID="platform:el9" 2026-02-14T02:06:21.822 INFO:teuthology.orchestra.run.trial032.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-14T02:06:21.822 INFO:teuthology.orchestra.run.trial032.stdout:ANSI_COLOR="0;31" 2026-02-14T02:06:21.822 INFO:teuthology.orchestra.run.trial032.stdout:LOGO="fedora-logo-icon" 2026-02-14T02:06:21.823 INFO:teuthology.orchestra.run.trial032.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-14T02:06:21.823 INFO:teuthology.orchestra.run.trial032.stdout:HOME_URL="https://centos.org/" 2026-02-14T02:06:21.823 INFO:teuthology.orchestra.run.trial032.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-14T02:06:21.823 INFO:teuthology.orchestra.run.trial032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-14T02:06:21.823 INFO:teuthology.orchestra.run.trial032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-14T02:06:21.823 INFO:teuthology.lock.ops:Updating trial032.front.sepia.ceph.com on lock server 2026-02-14T02:06:21.974 INFO:teuthology.lock.ops:Updating [trial156.front.sepia.ceph.com]: set os type and version on server 2026-02-14T02:06:21.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial156.front.sepia.ceph.com' 2026-02-14T02:06:21.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-14T02:06:22.045 DEBUG:teuthology.orchestra.run.trial156:> true 2026-02-14T02:06:22.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial156.front.sepia.ceph.com' 2026-02-14T02:06:22.120 DEBUG:teuthology.orchestra.run.trial156:> uname -m 2026-02-14T02:06:22.176 INFO:teuthology.orchestra.run.trial156.stdout:x86_64 2026-02-14T02:06:22.177 DEBUG:teuthology.orchestra.run.trial156:> cat /etc/os-release 2026-02-14T02:06:22.232 INFO:teuthology.orchestra.run.trial156.stdout:NAME="CentOS Stream" 2026-02-14T02:06:22.232 INFO:teuthology.orchestra.run.trial156.stdout:VERSION="9" 2026-02-14T02:06:22.232 INFO:teuthology.orchestra.run.trial156.stdout:ID="centos" 2026-02-14T02:06:22.232 INFO:teuthology.orchestra.run.trial156.stdout:ID_LIKE="rhel fedora" 2026-02-14T02:06:22.232 INFO:teuthology.orchestra.run.trial156.stdout:VERSION_ID="9" 2026-02-14T02:06:22.233 INFO:teuthology.orchestra.run.trial156.stdout:PLATFORM_ID="platform:el9" 2026-02-14T02:06:22.233 INFO:teuthology.orchestra.run.trial156.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-14T02:06:22.233 INFO:teuthology.orchestra.run.trial156.stdout:ANSI_COLOR="0;31" 2026-02-14T02:06:22.233 INFO:teuthology.orchestra.run.trial156.stdout:LOGO="fedora-logo-icon" 2026-02-14T02:06:22.233 INFO:teuthology.orchestra.run.trial156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-14T02:06:22.233 INFO:teuthology.orchestra.run.trial156.stdout:HOME_URL="https://centos.org/" 2026-02-14T02:06:22.233 INFO:teuthology.orchestra.run.trial156.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-14T02:06:22.233 INFO:teuthology.orchestra.run.trial156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-14T02:06:22.233 INFO:teuthology.orchestra.run.trial156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-14T02:06:22.234 INFO:teuthology.lock.ops:Updating trial156.front.sepia.ceph.com on lock server 2026-02-14T02:06:22.343 INFO:teuthology.lock.ops:Updating [trial158.front.sepia.ceph.com]: set os type and version on server 2026-02-14T02:06:22.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-14T02:06:22.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-14T02:06:22.415 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-14T02:06:22.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-14T02:06:22.494 DEBUG:teuthology.orchestra.run.trial158:> uname -m 2026-02-14T02:06:22.550 INFO:teuthology.orchestra.run.trial158.stdout:x86_64 2026-02-14T02:06:22.550 DEBUG:teuthology.orchestra.run.trial158:> cat /etc/os-release 2026-02-14T02:06:22.608 INFO:teuthology.orchestra.run.trial158.stdout:NAME="CentOS Stream" 2026-02-14T02:06:22.609 INFO:teuthology.orchestra.run.trial158.stdout:VERSION="9" 2026-02-14T02:06:22.609 INFO:teuthology.orchestra.run.trial158.stdout:ID="centos" 2026-02-14T02:06:22.609 INFO:teuthology.orchestra.run.trial158.stdout:ID_LIKE="rhel fedora" 2026-02-14T02:06:22.609 INFO:teuthology.orchestra.run.trial158.stdout:VERSION_ID="9" 2026-02-14T02:06:22.609 INFO:teuthology.orchestra.run.trial158.stdout:PLATFORM_ID="platform:el9" 2026-02-14T02:06:22.609 INFO:teuthology.orchestra.run.trial158.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-14T02:06:22.609 INFO:teuthology.orchestra.run.trial158.stdout:ANSI_COLOR="0;31" 2026-02-14T02:06:22.609 INFO:teuthology.orchestra.run.trial158.stdout:LOGO="fedora-logo-icon" 2026-02-14T02:06:22.609 INFO:teuthology.orchestra.run.trial158.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-14T02:06:22.609 INFO:teuthology.orchestra.run.trial158.stdout:HOME_URL="https://centos.org/" 2026-02-14T02:06:22.609 INFO:teuthology.orchestra.run.trial158.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-14T02:06:22.609 INFO:teuthology.orchestra.run.trial158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-14T02:06:22.610 INFO:teuthology.orchestra.run.trial158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-14T02:06:22.610 INFO:teuthology.lock.ops:Updating trial158.front.sepia.ceph.com on lock server 2026-02-14T02:06:22.715 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-14T02:06:22.815 INFO:teuthology.dispatcher.supervisor:Running job 50616 2026-02-14T02:06:22.815 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/bin/teuthology -v --owner scheduled_jcollin@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50616 --name jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/kernel_untar_build}} -- /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50616/orig.config.yaml 2026-02-14T02:06:22.816 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50616 2026-02-14T02:06:22.816 INFO:teuthology.dispatcher.supervisor:Job PID: 1744429 2026-02-14T02:06:22.816 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-14T02:08:22.916 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-14T02:10:23.108 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-14T02:12:23.333 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-14T02:14:23.450 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-14T02:16:25.126 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-14T02:18:25.339 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-14T02:20:25.549 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-14T02:22:25.747 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-14T02:24:25.935 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-14T02:26:26.145 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-14T02:28:26.355 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-14T02:30:26.525 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-14T02:32:26.680 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-14T02:34:26.899 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-14T02:34:26.995 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2026-02-14T02:34:27.169 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-14T02:34:27.896 INFO:teuthology.orchestra.console.trial032:Power off 2026-02-14T02:34:27.896 DEBUG:teuthology.orchestra.console.trial032:pexpect command: ipmitool -H trial032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-14T02:34:27.908 INFO:teuthology.orchestra.console.trial156:Power off 2026-02-14T02:34:27.908 DEBUG:teuthology.orchestra.console.trial156:pexpect command: ipmitool -H trial156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-14T02:34:27.917 INFO:teuthology.orchestra.console.trial158:Power off 2026-02-14T02:34:27.917 DEBUG:teuthology.orchestra.console.trial158:pexpect command: ipmitool -H trial158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-14T02:34:27.935 DEBUG:teuthology.orchestra.console.trial032:power off output: Chassis Power Control: Down/Off 2026-02-14T02:34:27.947 DEBUG:teuthology.orchestra.console.trial156:power off output: Chassis Power Control: Down/Off 2026-02-14T02:34:27.956 DEBUG:teuthology.orchestra.console.trial158:power off output: Chassis Power Control: Down/Off 2026-02-14T02:34:31.941 DEBUG:teuthology.orchestra.console.trial032:pexpect command: ipmitool -H trial032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-14T02:34:31.947 DEBUG:teuthology.orchestra.console.trial156:pexpect command: ipmitool -H trial156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-14T02:34:31.956 DEBUG:teuthology.orchestra.console.trial158:pexpect command: ipmitool -H trial158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-14T02:34:32.050 DEBUG:teuthology.orchestra.console.trial032:check power output: Chassis Power is on 2026-02-14T02:34:32.057 DEBUG:teuthology.orchestra.console.trial156:check power output: Chassis Power is on 2026-02-14T02:34:32.066 DEBUG:teuthology.orchestra.console.trial158:check power output: Chassis Power is on 2026-02-14T02:34:36.055 DEBUG:teuthology.orchestra.console.trial032:pexpect command: ipmitool -H trial032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-14T02:34:36.063 DEBUG:teuthology.orchestra.console.trial156:pexpect command: ipmitool -H trial156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-14T02:34:36.072 DEBUG:teuthology.orchestra.console.trial158:pexpect command: ipmitool -H trial158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-14T02:34:36.165 DEBUG:teuthology.orchestra.console.trial032:check power output: Chassis Power is off 2026-02-14T02:34:36.166 INFO:teuthology.orchestra.console.trial032:Power off completed 2026-02-14T02:34:36.174 DEBUG:teuthology.orchestra.console.trial156:check power output: Chassis Power is off 2026-02-14T02:34:36.174 INFO:teuthology.orchestra.console.trial156:Power off completed 2026-02-14T02:34:36.181 DEBUG:teuthology.orchestra.console.trial158:check power output: Chassis Power is off 2026-02-14T02:34:36.181 INFO:teuthology.orchestra.console.trial158:Power off completed 2026-02-14T02:34:36.459 INFO:teuthology.lock.ops:unlocked: trial032.front.sepia.ceph.com 2026-02-14T02:34:36.469 INFO:teuthology.lock.ops:unlocked: trial156.front.sepia.ceph.com 2026-02-14T02:34:36.473 INFO:teuthology.lock.ops:unlocked: trial158.front.sepia.ceph.com