2026-02-20T01:06:33.931 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-20T01:06:33.931 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:06:34.004 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:06:34.265 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ea7a906fec0>, signals=[15]) 2026-02-20T01:06:34.265 INFO:teuthology.lock.ops:Start node 'trial109.front.sepia.ceph.com' reimaging 2026-02-20T01:06:34.265 INFO:teuthology.lock.ops:Updating [trial109.front.sepia.ceph.com]: reset os type and version on server 2026-02-20T01:06:34.265 INFO:teuthology.lock.ops:Updating trial109.front.sepia.ceph.com on lock server 2026-02-20T01:06:34.326 INFO:teuthology.lock.ops:Start node 'trial111.front.sepia.ceph.com' reimaging 2026-02-20T01:06:34.326 INFO:teuthology.lock.ops:Updating [trial111.front.sepia.ceph.com]: reset os type and version on server 2026-02-20T01:06:34.326 INFO:teuthology.lock.ops:Updating trial111.front.sepia.ceph.com on lock server 2026-02-20T01:06:34.385 INFO:teuthology.lock.ops:Start node 'trial146.front.sepia.ceph.com' reimaging 2026-02-20T01:06:34.385 INFO:teuthology.lock.ops:Updating [trial146.front.sepia.ceph.com]: reset os type and version on server 2026-02-20T01:06:34.385 INFO:teuthology.lock.ops:Updating trial146.front.sepia.ceph.com on lock server 2026-02-20T01:06:34.620 DEBUG:teuthology.provision.fog.trial111:Requesting image trial_centos_9.stream (ID 3) 2026-02-20T01:06:34.620 DEBUG:teuthology.provision.fog.trial109:Requesting image trial_centos_9.stream (ID 3) 2026-02-20T01:06:34.663 INFO:teuthology.provision.fog.trial109:Scheduling deploy of centos 9.stream 2026-02-20T01:06:34.675 INFO:teuthology.provision.fog.trial111:Scheduling deploy of centos 9.stream 2026-02-20T01:06:34.677 DEBUG:teuthology.provision.fog.trial146:Requesting image trial_centos_9.stream (ID 3) 2026-02-20T01:06:34.727 INFO:teuthology.provision.fog.trial146:Scheduling deploy of centos 9.stream 2026-02-20T01:06:36.112 INFO:teuthology.orchestra.console.trial109:Power off 2026-02-20T01:06:36.112 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-20T01:06:36.124 INFO:teuthology.orchestra.console.trial146:Power off 2026-02-20T01:06:36.125 DEBUG:teuthology.orchestra.console.trial146:pexpect command: ipmitool -H trial146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-20T01:06:36.132 INFO:teuthology.orchestra.console.trial111:Power off 2026-02-20T01:06:36.133 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-20T01:06:36.151 DEBUG:teuthology.orchestra.console.trial109:power off output: Chassis Power Control: Down/Off 2026-02-20T01:06:36.170 DEBUG:teuthology.orchestra.console.trial146:power off output: Chassis Power Control: Down/Off 2026-02-20T01:06:36.171 DEBUG:teuthology.orchestra.console.trial111:power off output: Chassis Power Control: Down/Off 2026-02-20T01:06:40.154 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-20T01:06:40.170 DEBUG:teuthology.orchestra.console.trial146:pexpect command: ipmitool -H trial146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-20T01:06:40.176 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-20T01:06:40.264 DEBUG:teuthology.orchestra.console.trial109:check power output: Chassis Power is off 2026-02-20T01:06:40.265 INFO:teuthology.orchestra.console.trial109:Power off completed 2026-02-20T01:06:40.278 DEBUG:teuthology.orchestra.console.trial146:check power output: Chassis Power is off 2026-02-20T01:06:40.278 INFO:teuthology.orchestra.console.trial146:Power off completed 2026-02-20T01:06:40.283 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is off 2026-02-20T01:06:40.284 INFO:teuthology.orchestra.console.trial111:Power off completed 2026-02-20T01:06:40.366 INFO:teuthology.orchestra.console.trial109:Power on 2026-02-20T01:06:40.366 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-20T01:06:40.378 INFO:teuthology.orchestra.console.trial146:Power on 2026-02-20T01:06:40.379 DEBUG:teuthology.orchestra.console.trial146:pexpect command: ipmitool -H trial146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-20T01:06:40.387 INFO:teuthology.orchestra.console.trial111:Power on 2026-02-20T01:06:40.388 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-20T01:06:40.408 DEBUG:teuthology.orchestra.console.trial109:power on output: Chassis Power Control: Up/On 2026-02-20T01:06:40.419 DEBUG:teuthology.orchestra.console.trial146:power on output: Chassis Power Control: Up/On 2026-02-20T01:06:40.430 DEBUG:teuthology.orchestra.console.trial111:power on output: Chassis Power Control: Up/On 2026-02-20T01:06:44.412 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-20T01:06:44.421 DEBUG:teuthology.orchestra.console.trial146:pexpect command: ipmitool -H trial146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-20T01:06:44.431 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-20T01:06:44.523 DEBUG:teuthology.orchestra.console.trial109:check power output: Chassis Power is on 2026-02-20T01:06:44.524 INFO:teuthology.orchestra.console.trial109:Power on completed 2026-02-20T01:06:44.531 DEBUG:teuthology.orchestra.console.trial146:check power output: Chassis Power is on 2026-02-20T01:06:44.531 INFO:teuthology.orchestra.console.trial146:Power on completed 2026-02-20T01:06:44.539 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is on 2026-02-20T01:06:44.540 INFO:teuthology.orchestra.console.trial111:Power on completed 2026-02-20T01:06:44.625 INFO:teuthology.provision.fog.trial109:Waiting for deploy to finish 2026-02-20T01:06:44.632 INFO:teuthology.provision.fog.trial146:Waiting for deploy to finish 2026-02-20T01:06:44.640 INFO:teuthology.provision.fog.trial111:Waiting for deploy to finish 2026-02-20T01:08:32.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T01:08:32.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T01:08:32.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T01:08:32.663 ERROR:teuthology.orchestra.connection:Error authenticating with trial109.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2026-02-20T01:08:32.670 ERROR:teuthology.orchestra.connection:Error authenticating with trial111.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2026-02-20T01:08:32.680 ERROR:teuthology.orchestra.connection:Error authenticating with trial146.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2026-02-20T01:08:44.864 WARNING:teuthology.provision.fog.trial109:[Errno None] Unable to connect to port 22 on 10.20.193.109 2026-02-20T01:08:50.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T01:08:53.952 WARNING:teuthology.provision.fog.trial109:[Errno None] Unable to connect to port 22 on 10.20.193.109 2026-02-20T01:08:59.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T01:09:03.040 WARNING:teuthology.provision.fog.trial109:[Errno None] Unable to connect to port 22 on 10.20.193.109 2026-02-20T01:09:09.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T01:09:12.128 WARNING:teuthology.provision.fog.trial109:[Errno None] Unable to connect to port 22 on 10.20.193.109 2026-02-20T01:09:18.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T01:09:36.672 WARNING:teuthology.provision.fog.trial111:timed out 2026-02-20T01:09:36.683 WARNING:teuthology.provision.fog.trial146:timed out 2026-02-20T01:09:42.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T01:09:42.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T01:09:46.220 ERROR:teuthology.orchestra.connection:Error authenticating with trial111.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-20T01:09:49.978 ERROR:teuthology.orchestra.connection:Error authenticating with trial146.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-20T01:09:50.295 ERROR:teuthology.orchestra.connection:Error authenticating with trial111.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-20T01:09:54.233 ERROR:teuthology.orchestra.connection:Error authenticating with trial146.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-20T01:09:54.287 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-20T01:09:54.287 DEBUG:teuthology.orchestra.run.trial109:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-20T01:09:54.503 INFO:teuthology.provision.fog.trial109:Node is ready 2026-02-20T01:09:54.503 DEBUG:teuthology.orchestra.run.trial109:> hostname 2026-02-20T01:09:54.563 INFO:teuthology.orchestra.run.trial109.stdout:trial109.front.sepia.ceph.com 2026-02-20T01:09:54.564 DEBUG:teuthology.orchestra.run.trial109:> grep trial109.front.sepia.ceph.com /etc/hosts 2026-02-20T01:09:54.625 INFO:teuthology.orchestra.run.trial109.stdout:10.20.193.109 trial109.front.sepia.ceph.com trial109 2026-02-20T01:09:54.626 DEBUG:teuthology.orchestra.run.trial109:> sudo hostname trial109 2026-02-20T01:09:54.700 DEBUG:teuthology.orchestra.run.trial109:> sudo sed -i -e 's/trial109.front.sepia.ceph.com/trial109/g' /etc/hosts 2026-02-20T01:09:54.769 DEBUG:teuthology.orchestra.run.trial109:> sudo sed -i -e 's/10.20.193.109/10.20.193.109/g' /etc/hosts 2026-02-20T01:09:54.838 DEBUG:teuthology.orchestra.run.trial109:> sudo sed -i -e 's/trial109.front.sepia.ceph.com/trial109/g' /etc/hostname 2026-02-20T01:09:54.907 DEBUG:teuthology.orchestra.run.trial109:> sudo hostname trial109 2026-02-20T01:09:54.977 DEBUG:teuthology.orchestra.run.trial109:> cat /etc/os-release 2026-02-20T01:09:55.038 INFO:teuthology.orchestra.run.trial109.stdout:NAME="CentOS Stream" 2026-02-20T01:09:55.038 INFO:teuthology.orchestra.run.trial109.stdout:VERSION="9" 2026-02-20T01:09:55.038 INFO:teuthology.orchestra.run.trial109.stdout:ID="centos" 2026-02-20T01:09:55.038 INFO:teuthology.orchestra.run.trial109.stdout:ID_LIKE="rhel fedora" 2026-02-20T01:09:55.038 INFO:teuthology.orchestra.run.trial109.stdout:VERSION_ID="9" 2026-02-20T01:09:55.038 INFO:teuthology.orchestra.run.trial109.stdout:PLATFORM_ID="platform:el9" 2026-02-20T01:09:55.038 INFO:teuthology.orchestra.run.trial109.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T01:09:55.038 INFO:teuthology.orchestra.run.trial109.stdout:ANSI_COLOR="0;31" 2026-02-20T01:09:55.039 INFO:teuthology.orchestra.run.trial109.stdout:LOGO="fedora-logo-icon" 2026-02-20T01:09:55.039 INFO:teuthology.orchestra.run.trial109.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T01:09:55.039 INFO:teuthology.orchestra.run.trial109.stdout:HOME_URL="https://centos.org/" 2026-02-20T01:09:55.039 INFO:teuthology.orchestra.run.trial109.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T01:09:55.039 INFO:teuthology.orchestra.run.trial109.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T01:09:55.039 INFO:teuthology.orchestra.run.trial109.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T01:09:55.040 INFO:teuthology.provision.fog.trial109:Deploy complete! 2026-02-20T01:09:55.040 DEBUG:teuthology.parallel:result is None 2026-02-20T01:09:57.358 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-20T01:09:57.358 DEBUG:teuthology.orchestra.run.trial111:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-20T01:09:57.516 INFO:teuthology.provision.fog.trial111:Node is ready 2026-02-20T01:09:57.517 DEBUG:teuthology.orchestra.run.trial111:> hostname 2026-02-20T01:09:57.572 INFO:teuthology.orchestra.run.trial111.stdout:trial111.front.sepia.ceph.com 2026-02-20T01:09:57.573 DEBUG:teuthology.orchestra.run.trial111:> grep trial111.front.sepia.ceph.com /etc/hosts 2026-02-20T01:09:57.628 INFO:teuthology.orchestra.run.trial111.stdout:10.20.193.111 trial111.front.sepia.ceph.com trial111 2026-02-20T01:09:57.629 DEBUG:teuthology.orchestra.run.trial111:> sudo hostname trial111 2026-02-20T01:09:57.699 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i -e 's/trial111.front.sepia.ceph.com/trial111/g' /etc/hosts 2026-02-20T01:09:57.764 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i -e 's/10.20.193.111/10.20.193.111/g' /etc/hosts 2026-02-20T01:09:57.829 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i -e 's/trial111.front.sepia.ceph.com/trial111/g' /etc/hostname 2026-02-20T01:09:57.893 DEBUG:teuthology.orchestra.run.trial111:> sudo hostname trial111 2026-02-20T01:09:57.957 DEBUG:teuthology.orchestra.run.trial111:> cat /etc/os-release 2026-02-20T01:09:58.013 INFO:teuthology.orchestra.run.trial111.stdout:NAME="CentOS Stream" 2026-02-20T01:09:58.013 INFO:teuthology.orchestra.run.trial111.stdout:VERSION="9" 2026-02-20T01:09:58.014 INFO:teuthology.orchestra.run.trial111.stdout:ID="centos" 2026-02-20T01:09:58.014 INFO:teuthology.orchestra.run.trial111.stdout:ID_LIKE="rhel fedora" 2026-02-20T01:09:58.014 INFO:teuthology.orchestra.run.trial111.stdout:VERSION_ID="9" 2026-02-20T01:09:58.014 INFO:teuthology.orchestra.run.trial111.stdout:PLATFORM_ID="platform:el9" 2026-02-20T01:09:58.014 INFO:teuthology.orchestra.run.trial111.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T01:09:58.014 INFO:teuthology.orchestra.run.trial111.stdout:ANSI_COLOR="0;31" 2026-02-20T01:09:58.014 INFO:teuthology.orchestra.run.trial111.stdout:LOGO="fedora-logo-icon" 2026-02-20T01:09:58.015 INFO:teuthology.orchestra.run.trial111.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T01:09:58.015 INFO:teuthology.orchestra.run.trial111.stdout:HOME_URL="https://centos.org/" 2026-02-20T01:09:58.015 INFO:teuthology.orchestra.run.trial111.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T01:09:58.015 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T01:09:58.015 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T01:09:58.016 INFO:teuthology.provision.fog.trial111:Deploy complete! 2026-02-20T01:09:58.018 DEBUG:teuthology.parallel:result is None 2026-02-20T01:10:01.346 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-20T01:10:01.346 DEBUG:teuthology.orchestra.run.trial146:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-20T01:10:01.513 INFO:teuthology.provision.fog.trial146:Node is ready 2026-02-20T01:10:01.514 DEBUG:teuthology.orchestra.run.trial146:> hostname 2026-02-20T01:10:01.569 INFO:teuthology.orchestra.run.trial146.stdout:trial146.front.sepia.ceph.com 2026-02-20T01:10:01.569 DEBUG:teuthology.orchestra.run.trial146:> grep trial146.front.sepia.ceph.com /etc/hosts 2026-02-20T01:10:01.628 INFO:teuthology.orchestra.run.trial146.stdout:10.20.193.146 trial146.front.sepia.ceph.com trial146 2026-02-20T01:10:01.628 DEBUG:teuthology.orchestra.run.trial146:> sudo hostname trial146 2026-02-20T01:10:01.701 DEBUG:teuthology.orchestra.run.trial146:> sudo sed -i -e 's/trial146.front.sepia.ceph.com/trial146/g' /etc/hosts 2026-02-20T01:10:01.767 DEBUG:teuthology.orchestra.run.trial146:> sudo sed -i -e 's/10.20.193.146/10.20.193.146/g' /etc/hosts 2026-02-20T01:10:01.833 DEBUG:teuthology.orchestra.run.trial146:> sudo sed -i -e 's/trial146.front.sepia.ceph.com/trial146/g' /etc/hostname 2026-02-20T01:10:01.899 DEBUG:teuthology.orchestra.run.trial146:> sudo hostname trial146 2026-02-20T01:10:01.964 DEBUG:teuthology.orchestra.run.trial146:> cat /etc/os-release 2026-02-20T01:10:02.020 INFO:teuthology.orchestra.run.trial146.stdout:NAME="CentOS Stream" 2026-02-20T01:10:02.021 INFO:teuthology.orchestra.run.trial146.stdout:VERSION="9" 2026-02-20T01:10:02.021 INFO:teuthology.orchestra.run.trial146.stdout:ID="centos" 2026-02-20T01:10:02.021 INFO:teuthology.orchestra.run.trial146.stdout:ID_LIKE="rhel fedora" 2026-02-20T01:10:02.021 INFO:teuthology.orchestra.run.trial146.stdout:VERSION_ID="9" 2026-02-20T01:10:02.021 INFO:teuthology.orchestra.run.trial146.stdout:PLATFORM_ID="platform:el9" 2026-02-20T01:10:02.021 INFO:teuthology.orchestra.run.trial146.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T01:10:02.021 INFO:teuthology.orchestra.run.trial146.stdout:ANSI_COLOR="0;31" 2026-02-20T01:10:02.021 INFO:teuthology.orchestra.run.trial146.stdout:LOGO="fedora-logo-icon" 2026-02-20T01:10:02.021 INFO:teuthology.orchestra.run.trial146.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T01:10:02.022 INFO:teuthology.orchestra.run.trial146.stdout:HOME_URL="https://centos.org/" 2026-02-20T01:10:02.022 INFO:teuthology.orchestra.run.trial146.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T01:10:02.022 INFO:teuthology.orchestra.run.trial146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T01:10:02.022 INFO:teuthology.orchestra.run.trial146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T01:10:02.022 INFO:teuthology.provision.fog.trial146:Deploy complete! 2026-02-20T01:10:02.023 DEBUG:teuthology.parallel:result is None 2026-02-20T01:10:02.547 INFO:teuthology.lock.ops:Checking trial109.front.sepia.ceph.com 2026-02-20T01:10:02.547 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-20T01:10:02.655 INFO:teuthology.lock.ops:Checking trial111.front.sepia.ceph.com 2026-02-20T01:10:02.655 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-20T01:10:02.716 INFO:teuthology.lock.ops:Checking trial146.front.sepia.ceph.com 2026-02-20T01:10:02.716 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-20T01:10:02.773 INFO:teuthology.lock.ops:Updating [trial109.front.sepia.ceph.com]: set os type and version on server 2026-02-20T01:10:02.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-20T01:10:02.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T01:10:02.833 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-20T01:10:02.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-20T01:10:02.905 DEBUG:teuthology.orchestra.run.trial109:> uname -m 2026-02-20T01:10:02.961 INFO:teuthology.orchestra.run.trial109.stdout:x86_64 2026-02-20T01:10:02.961 DEBUG:teuthology.orchestra.run.trial109:> cat /etc/os-release 2026-02-20T01:10:03.017 INFO:teuthology.orchestra.run.trial109.stdout:NAME="CentOS Stream" 2026-02-20T01:10:03.018 INFO:teuthology.orchestra.run.trial109.stdout:VERSION="9" 2026-02-20T01:10:03.018 INFO:teuthology.orchestra.run.trial109.stdout:ID="centos" 2026-02-20T01:10:03.018 INFO:teuthology.orchestra.run.trial109.stdout:ID_LIKE="rhel fedora" 2026-02-20T01:10:03.018 INFO:teuthology.orchestra.run.trial109.stdout:VERSION_ID="9" 2026-02-20T01:10:03.018 INFO:teuthology.orchestra.run.trial109.stdout:PLATFORM_ID="platform:el9" 2026-02-20T01:10:03.018 INFO:teuthology.orchestra.run.trial109.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T01:10:03.018 INFO:teuthology.orchestra.run.trial109.stdout:ANSI_COLOR="0;31" 2026-02-20T01:10:03.018 INFO:teuthology.orchestra.run.trial109.stdout:LOGO="fedora-logo-icon" 2026-02-20T01:10:03.018 INFO:teuthology.orchestra.run.trial109.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T01:10:03.018 INFO:teuthology.orchestra.run.trial109.stdout:HOME_URL="https://centos.org/" 2026-02-20T01:10:03.018 INFO:teuthology.orchestra.run.trial109.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T01:10:03.018 INFO:teuthology.orchestra.run.trial109.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T01:10:03.018 INFO:teuthology.orchestra.run.trial109.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T01:10:03.019 INFO:teuthology.lock.ops:Updating trial109.front.sepia.ceph.com on lock server 2026-02-20T01:10:03.122 INFO:teuthology.lock.ops:Updating [trial111.front.sepia.ceph.com]: set os type and version on server 2026-02-20T01:10:03.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-20T01:10:03.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T01:10:03.198 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-20T01:10:03.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-20T01:10:03.266 DEBUG:teuthology.orchestra.run.trial111:> uname -m 2026-02-20T01:10:03.322 INFO:teuthology.orchestra.run.trial111.stdout:x86_64 2026-02-20T01:10:03.322 DEBUG:teuthology.orchestra.run.trial111:> cat /etc/os-release 2026-02-20T01:10:03.378 INFO:teuthology.orchestra.run.trial111.stdout:NAME="CentOS Stream" 2026-02-20T01:10:03.378 INFO:teuthology.orchestra.run.trial111.stdout:VERSION="9" 2026-02-20T01:10:03.378 INFO:teuthology.orchestra.run.trial111.stdout:ID="centos" 2026-02-20T01:10:03.378 INFO:teuthology.orchestra.run.trial111.stdout:ID_LIKE="rhel fedora" 2026-02-20T01:10:03.378 INFO:teuthology.orchestra.run.trial111.stdout:VERSION_ID="9" 2026-02-20T01:10:03.378 INFO:teuthology.orchestra.run.trial111.stdout:PLATFORM_ID="platform:el9" 2026-02-20T01:10:03.378 INFO:teuthology.orchestra.run.trial111.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T01:10:03.378 INFO:teuthology.orchestra.run.trial111.stdout:ANSI_COLOR="0;31" 2026-02-20T01:10:03.378 INFO:teuthology.orchestra.run.trial111.stdout:LOGO="fedora-logo-icon" 2026-02-20T01:10:03.378 INFO:teuthology.orchestra.run.trial111.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T01:10:03.378 INFO:teuthology.orchestra.run.trial111.stdout:HOME_URL="https://centos.org/" 2026-02-20T01:10:03.378 INFO:teuthology.orchestra.run.trial111.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T01:10:03.378 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T01:10:03.378 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T01:10:03.378 INFO:teuthology.lock.ops:Updating trial111.front.sepia.ceph.com on lock server 2026-02-20T01:10:03.449 INFO:teuthology.lock.ops:Updating [trial146.front.sepia.ceph.com]: set os type and version on server 2026-02-20T01:10:03.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial146.front.sepia.ceph.com' 2026-02-20T01:10:03.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T01:10:03.512 DEBUG:teuthology.orchestra.run.trial146:> true 2026-02-20T01:10:03.588 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial146.front.sepia.ceph.com' 2026-02-20T01:10:03.588 DEBUG:teuthology.orchestra.run.trial146:> uname -m 2026-02-20T01:10:03.643 INFO:teuthology.orchestra.run.trial146.stdout:x86_64 2026-02-20T01:10:03.644 DEBUG:teuthology.orchestra.run.trial146:> cat /etc/os-release 2026-02-20T01:10:03.699 INFO:teuthology.orchestra.run.trial146.stdout:NAME="CentOS Stream" 2026-02-20T01:10:03.699 INFO:teuthology.orchestra.run.trial146.stdout:VERSION="9" 2026-02-20T01:10:03.700 INFO:teuthology.orchestra.run.trial146.stdout:ID="centos" 2026-02-20T01:10:03.700 INFO:teuthology.orchestra.run.trial146.stdout:ID_LIKE="rhel fedora" 2026-02-20T01:10:03.700 INFO:teuthology.orchestra.run.trial146.stdout:VERSION_ID="9" 2026-02-20T01:10:03.700 INFO:teuthology.orchestra.run.trial146.stdout:PLATFORM_ID="platform:el9" 2026-02-20T01:10:03.700 INFO:teuthology.orchestra.run.trial146.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T01:10:03.700 INFO:teuthology.orchestra.run.trial146.stdout:ANSI_COLOR="0;31" 2026-02-20T01:10:03.700 INFO:teuthology.orchestra.run.trial146.stdout:LOGO="fedora-logo-icon" 2026-02-20T01:10:03.700 INFO:teuthology.orchestra.run.trial146.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T01:10:03.700 INFO:teuthology.orchestra.run.trial146.stdout:HOME_URL="https://centos.org/" 2026-02-20T01:10:03.700 INFO:teuthology.orchestra.run.trial146.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T01:10:03.700 INFO:teuthology.orchestra.run.trial146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T01:10:03.700 INFO:teuthology.orchestra.run.trial146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T01:10:03.700 INFO:teuthology.lock.ops:Updating trial146.front.sepia.ceph.com on lock server 2026-02-20T01:10:03.774 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:10:03.866 INFO:teuthology.dispatcher.supervisor:Running job 55227 2026-02-20T01:10:03.866 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_jcollin@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_23:11:18-fs-wip-jcollin-testing-20260217.130836-squid-distro-default-trial/55227 --name jcollin-2026-02-17_23:11:18-fs-wip-jcollin-testing-20260217.130836-squid-distro-default-trial --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/kernel_untar_build}} -- /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_23:11:18-fs-wip-jcollin-testing-20260217.130836-squid-distro-default-trial/55227/orig.config.yaml 2026-02-20T01:10:03.866 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_23:11:18-fs-wip-jcollin-testing-20260217.130836-squid-distro-default-trial/55227 2026-02-20T01:10:03.866 INFO:teuthology.dispatcher.supervisor:Job PID: 3292745 2026-02-20T01:10:03.866 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-20T01:12:03.867 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:12:38.528 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-20T01:14:03.986 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:16:04.113 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:18:04.233 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:20:04.835 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:22:04.952 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:24:05.078 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:26:05.197 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:28:05.298 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:30:05.388 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:32:05.508 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:34:05.626 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:36:05.745 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:38:05.846 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:40:05.966 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:42:06.085 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:44:06.204 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:46:06.307 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T01:46:06.418 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2026-02-20T01:46:06.591 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-20T01:46:07.317 INFO:teuthology.orchestra.console.trial111:Power off 2026-02-20T01:46:07.317 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-20T01:46:07.333 INFO:teuthology.orchestra.console.trial146:Power off 2026-02-20T01:46:07.333 DEBUG:teuthology.orchestra.console.trial146:pexpect command: ipmitool -H trial146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-20T01:46:07.342 INFO:teuthology.orchestra.console.trial109:Power off 2026-02-20T01:46:07.342 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-20T01:46:07.357 DEBUG:teuthology.orchestra.console.trial111:power off output: Chassis Power Control: Down/Off 2026-02-20T01:46:07.372 DEBUG:teuthology.orchestra.console.trial146:power off output: Chassis Power Control: Down/Off 2026-02-20T01:46:07.380 DEBUG:teuthology.orchestra.console.trial109:power off output: Chassis Power Control: Down/Off 2026-02-20T01:46:11.358 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-20T01:46:11.373 DEBUG:teuthology.orchestra.console.trial146:pexpect command: ipmitool -H trial146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-20T01:46:11.380 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-20T01:46:11.469 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is on 2026-02-20T01:46:11.480 DEBUG:teuthology.orchestra.console.trial146:check power output: Chassis Power is on 2026-02-20T01:46:11.487 DEBUG:teuthology.orchestra.console.trial109:check power output: Chassis Power is on 2026-02-20T01:46:15.471 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-20T01:46:15.481 DEBUG:teuthology.orchestra.console.trial146:pexpect command: ipmitool -H trial146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-20T01:46:15.489 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-20T01:46:15.581 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is off 2026-02-20T01:46:15.581 INFO:teuthology.orchestra.console.trial111:Power off completed 2026-02-20T01:46:15.590 DEBUG:teuthology.orchestra.console.trial146:check power output: Chassis Power is off 2026-02-20T01:46:15.590 INFO:teuthology.orchestra.console.trial146:Power off completed 2026-02-20T01:46:15.599 DEBUG:teuthology.orchestra.console.trial109:check power output: Chassis Power is off 2026-02-20T01:46:15.599 INFO:teuthology.orchestra.console.trial109:Power off completed 2026-02-20T01:46:15.823 INFO:teuthology.lock.ops:unlocked: trial111.front.sepia.ceph.com 2026-02-20T01:46:15.831 INFO:teuthology.lock.ops:unlocked: trial146.front.sepia.ceph.com 2026-02-20T01:46:15.835 INFO:teuthology.lock.ops:unlocked: trial109.front.sepia.ceph.com