2026-02-23T04:35:24.946 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-23T04:35:24.946 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:35:25.019 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:35:25.278 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x72ef57d8d9e0>, signals=[15]) 2026-02-23T04:35:25.278 INFO:teuthology.lock.ops:Start node 'trial043.front.sepia.ceph.com' reimaging 2026-02-23T04:35:25.279 INFO:teuthology.lock.ops:Updating [trial043.front.sepia.ceph.com]: reset os type and version on server 2026-02-23T04:35:25.279 INFO:teuthology.lock.ops:Updating trial043.front.sepia.ceph.com on lock server 2026-02-23T04:35:25.337 INFO:teuthology.lock.ops:Start node 'trial114.front.sepia.ceph.com' reimaging 2026-02-23T04:35:25.338 INFO:teuthology.lock.ops:Updating [trial114.front.sepia.ceph.com]: reset os type and version on server 2026-02-23T04:35:25.338 INFO:teuthology.lock.ops:Updating trial114.front.sepia.ceph.com on lock server 2026-02-23T04:35:25.397 INFO:teuthology.lock.ops:Start node 'trial117.front.sepia.ceph.com' reimaging 2026-02-23T04:35:25.397 INFO:teuthology.lock.ops:Updating [trial117.front.sepia.ceph.com]: reset os type and version on server 2026-02-23T04:35:25.397 INFO:teuthology.lock.ops:Updating trial117.front.sepia.ceph.com on lock server 2026-02-23T04:35:25.660 DEBUG:teuthology.provision.fog.trial043:Requesting image trial_centos_9.stream (ID 3) 2026-02-23T04:35:25.661 DEBUG:teuthology.provision.fog.trial114:Requesting image trial_centos_9.stream (ID 3) 2026-02-23T04:35:25.685 INFO:teuthology.provision.fog.trial114:Scheduling deploy of centos 9.stream 2026-02-23T04:35:25.712 INFO:teuthology.provision.fog.trial043:Scheduling deploy of centos 9.stream 2026-02-23T04:35:25.717 DEBUG:teuthology.provision.fog.trial117:Requesting image trial_centos_9.stream (ID 3) 2026-02-23T04:35:25.764 INFO:teuthology.provision.fog.trial117:Scheduling deploy of centos 9.stream 2026-02-23T04:35:27.085 INFO:teuthology.orchestra.console.trial043:Power off 2026-02-23T04:35:27.085 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T04:35:27.098 INFO:teuthology.orchestra.console.trial117:Power off 2026-02-23T04:35:27.098 DEBUG:teuthology.orchestra.console.trial117:pexpect command: ipmitool -H trial117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T04:35:27.105 INFO:teuthology.orchestra.console.trial114:Power off 2026-02-23T04:35:27.105 DEBUG:teuthology.orchestra.console.trial114:pexpect command: ipmitool -H trial114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T04:35:27.124 DEBUG:teuthology.orchestra.console.trial043:power off output: Chassis Power Control: Down/Off 2026-02-23T04:35:27.137 DEBUG:teuthology.orchestra.console.trial117:power off output: Chassis Power Control: Down/Off 2026-02-23T04:35:27.143 DEBUG:teuthology.orchestra.console.trial114:power off output: Chassis Power Control: Down/Off 2026-02-23T04:35:31.127 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T04:35:31.138 DEBUG:teuthology.orchestra.console.trial117:pexpect command: ipmitool -H trial117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T04:35:31.144 DEBUG:teuthology.orchestra.console.trial114:pexpect command: ipmitool -H trial114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T04:35:31.238 DEBUG:teuthology.orchestra.console.trial043:check power output: Chassis Power is off 2026-02-23T04:35:31.238 INFO:teuthology.orchestra.console.trial043:Power off completed 2026-02-23T04:35:31.246 DEBUG:teuthology.orchestra.console.trial117:check power output: Chassis Power is off 2026-02-23T04:35:31.246 INFO:teuthology.orchestra.console.trial117:Power off completed 2026-02-23T04:35:31.252 DEBUG:teuthology.orchestra.console.trial114:check power output: Chassis Power is off 2026-02-23T04:35:31.252 INFO:teuthology.orchestra.console.trial114:Power off completed 2026-02-23T04:35:31.339 INFO:teuthology.orchestra.console.trial043:Power on 2026-02-23T04:35:31.340 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-23T04:35:31.347 INFO:teuthology.orchestra.console.trial117:Power on 2026-02-23T04:35:31.348 DEBUG:teuthology.orchestra.console.trial117:pexpect command: ipmitool -H trial117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-23T04:35:31.354 INFO:teuthology.orchestra.console.trial114:Power on 2026-02-23T04:35:31.354 DEBUG:teuthology.orchestra.console.trial114:pexpect command: ipmitool -H trial114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-23T04:35:31.379 DEBUG:teuthology.orchestra.console.trial043:power on output: Chassis Power Control: Up/On 2026-02-23T04:35:31.386 DEBUG:teuthology.orchestra.console.trial117:power on output: Chassis Power Control: Up/On 2026-02-23T04:35:31.393 DEBUG:teuthology.orchestra.console.trial114:power on output: Chassis Power Control: Up/On 2026-02-23T04:35:35.383 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T04:35:35.393 DEBUG:teuthology.orchestra.console.trial117:pexpect command: ipmitool -H trial117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T04:35:35.401 DEBUG:teuthology.orchestra.console.trial114:pexpect command: ipmitool -H trial114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T04:35:35.496 DEBUG:teuthology.orchestra.console.trial043:check power output: Chassis Power is on 2026-02-23T04:35:35.496 INFO:teuthology.orchestra.console.trial043:Power on completed 2026-02-23T04:35:35.502 DEBUG:teuthology.orchestra.console.trial117:check power output: Chassis Power is off 2026-02-23T04:35:35.512 DEBUG:teuthology.orchestra.console.trial114:check power output: Chassis Power is on 2026-02-23T04:35:35.512 INFO:teuthology.orchestra.console.trial114:Power on completed 2026-02-23T04:35:35.598 INFO:teuthology.provision.fog.trial043:Waiting for deploy to finish 2026-02-23T04:35:35.613 INFO:teuthology.provision.fog.trial114:Waiting for deploy to finish 2026-02-23T04:35:39.507 DEBUG:teuthology.orchestra.console.trial117:pexpect command: ipmitool -H trial117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T04:35:39.618 DEBUG:teuthology.orchestra.console.trial117:check power output: Chassis Power is on 2026-02-23T04:35:39.618 INFO:teuthology.orchestra.console.trial117:Power on completed 2026-02-23T04:35:39.719 INFO:teuthology.provision.fog.trial117:Waiting for deploy to finish 2026-02-23T04:37:23.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T04:37:23.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T04:37:23.374 ERROR:teuthology.orchestra.connection:Error authenticating with trial114.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2026-02-23T04:37:23.388 ERROR:teuthology.orchestra.connection:Error authenticating with trial043.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2026-02-23T04:37:27.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T04:37:30.240 WARNING:teuthology.provision.fog.trial117:[Errno None] Unable to connect to port 22 on 10.20.193.117 2026-02-23T04:37:36.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T04:37:39.328 WARNING:teuthology.provision.fog.trial117:[Errno None] Unable to connect to port 22 on 10.20.193.117 2026-02-23T04:37:45.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T04:37:48.416 WARNING:teuthology.provision.fog.trial117:[Errno None] Unable to connect to port 22 on 10.20.193.117 2026-02-23T04:37:54.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T04:37:57.504 WARNING:teuthology.provision.fog.trial117:[Errno None] Unable to connect to port 22 on 10.20.193.117 2026-02-23T04:38:03.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T04:38:06.592 WARNING:teuthology.provision.fog.trial117:[Errno None] Unable to connect to port 22 on 10.20.193.117 2026-02-23T04:38:12.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T04:38:27.378 WARNING:teuthology.provision.fog.trial114:timed out 2026-02-23T04:38:27.390 WARNING:teuthology.provision.fog.trial043:timed out 2026-02-23T04:38:33.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T04:38:33.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T04:38:36.733 ERROR:teuthology.orchestra.connection:Error authenticating with trial114.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-23T04:38:36.886 ERROR:teuthology.orchestra.connection:Error authenticating with trial043.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-23T04:38:40.835 ERROR:teuthology.orchestra.connection:Error authenticating with trial114.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-23T04:38:40.980 ERROR:teuthology.orchestra.connection:Error authenticating with trial043.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-23T04:38:47.947 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-23T04:38:47.947 DEBUG:teuthology.orchestra.run.trial114:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-23T04:38:48.067 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-23T04:38:48.067 DEBUG:teuthology.orchestra.run.trial043:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-23T04:38:48.146 INFO:teuthology.provision.fog.trial114:Node is ready 2026-02-23T04:38:48.146 DEBUG:teuthology.orchestra.run.trial114:> hostname 2026-02-23T04:38:48.202 INFO:teuthology.orchestra.run.trial114.stdout:trial114.front.sepia.ceph.com 2026-02-23T04:38:48.203 DEBUG:teuthology.orchestra.run.trial114:> grep trial114.front.sepia.ceph.com /etc/hosts 2026-02-23T04:38:48.232 INFO:teuthology.provision.fog.trial043:Node is ready 2026-02-23T04:38:48.232 DEBUG:teuthology.orchestra.run.trial043:> hostname 2026-02-23T04:38:48.258 INFO:teuthology.orchestra.run.trial114.stdout:10.20.193.114 trial114.front.sepia.ceph.com trial114 2026-02-23T04:38:48.259 DEBUG:teuthology.orchestra.run.trial114:> sudo hostname trial114 2026-02-23T04:38:48.287 INFO:teuthology.orchestra.run.trial043.stdout:trial043.front.sepia.ceph.com 2026-02-23T04:38:48.288 DEBUG:teuthology.orchestra.run.trial043:> grep trial043.front.sepia.ceph.com /etc/hosts 2026-02-23T04:38:48.327 DEBUG:teuthology.orchestra.run.trial114:> sudo sed -i -e 's/trial114.front.sepia.ceph.com/trial114/g' /etc/hosts 2026-02-23T04:38:48.344 INFO:teuthology.orchestra.run.trial043.stdout:10.20.193.43 trial043.front.sepia.ceph.com trial043 2026-02-23T04:38:48.344 DEBUG:teuthology.orchestra.run.trial043:> sudo hostname trial043 2026-02-23T04:38:48.391 DEBUG:teuthology.orchestra.run.trial114:> sudo sed -i -e 's/10.20.193.114/10.20.193.114/g' /etc/hosts 2026-02-23T04:38:48.415 DEBUG:teuthology.orchestra.run.trial043:> sudo sed -i -e 's/trial043.front.sepia.ceph.com/trial043/g' /etc/hosts 2026-02-23T04:38:48.456 DEBUG:teuthology.orchestra.run.trial114:> sudo sed -i -e 's/trial114.front.sepia.ceph.com/trial114/g' /etc/hostname 2026-02-23T04:38:48.562 DEBUG:teuthology.orchestra.run.trial043:> sudo sed -i -e 's/10.20.193.43/10.20.193.43/g' /etc/hosts 2026-02-23T04:38:48.585 DEBUG:teuthology.orchestra.run.trial114:> sudo hostname trial114 2026-02-23T04:38:48.586 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-23T04:38:48.586 DEBUG:teuthology.orchestra.run.trial117:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-23T04:38:48.626 DEBUG:teuthology.orchestra.run.trial043:> sudo sed -i -e 's/trial043.front.sepia.ceph.com/trial043/g' /etc/hostname 2026-02-23T04:38:48.648 DEBUG:teuthology.orchestra.run.trial114:> cat /etc/os-release 2026-02-23T04:38:48.690 DEBUG:teuthology.orchestra.run.trial043:> sudo hostname trial043 2026-02-23T04:38:48.706 INFO:teuthology.orchestra.run.trial114.stdout:NAME="CentOS Stream" 2026-02-23T04:38:48.706 INFO:teuthology.orchestra.run.trial114.stdout:VERSION="9" 2026-02-23T04:38:48.706 INFO:teuthology.orchestra.run.trial114.stdout:ID="centos" 2026-02-23T04:38:48.706 INFO:teuthology.orchestra.run.trial114.stdout:ID_LIKE="rhel fedora" 2026-02-23T04:38:48.706 INFO:teuthology.orchestra.run.trial114.stdout:VERSION_ID="9" 2026-02-23T04:38:48.706 INFO:teuthology.orchestra.run.trial114.stdout:PLATFORM_ID="platform:el9" 2026-02-23T04:38:48.707 INFO:teuthology.orchestra.run.trial114.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T04:38:48.707 INFO:teuthology.orchestra.run.trial114.stdout:ANSI_COLOR="0;31" 2026-02-23T04:38:48.707 INFO:teuthology.orchestra.run.trial114.stdout:LOGO="fedora-logo-icon" 2026-02-23T04:38:48.707 INFO:teuthology.orchestra.run.trial114.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T04:38:48.707 INFO:teuthology.orchestra.run.trial114.stdout:HOME_URL="https://centos.org/" 2026-02-23T04:38:48.707 INFO:teuthology.orchestra.run.trial114.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T04:38:48.707 INFO:teuthology.orchestra.run.trial114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T04:38:48.707 INFO:teuthology.orchestra.run.trial114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T04:38:48.708 INFO:teuthology.provision.fog.trial114:Deploy complete! 2026-02-23T04:38:48.709 DEBUG:teuthology.parallel:result is None 2026-02-23T04:38:48.754 DEBUG:teuthology.orchestra.run.trial043:> cat /etc/os-release 2026-02-23T04:38:48.810 INFO:teuthology.orchestra.run.trial043.stdout:NAME="CentOS Stream" 2026-02-23T04:38:48.811 INFO:teuthology.orchestra.run.trial043.stdout:VERSION="9" 2026-02-23T04:38:48.811 INFO:teuthology.orchestra.run.trial043.stdout:ID="centos" 2026-02-23T04:38:48.811 INFO:teuthology.orchestra.run.trial043.stdout:ID_LIKE="rhel fedora" 2026-02-23T04:38:48.811 INFO:teuthology.orchestra.run.trial043.stdout:VERSION_ID="9" 2026-02-23T04:38:48.811 INFO:teuthology.orchestra.run.trial043.stdout:PLATFORM_ID="platform:el9" 2026-02-23T04:38:48.812 INFO:teuthology.orchestra.run.trial043.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T04:38:48.812 INFO:teuthology.orchestra.run.trial043.stdout:ANSI_COLOR="0;31" 2026-02-23T04:38:48.812 INFO:teuthology.orchestra.run.trial043.stdout:LOGO="fedora-logo-icon" 2026-02-23T04:38:48.812 INFO:teuthology.orchestra.run.trial043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T04:38:48.812 INFO:teuthology.orchestra.run.trial043.stdout:HOME_URL="https://centos.org/" 2026-02-23T04:38:48.812 INFO:teuthology.orchestra.run.trial043.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T04:38:48.812 INFO:teuthology.orchestra.run.trial043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T04:38:48.812 INFO:teuthology.orchestra.run.trial043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T04:38:48.813 INFO:teuthology.provision.fog.trial043:Deploy complete! 2026-02-23T04:38:48.814 DEBUG:teuthology.parallel:result is None 2026-02-23T04:38:48.815 INFO:teuthology.provision.fog.trial117:Node is ready 2026-02-23T04:38:48.815 DEBUG:teuthology.orchestra.run.trial117:> hostname 2026-02-23T04:38:48.874 INFO:teuthology.orchestra.run.trial117.stdout:trial117.front.sepia.ceph.com 2026-02-23T04:38:48.875 DEBUG:teuthology.orchestra.run.trial117:> grep trial117.front.sepia.ceph.com /etc/hosts 2026-02-23T04:38:48.934 INFO:teuthology.orchestra.run.trial117.stdout:10.20.193.117 trial117.front.sepia.ceph.com trial117 2026-02-23T04:38:48.934 DEBUG:teuthology.orchestra.run.trial117:> sudo hostname trial117 2026-02-23T04:38:49.009 DEBUG:teuthology.orchestra.run.trial117:> sudo sed -i -e 's/trial117.front.sepia.ceph.com/trial117/g' /etc/hosts 2026-02-23T04:38:49.078 DEBUG:teuthology.orchestra.run.trial117:> sudo sed -i -e 's/10.20.193.117/10.20.193.117/g' /etc/hosts 2026-02-23T04:38:49.147 DEBUG:teuthology.orchestra.run.trial117:> sudo sed -i -e 's/trial117.front.sepia.ceph.com/trial117/g' /etc/hostname 2026-02-23T04:38:49.217 DEBUG:teuthology.orchestra.run.trial117:> sudo hostname trial117 2026-02-23T04:38:49.285 DEBUG:teuthology.orchestra.run.trial117:> cat /etc/os-release 2026-02-23T04:38:49.345 INFO:teuthology.orchestra.run.trial117.stdout:NAME="CentOS Stream" 2026-02-23T04:38:49.345 INFO:teuthology.orchestra.run.trial117.stdout:VERSION="9" 2026-02-23T04:38:49.345 INFO:teuthology.orchestra.run.trial117.stdout:ID="centos" 2026-02-23T04:38:49.345 INFO:teuthology.orchestra.run.trial117.stdout:ID_LIKE="rhel fedora" 2026-02-23T04:38:49.346 INFO:teuthology.orchestra.run.trial117.stdout:VERSION_ID="9" 2026-02-23T04:38:49.346 INFO:teuthology.orchestra.run.trial117.stdout:PLATFORM_ID="platform:el9" 2026-02-23T04:38:49.346 INFO:teuthology.orchestra.run.trial117.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T04:38:49.346 INFO:teuthology.orchestra.run.trial117.stdout:ANSI_COLOR="0;31" 2026-02-23T04:38:49.346 INFO:teuthology.orchestra.run.trial117.stdout:LOGO="fedora-logo-icon" 2026-02-23T04:38:49.346 INFO:teuthology.orchestra.run.trial117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T04:38:49.347 INFO:teuthology.orchestra.run.trial117.stdout:HOME_URL="https://centos.org/" 2026-02-23T04:38:49.347 INFO:teuthology.orchestra.run.trial117.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T04:38:49.347 INFO:teuthology.orchestra.run.trial117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T04:38:49.347 INFO:teuthology.orchestra.run.trial117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T04:38:49.348 INFO:teuthology.provision.fog.trial117:Deploy complete! 2026-02-23T04:38:49.349 DEBUG:teuthology.parallel:result is None 2026-02-23T04:38:49.871 INFO:teuthology.lock.ops:Checking trial043.front.sepia.ceph.com 2026-02-23T04:38:49.871 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-23T04:38:49.952 INFO:teuthology.lock.ops:Checking trial114.front.sepia.ceph.com 2026-02-23T04:38:49.952 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-23T04:38:50.012 INFO:teuthology.lock.ops:Checking trial117.front.sepia.ceph.com 2026-02-23T04:38:50.012 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-23T04:38:50.070 INFO:teuthology.lock.ops:Updating [trial043.front.sepia.ceph.com]: set os type and version on server 2026-02-23T04:38:50.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial043.front.sepia.ceph.com' 2026-02-23T04:38:50.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T04:38:50.132 DEBUG:teuthology.orchestra.run.trial043:> true 2026-02-23T04:38:50.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial043.front.sepia.ceph.com' 2026-02-23T04:38:50.212 DEBUG:teuthology.orchestra.run.trial043:> uname -m 2026-02-23T04:38:50.268 INFO:teuthology.orchestra.run.trial043.stdout:x86_64 2026-02-23T04:38:50.268 DEBUG:teuthology.orchestra.run.trial043:> cat /etc/os-release 2026-02-23T04:38:50.324 INFO:teuthology.orchestra.run.trial043.stdout:NAME="CentOS Stream" 2026-02-23T04:38:50.324 INFO:teuthology.orchestra.run.trial043.stdout:VERSION="9" 2026-02-23T04:38:50.324 INFO:teuthology.orchestra.run.trial043.stdout:ID="centos" 2026-02-23T04:38:50.324 INFO:teuthology.orchestra.run.trial043.stdout:ID_LIKE="rhel fedora" 2026-02-23T04:38:50.324 INFO:teuthology.orchestra.run.trial043.stdout:VERSION_ID="9" 2026-02-23T04:38:50.324 INFO:teuthology.orchestra.run.trial043.stdout:PLATFORM_ID="platform:el9" 2026-02-23T04:38:50.324 INFO:teuthology.orchestra.run.trial043.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T04:38:50.324 INFO:teuthology.orchestra.run.trial043.stdout:ANSI_COLOR="0;31" 2026-02-23T04:38:50.324 INFO:teuthology.orchestra.run.trial043.stdout:LOGO="fedora-logo-icon" 2026-02-23T04:38:50.324 INFO:teuthology.orchestra.run.trial043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T04:38:50.324 INFO:teuthology.orchestra.run.trial043.stdout:HOME_URL="https://centos.org/" 2026-02-23T04:38:50.324 INFO:teuthology.orchestra.run.trial043.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T04:38:50.324 INFO:teuthology.orchestra.run.trial043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T04:38:50.324 INFO:teuthology.orchestra.run.trial043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T04:38:50.324 INFO:teuthology.lock.ops:Updating trial043.front.sepia.ceph.com on lock server 2026-02-23T04:38:50.381 INFO:teuthology.lock.ops:Updating [trial114.front.sepia.ceph.com]: set os type and version on server 2026-02-23T04:38:50.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-23T04:38:50.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T04:38:50.442 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-23T04:38:50.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-23T04:38:50.516 DEBUG:teuthology.orchestra.run.trial114:> uname -m 2026-02-23T04:38:50.571 INFO:teuthology.orchestra.run.trial114.stdout:x86_64 2026-02-23T04:38:50.572 DEBUG:teuthology.orchestra.run.trial114:> cat /etc/os-release 2026-02-23T04:38:50.627 INFO:teuthology.orchestra.run.trial114.stdout:NAME="CentOS Stream" 2026-02-23T04:38:50.627 INFO:teuthology.orchestra.run.trial114.stdout:VERSION="9" 2026-02-23T04:38:50.627 INFO:teuthology.orchestra.run.trial114.stdout:ID="centos" 2026-02-23T04:38:50.627 INFO:teuthology.orchestra.run.trial114.stdout:ID_LIKE="rhel fedora" 2026-02-23T04:38:50.627 INFO:teuthology.orchestra.run.trial114.stdout:VERSION_ID="9" 2026-02-23T04:38:50.628 INFO:teuthology.orchestra.run.trial114.stdout:PLATFORM_ID="platform:el9" 2026-02-23T04:38:50.628 INFO:teuthology.orchestra.run.trial114.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T04:38:50.628 INFO:teuthology.orchestra.run.trial114.stdout:ANSI_COLOR="0;31" 2026-02-23T04:38:50.628 INFO:teuthology.orchestra.run.trial114.stdout:LOGO="fedora-logo-icon" 2026-02-23T04:38:50.628 INFO:teuthology.orchestra.run.trial114.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T04:38:50.628 INFO:teuthology.orchestra.run.trial114.stdout:HOME_URL="https://centos.org/" 2026-02-23T04:38:50.628 INFO:teuthology.orchestra.run.trial114.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T04:38:50.628 INFO:teuthology.orchestra.run.trial114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T04:38:50.628 INFO:teuthology.orchestra.run.trial114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T04:38:50.628 INFO:teuthology.lock.ops:Updating trial114.front.sepia.ceph.com on lock server 2026-02-23T04:38:50.695 INFO:teuthology.lock.ops:Updating [trial117.front.sepia.ceph.com]: set os type and version on server 2026-02-23T04:38:50.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial117.front.sepia.ceph.com' 2026-02-23T04:38:50.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T04:38:50.759 DEBUG:teuthology.orchestra.run.trial117:> true 2026-02-23T04:38:50.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial117.front.sepia.ceph.com' 2026-02-23T04:38:50.835 DEBUG:teuthology.orchestra.run.trial117:> uname -m 2026-02-23T04:38:50.890 INFO:teuthology.orchestra.run.trial117.stdout:x86_64 2026-02-23T04:38:50.890 DEBUG:teuthology.orchestra.run.trial117:> cat /etc/os-release 2026-02-23T04:38:50.946 INFO:teuthology.orchestra.run.trial117.stdout:NAME="CentOS Stream" 2026-02-23T04:38:50.946 INFO:teuthology.orchestra.run.trial117.stdout:VERSION="9" 2026-02-23T04:38:50.946 INFO:teuthology.orchestra.run.trial117.stdout:ID="centos" 2026-02-23T04:38:50.946 INFO:teuthology.orchestra.run.trial117.stdout:ID_LIKE="rhel fedora" 2026-02-23T04:38:50.946 INFO:teuthology.orchestra.run.trial117.stdout:VERSION_ID="9" 2026-02-23T04:38:50.947 INFO:teuthology.orchestra.run.trial117.stdout:PLATFORM_ID="platform:el9" 2026-02-23T04:38:50.947 INFO:teuthology.orchestra.run.trial117.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T04:38:50.947 INFO:teuthology.orchestra.run.trial117.stdout:ANSI_COLOR="0;31" 2026-02-23T04:38:50.947 INFO:teuthology.orchestra.run.trial117.stdout:LOGO="fedora-logo-icon" 2026-02-23T04:38:50.947 INFO:teuthology.orchestra.run.trial117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T04:38:50.947 INFO:teuthology.orchestra.run.trial117.stdout:HOME_URL="https://centos.org/" 2026-02-23T04:38:50.947 INFO:teuthology.orchestra.run.trial117.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T04:38:50.947 INFO:teuthology.orchestra.run.trial117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T04:38:50.947 INFO:teuthology.orchestra.run.trial117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T04:38:50.948 INFO:teuthology.lock.ops:Updating trial117.front.sepia.ceph.com on lock server 2026-02-23T04:38:51.050 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:38:51.148 INFO:teuthology.dispatcher.supervisor:Running job 64826 2026-02-23T04:38:51.148 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_vshankar@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64826 --name vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/dbench}} -- /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64826/orig.config.yaml 2026-02-23T04:38:51.148 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64826 2026-02-23T04:38:51.148 INFO:teuthology.dispatcher.supervisor:Job PID: 1638256 2026-02-23T04:38:51.149 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-23T04:40:51.149 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:42:51.250 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:44:51.333 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:46:51.600 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:48:52.278 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:50:52.405 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:52:52.500 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:54:52.623 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:56:52.746 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T04:58:52.870 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T05:00:52.991 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T05:02:53.115 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T05:04:53.209 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T05:06:53.329 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T05:08:53.452 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T05:10:53.543 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T05:12:53.626 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T05:14:53.702 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T05:16:53.831 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T05:16:55.860 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2026-02-23T05:16:56.052 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-23T05:16:56.782 INFO:teuthology.orchestra.console.trial117:Power off 2026-02-23T05:16:56.782 DEBUG:teuthology.orchestra.console.trial117:pexpect command: ipmitool -H trial117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T05:16:56.801 INFO:teuthology.orchestra.console.trial043:Power off 2026-02-23T05:16:56.801 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T05:16:56.811 INFO:teuthology.orchestra.console.trial114:Power off 2026-02-23T05:16:56.811 DEBUG:teuthology.orchestra.console.trial114:pexpect command: ipmitool -H trial114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T05:16:56.821 DEBUG:teuthology.orchestra.console.trial117:power off output: Chassis Power Control: Down/Off 2026-02-23T05:16:56.839 DEBUG:teuthology.orchestra.console.trial043:power off output: Chassis Power Control: Down/Off 2026-02-23T05:16:56.849 DEBUG:teuthology.orchestra.console.trial114:power off output: Chassis Power Control: Down/Off 2026-02-23T05:17:00.821 DEBUG:teuthology.orchestra.console.trial117:pexpect command: ipmitool -H trial117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T05:17:00.840 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T05:17:00.849 DEBUG:teuthology.orchestra.console.trial114:pexpect command: ipmitool -H trial114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T05:17:00.932 DEBUG:teuthology.orchestra.console.trial117:check power output: Chassis Power is on 2026-02-23T05:17:00.951 DEBUG:teuthology.orchestra.console.trial043:check power output: Chassis Power is on 2026-02-23T05:17:00.960 DEBUG:teuthology.orchestra.console.trial114:check power output: Chassis Power is on 2026-02-23T05:17:04.933 DEBUG:teuthology.orchestra.console.trial117:pexpect command: ipmitool -H trial117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T05:17:04.952 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T05:17:04.961 DEBUG:teuthology.orchestra.console.trial114:pexpect command: ipmitool -H trial114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T05:17:05.045 DEBUG:teuthology.orchestra.console.trial117:check power output: Chassis Power is off 2026-02-23T05:17:05.045 INFO:teuthology.orchestra.console.trial117:Power off completed 2026-02-23T05:17:05.063 DEBUG:teuthology.orchestra.console.trial043:check power output: Chassis Power is off 2026-02-23T05:17:05.063 INFO:teuthology.orchestra.console.trial043:Power off completed 2026-02-23T05:17:05.071 DEBUG:teuthology.orchestra.console.trial114:check power output: Chassis Power is off 2026-02-23T05:17:05.071 INFO:teuthology.orchestra.console.trial114:Power off completed 2026-02-23T05:17:05.334 INFO:teuthology.lock.ops:unlocked: trial117.front.sepia.ceph.com 2026-02-23T05:17:05.346 INFO:teuthology.lock.ops:unlocked: trial114.front.sepia.ceph.com 2026-02-23T05:17:05.438 INFO:teuthology.lock.ops:unlocked: trial043.front.sepia.ceph.com