2026-02-25T10:55:00.743 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-25T10:55:00.743 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:55:00.819 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:55:01.081 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x76352eac9260>, signals=[15]) 2026-02-25T10:55:01.081 INFO:teuthology.lock.ops:Start node 'trial047.front.sepia.ceph.com' reimaging 2026-02-25T10:55:01.081 INFO:teuthology.lock.ops:Updating [trial047.front.sepia.ceph.com]: reset os type and version on server 2026-02-25T10:55:01.081 INFO:teuthology.lock.ops:Updating trial047.front.sepia.ceph.com on lock server 2026-02-25T10:55:01.142 INFO:teuthology.lock.ops:Start node 'trial133.front.sepia.ceph.com' reimaging 2026-02-25T10:55:01.142 INFO:teuthology.lock.ops:Updating [trial133.front.sepia.ceph.com]: reset os type and version on server 2026-02-25T10:55:01.142 INFO:teuthology.lock.ops:Updating trial133.front.sepia.ceph.com on lock server 2026-02-25T10:55:01.202 INFO:teuthology.lock.ops:Start node 'trial150.front.sepia.ceph.com' reimaging 2026-02-25T10:55:01.202 INFO:teuthology.lock.ops:Updating [trial150.front.sepia.ceph.com]: reset os type and version on server 2026-02-25T10:55:01.202 INFO:teuthology.lock.ops:Updating trial150.front.sepia.ceph.com on lock server 2026-02-25T10:55:01.442 DEBUG:teuthology.provision.fog.trial133:Requesting image trial_centos_9.stream (ID 3) 2026-02-25T10:55:01.442 DEBUG:teuthology.provision.fog.trial047:Requesting image trial_centos_9.stream (ID 3) 2026-02-25T10:55:01.496 INFO:teuthology.provision.fog.trial047:Scheduling deploy of centos 9.stream 2026-02-25T10:55:01.498 DEBUG:teuthology.provision.fog.trial150:Requesting image trial_centos_9.stream (ID 3) 2026-02-25T10:55:01.499 INFO:teuthology.provision.fog.trial133:Scheduling deploy of centos 9.stream 2026-02-25T10:55:01.551 INFO:teuthology.provision.fog.trial150:Scheduling deploy of centos 9.stream 2026-02-25T10:55:02.878 INFO:teuthology.orchestra.console.trial150:Power off 2026-02-25T10:55:02.879 DEBUG:teuthology.orchestra.console.trial150:pexpect command: ipmitool -H trial150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-25T10:55:02.939 INFO:teuthology.orchestra.console.trial133:Power off 2026-02-25T10:55:02.939 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-25T10:55:02.945 DEBUG:teuthology.orchestra.console.trial150:power off output: Chassis Power Control: Down/Off 2026-02-25T10:55:02.959 INFO:teuthology.orchestra.console.trial047:Power off 2026-02-25T10:55:02.959 DEBUG:teuthology.orchestra.console.trial047:pexpect command: ipmitool -H trial047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-25T10:55:02.977 DEBUG:teuthology.orchestra.console.trial133:power off output: Chassis Power Control: Down/Off 2026-02-25T10:55:02.998 DEBUG:teuthology.orchestra.console.trial047:power off output: Chassis Power Control: Down/Off 2026-02-25T10:55:06.949 DEBUG:teuthology.orchestra.console.trial150:pexpect command: ipmitool -H trial150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T10:55:06.978 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T10:55:06.998 DEBUG:teuthology.orchestra.console.trial047:pexpect command: ipmitool -H trial047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T10:55:07.057 DEBUG:teuthology.orchestra.console.trial150:check power output: Chassis Power is off 2026-02-25T10:55:07.057 INFO:teuthology.orchestra.console.trial150:Power off completed 2026-02-25T10:55:07.086 DEBUG:teuthology.orchestra.console.trial133:check power output: Chassis Power is off 2026-02-25T10:55:07.086 INFO:teuthology.orchestra.console.trial133:Power off completed 2026-02-25T10:55:07.107 DEBUG:teuthology.orchestra.console.trial047:check power output: Chassis Power is off 2026-02-25T10:55:07.108 INFO:teuthology.orchestra.console.trial047:Power off completed 2026-02-25T10:55:07.158 INFO:teuthology.orchestra.console.trial150:Power on 2026-02-25T10:55:07.158 DEBUG:teuthology.orchestra.console.trial150:pexpect command: ipmitool -H trial150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-25T10:55:07.187 INFO:teuthology.orchestra.console.trial133:Power on 2026-02-25T10:55:07.187 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-25T10:55:07.198 DEBUG:teuthology.orchestra.console.trial150:power on output: Chassis Power Control: Up/On 2026-02-25T10:55:07.209 INFO:teuthology.orchestra.console.trial047:Power on 2026-02-25T10:55:07.209 DEBUG:teuthology.orchestra.console.trial047:pexpect command: ipmitool -H trial047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-25T10:55:07.227 DEBUG:teuthology.orchestra.console.trial133:power on output: Chassis Power Control: Up/On 2026-02-25T10:55:07.249 DEBUG:teuthology.orchestra.console.trial047:power on output: Chassis Power Control: Up/On 2026-02-25T10:55:11.203 DEBUG:teuthology.orchestra.console.trial150:pexpect command: ipmitool -H trial150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T10:55:11.228 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T10:55:11.250 DEBUG:teuthology.orchestra.console.trial047:pexpect command: ipmitool -H trial047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T10:55:11.313 DEBUG:teuthology.orchestra.console.trial150:check power output: Chassis Power is on 2026-02-25T10:55:11.313 INFO:teuthology.orchestra.console.trial150:Power on completed 2026-02-25T10:55:11.338 DEBUG:teuthology.orchestra.console.trial133:check power output: Chassis Power is on 2026-02-25T10:55:11.338 INFO:teuthology.orchestra.console.trial133:Power on completed 2026-02-25T10:55:11.358 DEBUG:teuthology.orchestra.console.trial047:check power output: Chassis Power is on 2026-02-25T10:55:11.358 INFO:teuthology.orchestra.console.trial047:Power on completed 2026-02-25T10:55:11.414 INFO:teuthology.provision.fog.trial150:Waiting for deploy to finish 2026-02-25T10:55:11.439 INFO:teuthology.provision.fog.trial133:Waiting for deploy to finish 2026-02-25T10:55:11.459 INFO:teuthology.provision.fog.trial047:Waiting for deploy to finish 2026-02-25T10:56:59.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:56:59.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:56:59.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:57:02.656 WARNING:teuthology.provision.fog.trial133:[Errno None] Unable to connect to port 22 on 10.20.193.133 2026-02-25T10:57:02.720 WARNING:teuthology.provision.fog.trial150:[Errno None] Unable to connect to port 22 on 10.20.193.150 2026-02-25T10:57:08.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:57:08.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:57:11.744 WARNING:teuthology.provision.fog.trial133:[Errno None] Unable to connect to port 22 on 10.20.193.133 2026-02-25T10:57:11.808 WARNING:teuthology.provision.fog.trial150:[Errno None] Unable to connect to port 22 on 10.20.193.150 2026-02-25T10:57:17.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:57:17.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:57:20.832 WARNING:teuthology.provision.fog.trial133:[Errno None] Unable to connect to port 22 on 10.20.193.133 2026-02-25T10:57:20.896 WARNING:teuthology.provision.fog.trial150:[Errno None] Unable to connect to port 22 on 10.20.193.150 2026-02-25T10:57:26.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:57:26.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:57:29.920 WARNING:teuthology.provision.fog.trial133:[Errno None] Unable to connect to port 22 on 10.20.193.133 2026-02-25T10:57:29.984 WARNING:teuthology.provision.fog.trial150:[Errno None] Unable to connect to port 22 on 10.20.193.150 2026-02-25T10:57:35.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:57:35.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:57:39.007 WARNING:teuthology.provision.fog.trial133:[Errno None] Unable to connect to port 22 on 10.20.193.133 2026-02-25T10:57:39.072 WARNING:teuthology.provision.fog.trial150:[Errno None] Unable to connect to port 22 on 10.20.193.150 2026-02-25T10:57:45.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:57:45.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:57:59.611 WARNING:teuthology.provision.fog.trial047:timed out 2026-02-25T10:58:05.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:58:12.941 ERROR:teuthology.orchestra.connection:Error authenticating with trial047.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-25T10:58:17.275 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-25T10:58:17.275 DEBUG:teuthology.orchestra.run.trial047:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-25T10:58:20.748 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-25T10:58:20.749 DEBUG:teuthology.orchestra.run.trial133:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-25T10:58:20.974 INFO:teuthology.provision.fog.trial133:Node is ready 2026-02-25T10:58:20.974 DEBUG:teuthology.orchestra.run.trial133:> hostname 2026-02-25T10:58:21.030 INFO:teuthology.orchestra.run.trial133.stdout:trial133.front.sepia.ceph.com 2026-02-25T10:58:21.030 DEBUG:teuthology.orchestra.run.trial133:> grep trial133.front.sepia.ceph.com /etc/hosts 2026-02-25T10:58:21.087 INFO:teuthology.orchestra.run.trial133.stdout:10.20.193.133 trial133.front.sepia.ceph.com trial133 2026-02-25T10:58:21.088 DEBUG:teuthology.orchestra.run.trial133:> sudo hostname trial133 2026-02-25T10:58:21.158 DEBUG:teuthology.orchestra.run.trial133:> sudo sed -i -e 's/trial133.front.sepia.ceph.com/trial133/g' /etc/hosts 2026-02-25T10:58:21.295 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-25T10:58:21.295 DEBUG:teuthology.orchestra.run.trial150:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-25T10:58:21.296 DEBUG:teuthology.orchestra.run.trial133:> sudo sed -i -e 's/10.20.193.133/10.20.193.133/g' /etc/hosts 2026-02-25T10:58:21.362 DEBUG:teuthology.orchestra.run.trial133:> sudo sed -i -e 's/trial133.front.sepia.ceph.com/trial133/g' /etc/hostname 2026-02-25T10:58:21.427 DEBUG:teuthology.orchestra.run.trial133:> sudo hostname trial133 2026-02-25T10:58:21.493 DEBUG:teuthology.orchestra.run.trial133:> cat /etc/os-release 2026-02-25T10:58:21.513 INFO:teuthology.provision.fog.trial150:Node is ready 2026-02-25T10:58:21.514 DEBUG:teuthology.orchestra.run.trial150:> hostname 2026-02-25T10:58:21.562 INFO:teuthology.orchestra.run.trial133.stdout:NAME="CentOS Stream" 2026-02-25T10:58:21.562 INFO:teuthology.orchestra.run.trial133.stdout:VERSION="9" 2026-02-25T10:58:21.563 INFO:teuthology.orchestra.run.trial133.stdout:ID="centos" 2026-02-25T10:58:21.563 INFO:teuthology.orchestra.run.trial133.stdout:ID_LIKE="rhel fedora" 2026-02-25T10:58:21.563 INFO:teuthology.orchestra.run.trial133.stdout:VERSION_ID="9" 2026-02-25T10:58:21.563 INFO:teuthology.orchestra.run.trial133.stdout:PLATFORM_ID="platform:el9" 2026-02-25T10:58:21.563 INFO:teuthology.orchestra.run.trial133.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-25T10:58:21.563 INFO:teuthology.orchestra.run.trial133.stdout:ANSI_COLOR="0;31" 2026-02-25T10:58:21.563 INFO:teuthology.orchestra.run.trial133.stdout:LOGO="fedora-logo-icon" 2026-02-25T10:58:21.563 INFO:teuthology.orchestra.run.trial133.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-25T10:58:21.563 INFO:teuthology.orchestra.run.trial133.stdout:HOME_URL="https://centos.org/" 2026-02-25T10:58:21.563 INFO:teuthology.orchestra.run.trial133.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-25T10:58:21.563 INFO:teuthology.orchestra.run.trial133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-25T10:58:21.563 INFO:teuthology.orchestra.run.trial133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-25T10:58:21.563 INFO:teuthology.provision.fog.trial133:Deploy complete! 2026-02-25T10:58:21.564 DEBUG:teuthology.parallel:result is None 2026-02-25T10:58:21.569 INFO:teuthology.orchestra.run.trial150.stdout:trial150.front.sepia.ceph.com 2026-02-25T10:58:21.569 DEBUG:teuthology.orchestra.run.trial150:> grep trial150.front.sepia.ceph.com /etc/hosts 2026-02-25T10:58:21.626 INFO:teuthology.orchestra.run.trial150.stdout:10.20.193.150 trial150.front.sepia.ceph.com trial150 2026-02-25T10:58:21.627 DEBUG:teuthology.orchestra.run.trial150:> sudo hostname trial150 2026-02-25T10:58:21.696 DEBUG:teuthology.orchestra.run.trial150:> sudo sed -i -e 's/trial150.front.sepia.ceph.com/trial150/g' /etc/hosts 2026-02-25T10:58:21.761 DEBUG:teuthology.orchestra.run.trial150:> sudo sed -i -e 's/10.20.193.150/10.20.193.150/g' /etc/hosts 2026-02-25T10:58:21.827 DEBUG:teuthology.orchestra.run.trial150:> sudo sed -i -e 's/trial150.front.sepia.ceph.com/trial150/g' /etc/hostname 2026-02-25T10:58:21.914 DEBUG:teuthology.orchestra.run.trial150:> sudo hostname trial150 2026-02-25T10:58:21.964 DEBUG:teuthology.orchestra.run.trial150:> cat /etc/os-release 2026-02-25T10:58:22.052 INFO:teuthology.orchestra.run.trial150.stdout:NAME="CentOS Stream" 2026-02-25T10:58:22.052 INFO:teuthology.orchestra.run.trial150.stdout:VERSION="9" 2026-02-25T10:58:22.052 INFO:teuthology.orchestra.run.trial150.stdout:ID="centos" 2026-02-25T10:58:22.052 INFO:teuthology.orchestra.run.trial150.stdout:ID_LIKE="rhel fedora" 2026-02-25T10:58:22.052 INFO:teuthology.orchestra.run.trial150.stdout:VERSION_ID="9" 2026-02-25T10:58:22.052 INFO:teuthology.orchestra.run.trial150.stdout:PLATFORM_ID="platform:el9" 2026-02-25T10:58:22.053 INFO:teuthology.orchestra.run.trial150.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-25T10:58:22.053 INFO:teuthology.orchestra.run.trial150.stdout:ANSI_COLOR="0;31" 2026-02-25T10:58:22.053 INFO:teuthology.orchestra.run.trial150.stdout:LOGO="fedora-logo-icon" 2026-02-25T10:58:22.053 INFO:teuthology.orchestra.run.trial150.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-25T10:58:22.053 INFO:teuthology.orchestra.run.trial150.stdout:HOME_URL="https://centos.org/" 2026-02-25T10:58:22.053 INFO:teuthology.orchestra.run.trial150.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-25T10:58:22.053 INFO:teuthology.orchestra.run.trial150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-25T10:58:22.053 INFO:teuthology.orchestra.run.trial150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-25T10:58:22.054 INFO:teuthology.provision.fog.trial150:Deploy complete! 2026-02-25T10:58:22.055 DEBUG:teuthology.parallel:result is None 2026-02-25T10:58:22.869 INFO:teuthology.provision.fog.trial047:Node is ready 2026-02-25T10:58:22.870 DEBUG:teuthology.orchestra.run.trial047:> hostname 2026-02-25T10:58:22.886 INFO:teuthology.orchestra.run.trial047.stdout:trial047.front.sepia.ceph.com 2026-02-25T10:58:22.886 DEBUG:teuthology.orchestra.run.trial047:> grep trial047.front.sepia.ceph.com /etc/hosts 2026-02-25T10:58:22.942 INFO:teuthology.orchestra.run.trial047.stdout:10.20.193.47 trial047.front.sepia.ceph.com trial047 2026-02-25T10:58:22.943 DEBUG:teuthology.orchestra.run.trial047:> sudo hostname trial047 2026-02-25T10:58:23.021 DEBUG:teuthology.orchestra.run.trial047:> sudo sed -i -e 's/trial047.front.sepia.ceph.com/trial047/g' /etc/hosts 2026-02-25T10:58:23.088 DEBUG:teuthology.orchestra.run.trial047:> sudo sed -i -e 's/10.20.193.47/10.20.193.47/g' /etc/hosts 2026-02-25T10:58:23.152 DEBUG:teuthology.orchestra.run.trial047:> sudo sed -i -e 's/trial047.front.sepia.ceph.com/trial047/g' /etc/hostname 2026-02-25T10:58:23.218 DEBUG:teuthology.orchestra.run.trial047:> sudo hostname trial047 2026-02-25T10:58:23.281 DEBUG:teuthology.orchestra.run.trial047:> cat /etc/os-release 2026-02-25T10:58:23.337 INFO:teuthology.orchestra.run.trial047.stdout:NAME="CentOS Stream" 2026-02-25T10:58:23.338 INFO:teuthology.orchestra.run.trial047.stdout:VERSION="9" 2026-02-25T10:58:23.338 INFO:teuthology.orchestra.run.trial047.stdout:ID="centos" 2026-02-25T10:58:23.338 INFO:teuthology.orchestra.run.trial047.stdout:ID_LIKE="rhel fedora" 2026-02-25T10:58:23.338 INFO:teuthology.orchestra.run.trial047.stdout:VERSION_ID="9" 2026-02-25T10:58:23.338 INFO:teuthology.orchestra.run.trial047.stdout:PLATFORM_ID="platform:el9" 2026-02-25T10:58:23.338 INFO:teuthology.orchestra.run.trial047.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-25T10:58:23.338 INFO:teuthology.orchestra.run.trial047.stdout:ANSI_COLOR="0;31" 2026-02-25T10:58:23.338 INFO:teuthology.orchestra.run.trial047.stdout:LOGO="fedora-logo-icon" 2026-02-25T10:58:23.338 INFO:teuthology.orchestra.run.trial047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-25T10:58:23.338 INFO:teuthology.orchestra.run.trial047.stdout:HOME_URL="https://centos.org/" 2026-02-25T10:58:23.338 INFO:teuthology.orchestra.run.trial047.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-25T10:58:23.338 INFO:teuthology.orchestra.run.trial047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-25T10:58:23.338 INFO:teuthology.orchestra.run.trial047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-25T10:58:23.338 INFO:teuthology.provision.fog.trial047:Deploy complete! 2026-02-25T10:58:23.338 DEBUG:teuthology.parallel:result is None 2026-02-25T10:58:23.829 INFO:teuthology.lock.ops:Checking trial047.front.sepia.ceph.com 2026-02-25T10:58:23.829 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-25T10:58:23.934 INFO:teuthology.lock.ops:Checking trial133.front.sepia.ceph.com 2026-02-25T10:58:23.934 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-25T10:58:23.993 INFO:teuthology.lock.ops:Checking trial150.front.sepia.ceph.com 2026-02-25T10:58:23.993 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-25T10:58:24.051 INFO:teuthology.lock.ops:Updating [trial047.front.sepia.ceph.com]: set os type and version on server 2026-02-25T10:58:24.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial047.front.sepia.ceph.com' 2026-02-25T10:58:24.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:58:24.114 DEBUG:teuthology.orchestra.run.trial047:> true 2026-02-25T10:58:24.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial047.front.sepia.ceph.com' 2026-02-25T10:58:24.190 DEBUG:teuthology.orchestra.run.trial047:> uname -m 2026-02-25T10:58:24.245 INFO:teuthology.orchestra.run.trial047.stdout:x86_64 2026-02-25T10:58:24.245 DEBUG:teuthology.orchestra.run.trial047:> cat /etc/os-release 2026-02-25T10:58:24.302 INFO:teuthology.orchestra.run.trial047.stdout:NAME="CentOS Stream" 2026-02-25T10:58:24.302 INFO:teuthology.orchestra.run.trial047.stdout:VERSION="9" 2026-02-25T10:58:24.302 INFO:teuthology.orchestra.run.trial047.stdout:ID="centos" 2026-02-25T10:58:24.302 INFO:teuthology.orchestra.run.trial047.stdout:ID_LIKE="rhel fedora" 2026-02-25T10:58:24.302 INFO:teuthology.orchestra.run.trial047.stdout:VERSION_ID="9" 2026-02-25T10:58:24.302 INFO:teuthology.orchestra.run.trial047.stdout:PLATFORM_ID="platform:el9" 2026-02-25T10:58:24.303 INFO:teuthology.orchestra.run.trial047.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-25T10:58:24.303 INFO:teuthology.orchestra.run.trial047.stdout:ANSI_COLOR="0;31" 2026-02-25T10:58:24.303 INFO:teuthology.orchestra.run.trial047.stdout:LOGO="fedora-logo-icon" 2026-02-25T10:58:24.303 INFO:teuthology.orchestra.run.trial047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-25T10:58:24.303 INFO:teuthology.orchestra.run.trial047.stdout:HOME_URL="https://centos.org/" 2026-02-25T10:58:24.303 INFO:teuthology.orchestra.run.trial047.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-25T10:58:24.303 INFO:teuthology.orchestra.run.trial047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-25T10:58:24.303 INFO:teuthology.orchestra.run.trial047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-25T10:58:24.304 INFO:teuthology.lock.ops:Updating trial047.front.sepia.ceph.com on lock server 2026-02-25T10:58:24.407 INFO:teuthology.lock.ops:Updating [trial133.front.sepia.ceph.com]: set os type and version on server 2026-02-25T10:58:24.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-25T10:58:24.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:58:24.479 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-25T10:58:24.552 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-25T10:58:24.552 DEBUG:teuthology.orchestra.run.trial133:> uname -m 2026-02-25T10:58:24.608 INFO:teuthology.orchestra.run.trial133.stdout:x86_64 2026-02-25T10:58:24.608 DEBUG:teuthology.orchestra.run.trial133:> cat /etc/os-release 2026-02-25T10:58:24.664 INFO:teuthology.orchestra.run.trial133.stdout:NAME="CentOS Stream" 2026-02-25T10:58:24.664 INFO:teuthology.orchestra.run.trial133.stdout:VERSION="9" 2026-02-25T10:58:24.665 INFO:teuthology.orchestra.run.trial133.stdout:ID="centos" 2026-02-25T10:58:24.665 INFO:teuthology.orchestra.run.trial133.stdout:ID_LIKE="rhel fedora" 2026-02-25T10:58:24.665 INFO:teuthology.orchestra.run.trial133.stdout:VERSION_ID="9" 2026-02-25T10:58:24.665 INFO:teuthology.orchestra.run.trial133.stdout:PLATFORM_ID="platform:el9" 2026-02-25T10:58:24.665 INFO:teuthology.orchestra.run.trial133.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-25T10:58:24.665 INFO:teuthology.orchestra.run.trial133.stdout:ANSI_COLOR="0;31" 2026-02-25T10:58:24.665 INFO:teuthology.orchestra.run.trial133.stdout:LOGO="fedora-logo-icon" 2026-02-25T10:58:24.665 INFO:teuthology.orchestra.run.trial133.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-25T10:58:24.665 INFO:teuthology.orchestra.run.trial133.stdout:HOME_URL="https://centos.org/" 2026-02-25T10:58:24.665 INFO:teuthology.orchestra.run.trial133.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-25T10:58:24.665 INFO:teuthology.orchestra.run.trial133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-25T10:58:24.666 INFO:teuthology.orchestra.run.trial133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-25T10:58:24.666 INFO:teuthology.lock.ops:Updating trial133.front.sepia.ceph.com on lock server 2026-02-25T10:58:24.769 INFO:teuthology.lock.ops:Updating [trial150.front.sepia.ceph.com]: set os type and version on server 2026-02-25T10:58:24.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial150.front.sepia.ceph.com' 2026-02-25T10:58:24.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:58:24.832 DEBUG:teuthology.orchestra.run.trial150:> true 2026-02-25T10:58:24.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial150.front.sepia.ceph.com' 2026-02-25T10:58:24.905 DEBUG:teuthology.orchestra.run.trial150:> uname -m 2026-02-25T10:58:24.961 INFO:teuthology.orchestra.run.trial150.stdout:x86_64 2026-02-25T10:58:24.961 DEBUG:teuthology.orchestra.run.trial150:> cat /etc/os-release 2026-02-25T10:58:25.017 INFO:teuthology.orchestra.run.trial150.stdout:NAME="CentOS Stream" 2026-02-25T10:58:25.017 INFO:teuthology.orchestra.run.trial150.stdout:VERSION="9" 2026-02-25T10:58:25.018 INFO:teuthology.orchestra.run.trial150.stdout:ID="centos" 2026-02-25T10:58:25.018 INFO:teuthology.orchestra.run.trial150.stdout:ID_LIKE="rhel fedora" 2026-02-25T10:58:25.018 INFO:teuthology.orchestra.run.trial150.stdout:VERSION_ID="9" 2026-02-25T10:58:25.018 INFO:teuthology.orchestra.run.trial150.stdout:PLATFORM_ID="platform:el9" 2026-02-25T10:58:25.018 INFO:teuthology.orchestra.run.trial150.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-25T10:58:25.018 INFO:teuthology.orchestra.run.trial150.stdout:ANSI_COLOR="0;31" 2026-02-25T10:58:25.018 INFO:teuthology.orchestra.run.trial150.stdout:LOGO="fedora-logo-icon" 2026-02-25T10:58:25.018 INFO:teuthology.orchestra.run.trial150.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-25T10:58:25.018 INFO:teuthology.orchestra.run.trial150.stdout:HOME_URL="https://centos.org/" 2026-02-25T10:58:25.018 INFO:teuthology.orchestra.run.trial150.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-25T10:58:25.018 INFO:teuthology.orchestra.run.trial150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-25T10:58:25.018 INFO:teuthology.orchestra.run.trial150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-25T10:58:25.019 INFO:teuthology.lock.ops:Updating trial150.front.sepia.ceph.com on lock server 2026-02-25T10:58:25.123 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:58:25.226 INFO:teuthology.dispatcher.supervisor:Running job 69413 2026-02-25T10:58:25.226 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_vshankar@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/vshankar-2026-02-25_09:28:04-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/69413 --name vshankar-2026-02-25_09:28:04-fs-wip-vshankar-testing-20260224.100235-testing-default-trial --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} -- /home/teuthworker/mnt/teuthology/vshankar-2026-02-25_09:28:04-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/69413/orig.config.yaml 2026-02-25T10:58:25.227 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/vshankar-2026-02-25_09:28:04-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/69413 2026-02-25T10:58:25.227 INFO:teuthology.dispatcher.supervisor:Job PID: 375422 2026-02-25T10:58:25.227 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-25T11:00:25.326 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:02:25.501 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:04:25.686 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:06:25.871 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:08:26.061 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:10:26.256 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:12:26.443 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:14:26.605 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:16:26.767 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:18:26.967 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:20:27.124 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:22:27.229 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:24:27.408 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:26:27.602 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:28:27.809 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:30:27.994 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:32:28.171 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:32:28.253 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-25T11:32:28.424 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-25T11:32:29.149 INFO:teuthology.orchestra.console.trial133:Power off 2026-02-25T11:32:29.149 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-25T11:32:29.161 INFO:teuthology.orchestra.console.trial150:Power off 2026-02-25T11:32:29.162 DEBUG:teuthology.orchestra.console.trial150:pexpect command: ipmitool -H trial150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-25T11:32:29.169 INFO:teuthology.orchestra.console.trial047:Power off 2026-02-25T11:32:29.169 DEBUG:teuthology.orchestra.console.trial047:pexpect command: ipmitool -H trial047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-25T11:32:29.189 DEBUG:teuthology.orchestra.console.trial133:power off output: Chassis Power Control: Down/Off 2026-02-25T11:32:29.200 DEBUG:teuthology.orchestra.console.trial150:power off output: Chassis Power Control: Down/Off 2026-02-25T11:32:29.208 DEBUG:teuthology.orchestra.console.trial047:power off output: Chassis Power Control: Down/Off 2026-02-25T11:32:33.192 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T11:32:33.201 DEBUG:teuthology.orchestra.console.trial150:pexpect command: ipmitool -H trial150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T11:32:33.208 DEBUG:teuthology.orchestra.console.trial047:pexpect command: ipmitool -H trial047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T11:32:33.302 DEBUG:teuthology.orchestra.console.trial133:check power output: Chassis Power is on 2026-02-25T11:32:33.309 DEBUG:teuthology.orchestra.console.trial150:check power output: Chassis Power is on 2026-02-25T11:32:33.316 DEBUG:teuthology.orchestra.console.trial047:check power output: Chassis Power is on 2026-02-25T11:32:37.307 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T11:32:37.315 DEBUG:teuthology.orchestra.console.trial150:pexpect command: ipmitool -H trial150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T11:32:37.323 DEBUG:teuthology.orchestra.console.trial047:pexpect command: ipmitool -H trial047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T11:32:37.417 DEBUG:teuthology.orchestra.console.trial133:check power output: Chassis Power is off 2026-02-25T11:32:37.417 INFO:teuthology.orchestra.console.trial133:Power off completed 2026-02-25T11:32:37.424 DEBUG:teuthology.orchestra.console.trial150:check power output: Chassis Power is off 2026-02-25T11:32:37.424 INFO:teuthology.orchestra.console.trial150:Power off completed 2026-02-25T11:32:37.433 DEBUG:teuthology.orchestra.console.trial047:check power output: Chassis Power is off 2026-02-25T11:32:37.433 INFO:teuthology.orchestra.console.trial047:Power off completed 2026-02-25T11:32:37.715 INFO:teuthology.lock.ops:unlocked: trial133.front.sepia.ceph.com 2026-02-25T11:32:37.724 INFO:teuthology.lock.ops:unlocked: trial150.front.sepia.ceph.com 2026-02-25T11:32:37.727 INFO:teuthology.lock.ops:unlocked: trial047.front.sepia.ceph.com