2026-02-23T10:31:39.809 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-23T10:31:39.809 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T10:31:39.892 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T10:31:40.097 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x73afbf052f20>, signals=[15]) 2026-02-23T10:31:40.098 INFO:teuthology.lock.ops:Start node 'trial014.front.sepia.ceph.com' reimaging 2026-02-23T10:31:40.098 INFO:teuthology.lock.ops:Updating [trial014.front.sepia.ceph.com]: reset os type and version on server 2026-02-23T10:31:40.098 INFO:teuthology.lock.ops:Updating trial014.front.sepia.ceph.com on lock server 2026-02-23T10:31:40.157 INFO:teuthology.lock.ops:Start node 'trial046.front.sepia.ceph.com' reimaging 2026-02-23T10:31:40.157 INFO:teuthology.lock.ops:Updating [trial046.front.sepia.ceph.com]: reset os type and version on server 2026-02-23T10:31:40.157 INFO:teuthology.lock.ops:Updating trial046.front.sepia.ceph.com on lock server 2026-02-23T10:31:40.378 DEBUG:teuthology.provision.fog.trial046:Requesting image trial_centos_9.stream (ID 3) 2026-02-23T10:31:40.395 DEBUG:teuthology.provision.fog.trial014:Requesting image trial_centos_9.stream (ID 3) 2026-02-23T10:31:40.430 INFO:teuthology.provision.fog.trial046:Scheduling deploy of centos 9.stream 2026-02-23T10:31:40.447 INFO:teuthology.provision.fog.trial014:Scheduling deploy of centos 9.stream 2026-02-23T10:31:41.805 INFO:teuthology.orchestra.console.trial046:Power off 2026-02-23T10:31:41.805 DEBUG:teuthology.orchestra.console.trial046:pexpect command: ipmitool -H trial046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T10:31:41.824 INFO:teuthology.orchestra.console.trial014:Power off 2026-02-23T10:31:41.824 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T10:31:41.846 DEBUG:teuthology.orchestra.console.trial046:power off output: Chassis Power Control: Down/Off 2026-02-23T10:31:41.862 DEBUG:teuthology.orchestra.console.trial014:power off output: Chassis Power Control: Down/Off 2026-02-23T10:31:45.851 DEBUG:teuthology.orchestra.console.trial046:pexpect command: ipmitool -H trial046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T10:31:45.863 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T10:31:45.961 DEBUG:teuthology.orchestra.console.trial046:check power output: Chassis Power is off 2026-02-23T10:31:45.961 INFO:teuthology.orchestra.console.trial046:Power off completed 2026-02-23T10:31:45.970 DEBUG:teuthology.orchestra.console.trial014:check power output: Chassis Power is off 2026-02-23T10:31:45.970 INFO:teuthology.orchestra.console.trial014:Power off completed 2026-02-23T10:31:46.062 INFO:teuthology.orchestra.console.trial046:Power on 2026-02-23T10:31:46.062 DEBUG:teuthology.orchestra.console.trial046:pexpect command: ipmitool -H trial046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-23T10:31:46.071 INFO:teuthology.orchestra.console.trial014:Power on 2026-02-23T10:31:46.071 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-23T10:31:46.102 DEBUG:teuthology.orchestra.console.trial046:power on output: Chassis Power Control: Up/On 2026-02-23T10:31:46.111 DEBUG:teuthology.orchestra.console.trial014:power on output: Chassis Power Control: Up/On 2026-02-23T10:31:50.107 DEBUG:teuthology.orchestra.console.trial046:pexpect command: ipmitool -H trial046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T10:31:50.115 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T10:31:50.216 DEBUG:teuthology.orchestra.console.trial046:check power output: Chassis Power is on 2026-02-23T10:31:50.217 INFO:teuthology.orchestra.console.trial046:Power on completed 2026-02-23T10:31:50.224 DEBUG:teuthology.orchestra.console.trial014:check power output: Chassis Power is off 2026-02-23T10:31:50.317 INFO:teuthology.provision.fog.trial046:Waiting for deploy to finish 2026-02-23T10:31:54.227 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T10:31:54.338 DEBUG:teuthology.orchestra.console.trial014:check power output: Chassis Power is on 2026-02-23T10:31:54.339 INFO:teuthology.orchestra.console.trial014:Power on completed 2026-02-23T10:31:54.439 INFO:teuthology.provision.fog.trial014:Waiting for deploy to finish 2026-02-23T10:33:38.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T10:33:38.245 ERROR:teuthology.orchestra.connection:Error authenticating with trial046.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2026-02-23T10:33:41.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T10:34:20.929 WARNING:teuthology.provision.fog.trial014:[Errno None] Unable to connect to port 22 on 10.20.193.14 2026-02-23T10:34:26.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T10:34:42.248 WARNING:teuthology.provision.fog.trial046:timed out 2026-02-23T10:34:48.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T10:34:51.458 ERROR:teuthology.orchestra.connection:Error authenticating with trial046.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-23T10:34:55.596 ERROR:teuthology.orchestra.connection:Error authenticating with trial046.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-23T10:35:02.682 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-23T10:35:02.683 DEBUG:teuthology.orchestra.run.trial046:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-23T10:35:02.857 INFO:teuthology.provision.fog.trial046:Node is ready 2026-02-23T10:35:02.857 DEBUG:teuthology.orchestra.run.trial046:> hostname 2026-02-23T10:35:02.913 INFO:teuthology.orchestra.run.trial046.stdout:trial046.front.sepia.ceph.com 2026-02-23T10:35:02.913 DEBUG:teuthology.orchestra.run.trial046:> grep trial046.front.sepia.ceph.com /etc/hosts 2026-02-23T10:35:02.984 INFO:teuthology.orchestra.run.trial046.stdout:10.20.193.46 trial046.front.sepia.ceph.com trial046 2026-02-23T10:35:02.984 DEBUG:teuthology.orchestra.run.trial046:> sudo hostname trial046 2026-02-23T10:35:03.005 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-23T10:35:03.005 DEBUG:teuthology.orchestra.run.trial014:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-23T10:35:03.056 DEBUG:teuthology.orchestra.run.trial046:> sudo sed -i -e 's/trial046.front.sepia.ceph.com/trial046/g' /etc/hosts 2026-02-23T10:35:03.121 DEBUG:teuthology.orchestra.run.trial046:> sudo sed -i -e 's/10.20.193.46/10.20.193.46/g' /etc/hosts 2026-02-23T10:35:03.179 INFO:teuthology.provision.fog.trial014:Node is ready 2026-02-23T10:35:03.179 DEBUG:teuthology.orchestra.run.trial014:> hostname 2026-02-23T10:35:03.185 DEBUG:teuthology.orchestra.run.trial046:> sudo sed -i -e 's/trial046.front.sepia.ceph.com/trial046/g' /etc/hostname 2026-02-23T10:35:03.235 INFO:teuthology.orchestra.run.trial014.stdout:trial014.front.sepia.ceph.com 2026-02-23T10:35:03.235 DEBUG:teuthology.orchestra.run.trial014:> grep trial014.front.sepia.ceph.com /etc/hosts 2026-02-23T10:35:03.248 DEBUG:teuthology.orchestra.run.trial046:> sudo hostname trial046 2026-02-23T10:35:03.293 INFO:teuthology.orchestra.run.trial014.stdout:10.20.193.14 trial014.front.sepia.ceph.com trial014 2026-02-23T10:35:03.294 DEBUG:teuthology.orchestra.run.trial014:> sudo hostname trial014 2026-02-23T10:35:03.312 DEBUG:teuthology.orchestra.run.trial046:> cat /etc/os-release 2026-02-23T10:35:03.364 DEBUG:teuthology.orchestra.run.trial014:> sudo sed -i -e 's/trial014.front.sepia.ceph.com/trial014/g' /etc/hosts 2026-02-23T10:35:03.368 INFO:teuthology.orchestra.run.trial046.stdout:NAME="CentOS Stream" 2026-02-23T10:35:03.368 INFO:teuthology.orchestra.run.trial046.stdout:VERSION="9" 2026-02-23T10:35:03.368 INFO:teuthology.orchestra.run.trial046.stdout:ID="centos" 2026-02-23T10:35:03.368 INFO:teuthology.orchestra.run.trial046.stdout:ID_LIKE="rhel fedora" 2026-02-23T10:35:03.368 INFO:teuthology.orchestra.run.trial046.stdout:VERSION_ID="9" 2026-02-23T10:35:03.368 INFO:teuthology.orchestra.run.trial046.stdout:PLATFORM_ID="platform:el9" 2026-02-23T10:35:03.368 INFO:teuthology.orchestra.run.trial046.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T10:35:03.368 INFO:teuthology.orchestra.run.trial046.stdout:ANSI_COLOR="0;31" 2026-02-23T10:35:03.369 INFO:teuthology.orchestra.run.trial046.stdout:LOGO="fedora-logo-icon" 2026-02-23T10:35:03.369 INFO:teuthology.orchestra.run.trial046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T10:35:03.369 INFO:teuthology.orchestra.run.trial046.stdout:HOME_URL="https://centos.org/" 2026-02-23T10:35:03.369 INFO:teuthology.orchestra.run.trial046.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T10:35:03.369 INFO:teuthology.orchestra.run.trial046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T10:35:03.369 INFO:teuthology.orchestra.run.trial046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T10:35:03.370 INFO:teuthology.provision.fog.trial046:Deploy complete! 2026-02-23T10:35:03.372 DEBUG:teuthology.parallel:result is None 2026-02-23T10:35:03.429 DEBUG:teuthology.orchestra.run.trial014:> sudo sed -i -e 's/10.20.193.14/10.20.193.14/g' /etc/hosts 2026-02-23T10:35:03.495 DEBUG:teuthology.orchestra.run.trial014:> sudo sed -i -e 's/trial014.front.sepia.ceph.com/trial014/g' /etc/hostname 2026-02-23T10:35:03.561 DEBUG:teuthology.orchestra.run.trial014:> sudo hostname trial014 2026-02-23T10:35:03.625 DEBUG:teuthology.orchestra.run.trial014:> cat /etc/os-release 2026-02-23T10:35:03.680 INFO:teuthology.orchestra.run.trial014.stdout:NAME="CentOS Stream" 2026-02-23T10:35:03.680 INFO:teuthology.orchestra.run.trial014.stdout:VERSION="9" 2026-02-23T10:35:03.680 INFO:teuthology.orchestra.run.trial014.stdout:ID="centos" 2026-02-23T10:35:03.680 INFO:teuthology.orchestra.run.trial014.stdout:ID_LIKE="rhel fedora" 2026-02-23T10:35:03.680 INFO:teuthology.orchestra.run.trial014.stdout:VERSION_ID="9" 2026-02-23T10:35:03.680 INFO:teuthology.orchestra.run.trial014.stdout:PLATFORM_ID="platform:el9" 2026-02-23T10:35:03.680 INFO:teuthology.orchestra.run.trial014.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T10:35:03.680 INFO:teuthology.orchestra.run.trial014.stdout:ANSI_COLOR="0;31" 2026-02-23T10:35:03.680 INFO:teuthology.orchestra.run.trial014.stdout:LOGO="fedora-logo-icon" 2026-02-23T10:35:03.681 INFO:teuthology.orchestra.run.trial014.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T10:35:03.681 INFO:teuthology.orchestra.run.trial014.stdout:HOME_URL="https://centos.org/" 2026-02-23T10:35:03.681 INFO:teuthology.orchestra.run.trial014.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T10:35:03.681 INFO:teuthology.orchestra.run.trial014.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T10:35:03.681 INFO:teuthology.orchestra.run.trial014.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T10:35:03.681 INFO:teuthology.provision.fog.trial014:Deploy complete! 2026-02-23T10:35:03.681 DEBUG:teuthology.parallel:result is None 2026-02-23T10:35:04.039 INFO:teuthology.lock.ops:Checking trial014.front.sepia.ceph.com 2026-02-23T10:35:04.040 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-23T10:35:04.132 INFO:teuthology.lock.ops:Checking trial046.front.sepia.ceph.com 2026-02-23T10:35:04.132 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-23T10:35:04.196 INFO:teuthology.lock.ops:Updating [trial014.front.sepia.ceph.com]: set os type and version on server 2026-02-23T10:35:04.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial014.front.sepia.ceph.com' 2026-02-23T10:35:04.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T10:35:04.259 DEBUG:teuthology.orchestra.run.trial014:> true 2026-02-23T10:35:04.332 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial014.front.sepia.ceph.com' 2026-02-23T10:35:04.332 DEBUG:teuthology.orchestra.run.trial014:> uname -m 2026-02-23T10:35:04.387 INFO:teuthology.orchestra.run.trial014.stdout:x86_64 2026-02-23T10:35:04.388 DEBUG:teuthology.orchestra.run.trial014:> cat /etc/os-release 2026-02-23T10:35:04.443 INFO:teuthology.orchestra.run.trial014.stdout:NAME="CentOS Stream" 2026-02-23T10:35:04.443 INFO:teuthology.orchestra.run.trial014.stdout:VERSION="9" 2026-02-23T10:35:04.444 INFO:teuthology.orchestra.run.trial014.stdout:ID="centos" 2026-02-23T10:35:04.444 INFO:teuthology.orchestra.run.trial014.stdout:ID_LIKE="rhel fedora" 2026-02-23T10:35:04.444 INFO:teuthology.orchestra.run.trial014.stdout:VERSION_ID="9" 2026-02-23T10:35:04.444 INFO:teuthology.orchestra.run.trial014.stdout:PLATFORM_ID="platform:el9" 2026-02-23T10:35:04.444 INFO:teuthology.orchestra.run.trial014.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T10:35:04.444 INFO:teuthology.orchestra.run.trial014.stdout:ANSI_COLOR="0;31" 2026-02-23T10:35:04.444 INFO:teuthology.orchestra.run.trial014.stdout:LOGO="fedora-logo-icon" 2026-02-23T10:35:04.444 INFO:teuthology.orchestra.run.trial014.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T10:35:04.444 INFO:teuthology.orchestra.run.trial014.stdout:HOME_URL="https://centos.org/" 2026-02-23T10:35:04.444 INFO:teuthology.orchestra.run.trial014.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T10:35:04.444 INFO:teuthology.orchestra.run.trial014.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T10:35:04.444 INFO:teuthology.orchestra.run.trial014.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T10:35:04.445 INFO:teuthology.lock.ops:Updating trial014.front.sepia.ceph.com on lock server 2026-02-23T10:35:04.549 INFO:teuthology.lock.ops:Updating [trial046.front.sepia.ceph.com]: set os type and version on server 2026-02-23T10:35:04.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-23T10:35:04.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T10:35:04.625 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-23T10:35:04.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-23T10:35:04.705 DEBUG:teuthology.orchestra.run.trial046:> uname -m 2026-02-23T10:35:04.760 INFO:teuthology.orchestra.run.trial046.stdout:x86_64 2026-02-23T10:35:04.761 DEBUG:teuthology.orchestra.run.trial046:> cat /etc/os-release 2026-02-23T10:35:04.816 INFO:teuthology.orchestra.run.trial046.stdout:NAME="CentOS Stream" 2026-02-23T10:35:04.817 INFO:teuthology.orchestra.run.trial046.stdout:VERSION="9" 2026-02-23T10:35:04.817 INFO:teuthology.orchestra.run.trial046.stdout:ID="centos" 2026-02-23T10:35:04.817 INFO:teuthology.orchestra.run.trial046.stdout:ID_LIKE="rhel fedora" 2026-02-23T10:35:04.817 INFO:teuthology.orchestra.run.trial046.stdout:VERSION_ID="9" 2026-02-23T10:35:04.817 INFO:teuthology.orchestra.run.trial046.stdout:PLATFORM_ID="platform:el9" 2026-02-23T10:35:04.817 INFO:teuthology.orchestra.run.trial046.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T10:35:04.817 INFO:teuthology.orchestra.run.trial046.stdout:ANSI_COLOR="0;31" 2026-02-23T10:35:04.817 INFO:teuthology.orchestra.run.trial046.stdout:LOGO="fedora-logo-icon" 2026-02-23T10:35:04.817 INFO:teuthology.orchestra.run.trial046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T10:35:04.817 INFO:teuthology.orchestra.run.trial046.stdout:HOME_URL="https://centos.org/" 2026-02-23T10:35:04.818 INFO:teuthology.orchestra.run.trial046.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T10:35:04.818 INFO:teuthology.orchestra.run.trial046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T10:35:04.818 INFO:teuthology.orchestra.run.trial046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T10:35:04.818 INFO:teuthology.lock.ops:Updating trial046.front.sepia.ceph.com on lock server 2026-02-23T10:35:04.920 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T10:35:05.010 INFO:teuthology.dispatcher.supervisor:Running job 66113 2026-02-23T10:35:05.010 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_shraddhaag@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66113 --name shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects-balanced} -- /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66113/orig.config.yaml 2026-02-23T10:35:05.010 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66113 2026-02-23T10:35:05.010 INFO:teuthology.dispatcher.supervisor:Job PID: 4170235 2026-02-23T10:35:05.010 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-23T10:37:05.011 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T10:39:05.133 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T10:41:05.263 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T10:43:05.383 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T10:45:05.523 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T10:47:05.645 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T10:49:05.751 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T10:51:05.877 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T10:53:05.995 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T10:55:06.116 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T10:57:06.203 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T10:59:06.326 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T11:01:06.445 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T11:03:06.565 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T11:05:06.637 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T11:07:06.762 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T11:07:06.831 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-23T11:07:06.946 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-23T11:07:07.458 INFO:teuthology.orchestra.console.trial014:Power off 2026-02-23T11:07:07.458 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T11:07:07.468 INFO:teuthology.orchestra.console.trial046:Power off 2026-02-23T11:07:07.468 DEBUG:teuthology.orchestra.console.trial046:pexpect command: ipmitool -H trial046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T11:07:07.504 DEBUG:teuthology.orchestra.console.trial014:power off output: Chassis Power Control: Down/Off 2026-02-23T11:07:07.507 DEBUG:teuthology.orchestra.console.trial046:power off output: Chassis Power Control: Down/Off 2026-02-23T11:07:11.505 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T11:07:11.512 DEBUG:teuthology.orchestra.console.trial046:pexpect command: ipmitool -H trial046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T11:07:11.614 DEBUG:teuthology.orchestra.console.trial014:check power output: Chassis Power is on 2026-02-23T11:07:11.621 DEBUG:teuthology.orchestra.console.trial046:check power output: Chassis Power is on 2026-02-23T11:07:15.615 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T11:07:15.624 DEBUG:teuthology.orchestra.console.trial046:pexpect command: ipmitool -H trial046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T11:07:15.726 DEBUG:teuthology.orchestra.console.trial014:check power output: Chassis Power is off 2026-02-23T11:07:15.726 INFO:teuthology.orchestra.console.trial014:Power off completed 2026-02-23T11:07:15.735 DEBUG:teuthology.orchestra.console.trial046:check power output: Chassis Power is off 2026-02-23T11:07:15.735 INFO:teuthology.orchestra.console.trial046:Power off completed 2026-02-23T11:07:15.973 INFO:teuthology.lock.ops:unlocked: trial014.front.sepia.ceph.com 2026-02-23T11:07:15.986 INFO:teuthology.lock.ops:unlocked: trial046.front.sepia.ceph.com