2026-02-21T07:25:36.588 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-21T07:25:36.588 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:25:36.660 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:25:36.867 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x78a18b085440>, signals=[15]) 2026-02-21T07:25:36.867 INFO:teuthology.lock.ops:Start node 'trial096.front.sepia.ceph.com' reimaging 2026-02-21T07:25:36.867 INFO:teuthology.lock.ops:Updating [trial096.front.sepia.ceph.com]: reset os type and version on server 2026-02-21T07:25:36.867 INFO:teuthology.lock.ops:Updating trial096.front.sepia.ceph.com on lock server 2026-02-21T07:25:36.925 INFO:teuthology.lock.ops:Start node 'trial198.front.sepia.ceph.com' reimaging 2026-02-21T07:25:36.925 INFO:teuthology.lock.ops:Updating [trial198.front.sepia.ceph.com]: reset os type and version on server 2026-02-21T07:25:36.925 INFO:teuthology.lock.ops:Updating trial198.front.sepia.ceph.com on lock server 2026-02-21T07:25:37.130 DEBUG:teuthology.provision.fog.trial198:Requesting image trial_centos_9.stream (ID 3) 2026-02-21T07:25:37.137 DEBUG:teuthology.provision.fog.trial096:Requesting image trial_centos_9.stream (ID 3) 2026-02-21T07:25:37.181 INFO:teuthology.provision.fog.trial198:Scheduling deploy of centos 9.stream 2026-02-21T07:25:37.185 INFO:teuthology.provision.fog.trial096:Scheduling deploy of centos 9.stream 2026-02-21T07:25:39.189 INFO:teuthology.orchestra.console.trial096:Power off 2026-02-21T07:25:39.189 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-21T07:25:39.266 DEBUG:teuthology.orchestra.console.trial096:power off output: Chassis Power Control: Down/Off 2026-02-21T07:25:39.276 INFO:teuthology.orchestra.console.trial198:Power off 2026-02-21T07:25:39.277 DEBUG:teuthology.orchestra.console.trial198:pexpect command: ipmitool -H trial198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-21T07:25:39.314 DEBUG:teuthology.orchestra.console.trial198:power off output: Chassis Power Control: Down/Off 2026-02-21T07:25:43.270 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T07:25:43.315 DEBUG:teuthology.orchestra.console.trial198:pexpect command: ipmitool -H trial198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T07:25:43.378 DEBUG:teuthology.orchestra.console.trial096:check power output: Chassis Power is off 2026-02-21T07:25:43.379 INFO:teuthology.orchestra.console.trial096:Power off completed 2026-02-21T07:25:43.421 DEBUG:teuthology.orchestra.console.trial198:check power output: Chassis Power is off 2026-02-21T07:25:43.421 INFO:teuthology.orchestra.console.trial198:Power off completed 2026-02-21T07:25:43.480 INFO:teuthology.orchestra.console.trial096:Power on 2026-02-21T07:25:43.480 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-21T07:25:43.516 DEBUG:teuthology.orchestra.console.trial096:power on output: Chassis Power Control: Up/On 2026-02-21T07:25:43.523 INFO:teuthology.orchestra.console.trial198:Power on 2026-02-21T07:25:43.523 DEBUG:teuthology.orchestra.console.trial198:pexpect command: ipmitool -H trial198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-21T07:25:43.562 DEBUG:teuthology.orchestra.console.trial198:power on output: Chassis Power Control: Up/On 2026-02-21T07:25:47.521 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T07:25:47.563 DEBUG:teuthology.orchestra.console.trial198:pexpect command: ipmitool -H trial198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T07:25:47.631 DEBUG:teuthology.orchestra.console.trial096:check power output: Chassis Power is on 2026-02-21T07:25:47.631 INFO:teuthology.orchestra.console.trial096:Power on completed 2026-02-21T07:25:47.671 DEBUG:teuthology.orchestra.console.trial198:check power output: Chassis Power is on 2026-02-21T07:25:47.671 INFO:teuthology.orchestra.console.trial198:Power on completed 2026-02-21T07:25:47.732 INFO:teuthology.provision.fog.trial096:Waiting for deploy to finish 2026-02-21T07:25:47.771 INFO:teuthology.provision.fog.trial198:Waiting for deploy to finish 2026-02-21T07:27:51.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:27:51.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:27:54.560 WARNING:teuthology.provision.fog.trial096:[Errno None] Unable to connect to port 22 on 10.20.193.96 2026-02-21T07:28:00.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:28:03.648 WARNING:teuthology.provision.fog.trial096:[Errno None] Unable to connect to port 22 on 10.20.193.96 2026-02-21T07:28:05.824 WARNING:teuthology.provision.fog.trial198:[Errno None] Unable to connect to port 22 on 10.20.193.198 2026-02-21T07:28:09.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:28:11.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:28:12.736 WARNING:teuthology.provision.fog.trial096:[Errno None] Unable to connect to port 22 on 10.20.193.96 2026-02-21T07:28:14.913 WARNING:teuthology.provision.fog.trial198:[Errno None] Unable to connect to port 22 on 10.20.193.198 2026-02-21T07:28:18.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:28:20.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:28:21.824 WARNING:teuthology.provision.fog.trial096:[Errno None] Unable to connect to port 22 on 10.20.193.96 2026-02-21T07:28:24.000 WARNING:teuthology.provision.fog.trial198:[Errno None] Unable to connect to port 22 on 10.20.193.198 2026-02-21T07:28:27.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:28:30.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:28:30.912 WARNING:teuthology.provision.fog.trial096:[Errno None] Unable to connect to port 22 on 10.20.193.96 2026-02-21T07:28:36.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:29:06.039 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-21T07:29:06.040 DEBUG:teuthology.orchestra.run.trial198:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-21T07:29:06.258 INFO:teuthology.provision.fog.trial198:Node is ready 2026-02-21T07:29:06.258 DEBUG:teuthology.orchestra.run.trial198:> hostname 2026-02-21T07:29:06.314 INFO:teuthology.orchestra.run.trial198.stdout:trial198.front.sepia.ceph.com 2026-02-21T07:29:06.314 DEBUG:teuthology.orchestra.run.trial198:> grep trial198.front.sepia.ceph.com /etc/hosts 2026-02-21T07:29:06.371 INFO:teuthology.orchestra.run.trial198.stdout:10.20.193.198 trial198.front.sepia.ceph.com trial198 2026-02-21T07:29:06.372 DEBUG:teuthology.orchestra.run.trial198:> sudo hostname trial198 2026-02-21T07:29:06.443 DEBUG:teuthology.orchestra.run.trial198:> sudo sed -i -e 's/trial198.front.sepia.ceph.com/trial198/g' /etc/hosts 2026-02-21T07:29:06.508 DEBUG:teuthology.orchestra.run.trial198:> sudo sed -i -e 's/10.20.193.198/10.20.193.198/g' /etc/hosts 2026-02-21T07:29:06.572 DEBUG:teuthology.orchestra.run.trial198:> sudo sed -i -e 's/trial198.front.sepia.ceph.com/trial198/g' /etc/hostname 2026-02-21T07:29:06.637 DEBUG:teuthology.orchestra.run.trial198:> sudo hostname trial198 2026-02-21T07:29:06.701 DEBUG:teuthology.orchestra.run.trial198:> cat /etc/os-release 2026-02-21T07:29:06.758 INFO:teuthology.orchestra.run.trial198.stdout:NAME="CentOS Stream" 2026-02-21T07:29:06.758 INFO:teuthology.orchestra.run.trial198.stdout:VERSION="9" 2026-02-21T07:29:06.759 INFO:teuthology.orchestra.run.trial198.stdout:ID="centos" 2026-02-21T07:29:06.759 INFO:teuthology.orchestra.run.trial198.stdout:ID_LIKE="rhel fedora" 2026-02-21T07:29:06.759 INFO:teuthology.orchestra.run.trial198.stdout:VERSION_ID="9" 2026-02-21T07:29:06.759 INFO:teuthology.orchestra.run.trial198.stdout:PLATFORM_ID="platform:el9" 2026-02-21T07:29:06.759 INFO:teuthology.orchestra.run.trial198.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-21T07:29:06.759 INFO:teuthology.orchestra.run.trial198.stdout:ANSI_COLOR="0;31" 2026-02-21T07:29:06.759 INFO:teuthology.orchestra.run.trial198.stdout:LOGO="fedora-logo-icon" 2026-02-21T07:29:06.759 INFO:teuthology.orchestra.run.trial198.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-21T07:29:06.759 INFO:teuthology.orchestra.run.trial198.stdout:HOME_URL="https://centos.org/" 2026-02-21T07:29:06.759 INFO:teuthology.orchestra.run.trial198.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-21T07:29:06.760 INFO:teuthology.orchestra.run.trial198.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-21T07:29:06.760 INFO:teuthology.orchestra.run.trial198.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-21T07:29:06.761 INFO:teuthology.provision.fog.trial198:Deploy complete! 2026-02-21T07:29:06.762 DEBUG:teuthology.parallel:result is None 2026-02-21T07:29:12.696 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-21T07:29:12.697 DEBUG:teuthology.orchestra.run.trial096:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-21T07:29:12.918 INFO:teuthology.provision.fog.trial096:Node is ready 2026-02-21T07:29:12.919 DEBUG:teuthology.orchestra.run.trial096:> hostname 2026-02-21T07:29:12.975 INFO:teuthology.orchestra.run.trial096.stdout:trial096.front.sepia.ceph.com 2026-02-21T07:29:12.975 DEBUG:teuthology.orchestra.run.trial096:> grep trial096.front.sepia.ceph.com /etc/hosts 2026-02-21T07:29:13.033 INFO:teuthology.orchestra.run.trial096.stdout:10.20.193.96 trial096.front.sepia.ceph.com trial096 2026-02-21T07:29:13.034 DEBUG:teuthology.orchestra.run.trial096:> sudo hostname trial096 2026-02-21T07:29:13.104 DEBUG:teuthology.orchestra.run.trial096:> sudo sed -i -e 's/trial096.front.sepia.ceph.com/trial096/g' /etc/hosts 2026-02-21T07:29:13.169 DEBUG:teuthology.orchestra.run.trial096:> sudo sed -i -e 's/10.20.193.96/10.20.193.96/g' /etc/hosts 2026-02-21T07:29:13.234 DEBUG:teuthology.orchestra.run.trial096:> sudo sed -i -e 's/trial096.front.sepia.ceph.com/trial096/g' /etc/hostname 2026-02-21T07:29:13.342 DEBUG:teuthology.orchestra.run.trial096:> sudo hostname trial096 2026-02-21T07:29:13.416 DEBUG:teuthology.orchestra.run.trial096:> cat /etc/os-release 2026-02-21T07:29:13.432 INFO:teuthology.orchestra.run.trial096.stdout:NAME="CentOS Stream" 2026-02-21T07:29:13.433 INFO:teuthology.orchestra.run.trial096.stdout:VERSION="9" 2026-02-21T07:29:13.433 INFO:teuthology.orchestra.run.trial096.stdout:ID="centos" 2026-02-21T07:29:13.433 INFO:teuthology.orchestra.run.trial096.stdout:ID_LIKE="rhel fedora" 2026-02-21T07:29:13.433 INFO:teuthology.orchestra.run.trial096.stdout:VERSION_ID="9" 2026-02-21T07:29:13.433 INFO:teuthology.orchestra.run.trial096.stdout:PLATFORM_ID="platform:el9" 2026-02-21T07:29:13.433 INFO:teuthology.orchestra.run.trial096.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-21T07:29:13.433 INFO:teuthology.orchestra.run.trial096.stdout:ANSI_COLOR="0;31" 2026-02-21T07:29:13.433 INFO:teuthology.orchestra.run.trial096.stdout:LOGO="fedora-logo-icon" 2026-02-21T07:29:13.433 INFO:teuthology.orchestra.run.trial096.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-21T07:29:13.434 INFO:teuthology.orchestra.run.trial096.stdout:HOME_URL="https://centos.org/" 2026-02-21T07:29:13.434 INFO:teuthology.orchestra.run.trial096.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-21T07:29:13.434 INFO:teuthology.orchestra.run.trial096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-21T07:29:13.434 INFO:teuthology.orchestra.run.trial096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-21T07:29:13.434 INFO:teuthology.provision.fog.trial096:Deploy complete! 2026-02-21T07:29:13.435 DEBUG:teuthology.parallel:result is None 2026-02-21T07:29:15.970 INFO:teuthology.lock.ops:Checking trial096.front.sepia.ceph.com 2026-02-21T07:29:15.970 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-21T07:29:16.068 INFO:teuthology.lock.ops:Checking trial198.front.sepia.ceph.com 2026-02-21T07:29:16.068 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-21T07:29:16.328 INFO:teuthology.lock.ops:Updating [trial096.front.sepia.ceph.com]: set os type and version on server 2026-02-21T07:29:16.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial096.front.sepia.ceph.com' 2026-02-21T07:29:16.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:29:16.389 DEBUG:teuthology.orchestra.run.trial096:> true 2026-02-21T07:29:16.462 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial096.front.sepia.ceph.com' 2026-02-21T07:29:16.462 DEBUG:teuthology.orchestra.run.trial096:> uname -m 2026-02-21T07:29:16.518 INFO:teuthology.orchestra.run.trial096.stdout:x86_64 2026-02-21T07:29:16.518 DEBUG:teuthology.orchestra.run.trial096:> cat /etc/os-release 2026-02-21T07:29:16.574 INFO:teuthology.orchestra.run.trial096.stdout:NAME="CentOS Stream" 2026-02-21T07:29:16.574 INFO:teuthology.orchestra.run.trial096.stdout:VERSION="9" 2026-02-21T07:29:16.574 INFO:teuthology.orchestra.run.trial096.stdout:ID="centos" 2026-02-21T07:29:16.574 INFO:teuthology.orchestra.run.trial096.stdout:ID_LIKE="rhel fedora" 2026-02-21T07:29:16.575 INFO:teuthology.orchestra.run.trial096.stdout:VERSION_ID="9" 2026-02-21T07:29:16.575 INFO:teuthology.orchestra.run.trial096.stdout:PLATFORM_ID="platform:el9" 2026-02-21T07:29:16.575 INFO:teuthology.orchestra.run.trial096.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-21T07:29:16.575 INFO:teuthology.orchestra.run.trial096.stdout:ANSI_COLOR="0;31" 2026-02-21T07:29:16.575 INFO:teuthology.orchestra.run.trial096.stdout:LOGO="fedora-logo-icon" 2026-02-21T07:29:16.575 INFO:teuthology.orchestra.run.trial096.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-21T07:29:16.575 INFO:teuthology.orchestra.run.trial096.stdout:HOME_URL="https://centos.org/" 2026-02-21T07:29:16.575 INFO:teuthology.orchestra.run.trial096.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-21T07:29:16.575 INFO:teuthology.orchestra.run.trial096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-21T07:29:16.575 INFO:teuthology.orchestra.run.trial096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-21T07:29:16.576 INFO:teuthology.lock.ops:Updating trial096.front.sepia.ceph.com on lock server 2026-02-21T07:29:18.887 INFO:teuthology.lock.ops:Updating [trial198.front.sepia.ceph.com]: set os type and version on server 2026-02-21T07:29:18.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial198.front.sepia.ceph.com' 2026-02-21T07:29:18.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:29:18.989 DEBUG:teuthology.orchestra.run.trial198:> true 2026-02-21T07:29:19.136 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial198.front.sepia.ceph.com' 2026-02-21T07:29:19.136 DEBUG:teuthology.orchestra.run.trial198:> uname -m 2026-02-21T07:29:19.192 INFO:teuthology.orchestra.run.trial198.stdout:x86_64 2026-02-21T07:29:19.193 DEBUG:teuthology.orchestra.run.trial198:> cat /etc/os-release 2026-02-21T07:29:19.249 INFO:teuthology.orchestra.run.trial198.stdout:NAME="CentOS Stream" 2026-02-21T07:29:19.249 INFO:teuthology.orchestra.run.trial198.stdout:VERSION="9" 2026-02-21T07:29:19.249 INFO:teuthology.orchestra.run.trial198.stdout:ID="centos" 2026-02-21T07:29:19.249 INFO:teuthology.orchestra.run.trial198.stdout:ID_LIKE="rhel fedora" 2026-02-21T07:29:19.249 INFO:teuthology.orchestra.run.trial198.stdout:VERSION_ID="9" 2026-02-21T07:29:19.249 INFO:teuthology.orchestra.run.trial198.stdout:PLATFORM_ID="platform:el9" 2026-02-21T07:29:19.249 INFO:teuthology.orchestra.run.trial198.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-21T07:29:19.249 INFO:teuthology.orchestra.run.trial198.stdout:ANSI_COLOR="0;31" 2026-02-21T07:29:19.250 INFO:teuthology.orchestra.run.trial198.stdout:LOGO="fedora-logo-icon" 2026-02-21T07:29:19.250 INFO:teuthology.orchestra.run.trial198.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-21T07:29:19.250 INFO:teuthology.orchestra.run.trial198.stdout:HOME_URL="https://centos.org/" 2026-02-21T07:29:19.250 INFO:teuthology.orchestra.run.trial198.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-21T07:29:19.250 INFO:teuthology.orchestra.run.trial198.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-21T07:29:19.250 INFO:teuthology.orchestra.run.trial198.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-21T07:29:19.251 INFO:teuthology.lock.ops:Updating trial198.front.sepia.ceph.com on lock server 2026-02-21T07:29:19.380 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:29:21.446 INFO:teuthology.dispatcher.supervisor:Running job 62270 2026-02-21T07:29:21.446 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_amathuri@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/amathuri-2026-02-21_07:25:29-crimson-rados:thrash-main-distro-debug-trial/62270 --name amathuri-2026-02-21_07:25:29-crimson-rados:thrash-main-distro-debug-trial --description crimson-rados:thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{pggrow} thrashosds-health workloads/small-objects-localized} -- /home/teuthworker/mnt/teuthology/amathuri-2026-02-21_07:25:29-crimson-rados:thrash-main-distro-debug-trial/62270/orig.config.yaml 2026-02-21T07:29:21.446 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/amathuri-2026-02-21_07:25:29-crimson-rados:thrash-main-distro-debug-trial/62270 2026-02-21T07:29:21.446 INFO:teuthology.dispatcher.supervisor:Job PID: 2914632 2026-02-21T07:29:21.446 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-21T07:31:21.459 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:33:21.664 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:35:21.799 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:37:21.940 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:39:22.110 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:41:22.270 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:43:22.388 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:45:22.554 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:47:22.695 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:49:22.899 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:51:23.063 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:53:23.175 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:55:23.279 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:57:23.475 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:57:23.560 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-21T07:57:23.675 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-21T07:57:24.184 INFO:teuthology.orchestra.console.trial096:Power off 2026-02-21T07:57:24.184 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-21T07:57:24.201 INFO:teuthology.orchestra.console.trial198:Power off 2026-02-21T07:57:24.201 DEBUG:teuthology.orchestra.console.trial198:pexpect command: ipmitool -H trial198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-21T07:57:24.221 DEBUG:teuthology.orchestra.console.trial096:power off output: Chassis Power Control: Down/Off 2026-02-21T07:57:24.239 DEBUG:teuthology.orchestra.console.trial198:power off output: Chassis Power Control: Down/Off 2026-02-21T07:57:28.225 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T07:57:28.240 DEBUG:teuthology.orchestra.console.trial198:pexpect command: ipmitool -H trial198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T07:57:28.334 DEBUG:teuthology.orchestra.console.trial096:check power output: Chassis Power is on 2026-02-21T07:57:28.348 DEBUG:teuthology.orchestra.console.trial198:check power output: Chassis Power is on 2026-02-21T07:57:32.339 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T07:57:32.349 DEBUG:teuthology.orchestra.console.trial198:pexpect command: ipmitool -H trial198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T07:57:32.449 DEBUG:teuthology.orchestra.console.trial096:check power output: Chassis Power is off 2026-02-21T07:57:32.449 INFO:teuthology.orchestra.console.trial096:Power off completed 2026-02-21T07:57:32.459 DEBUG:teuthology.orchestra.console.trial198:check power output: Chassis Power is off 2026-02-21T07:57:32.459 INFO:teuthology.orchestra.console.trial198:Power off completed 2026-02-21T07:57:32.692 INFO:teuthology.lock.ops:unlocked: trial096.front.sepia.ceph.com 2026-02-21T07:57:32.704 INFO:teuthology.lock.ops:unlocked: trial198.front.sepia.ceph.com