2026-02-21T07:25:35.171 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-21T07:25:35.171 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:25:35.241 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:25:35.431 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7a99d1a38400>, signals=[15]) 2026-02-21T07:25:35.431 INFO:teuthology.lock.ops:Start node 'trial092.front.sepia.ceph.com' reimaging 2026-02-21T07:25:35.432 INFO:teuthology.lock.ops:Updating [trial092.front.sepia.ceph.com]: reset os type and version on server 2026-02-21T07:25:35.432 INFO:teuthology.lock.ops:Updating trial092.front.sepia.ceph.com on lock server 2026-02-21T07:25:35.487 INFO:teuthology.lock.ops:Start node 'trial154.front.sepia.ceph.com' reimaging 2026-02-21T07:25:35.487 INFO:teuthology.lock.ops:Updating [trial154.front.sepia.ceph.com]: reset os type and version on server 2026-02-21T07:25:35.487 INFO:teuthology.lock.ops:Updating trial154.front.sepia.ceph.com on lock server 2026-02-21T07:25:35.691 DEBUG:teuthology.provision.fog.trial092:Requesting image trial_centos_9.stream (ID 3) 2026-02-21T07:25:35.697 DEBUG:teuthology.provision.fog.trial154:Requesting image trial_centos_9.stream (ID 3) 2026-02-21T07:25:35.718 INFO:teuthology.provision.fog.trial092:Scheduling deploy of centos 9.stream 2026-02-21T07:25:35.747 INFO:teuthology.provision.fog.trial154:Scheduling deploy of centos 9.stream 2026-02-21T07:25:37.784 INFO:teuthology.orchestra.console.trial092:Power off 2026-02-21T07:25:37.784 DEBUG:teuthology.orchestra.console.trial092:pexpect command: ipmitool -H trial092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-21T07:25:37.794 INFO:teuthology.orchestra.console.trial154:Power off 2026-02-21T07:25:37.795 DEBUG:teuthology.orchestra.console.trial154:pexpect command: ipmitool -H trial154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-21T07:25:37.822 DEBUG:teuthology.orchestra.console.trial092:power off output: Chassis Power Control: Down/Off 2026-02-21T07:25:37.831 DEBUG:teuthology.orchestra.console.trial154:power off output: Chassis Power Control: Down/Off 2026-02-21T07:25:41.827 DEBUG:teuthology.orchestra.console.trial092:pexpect command: ipmitool -H trial092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T07:25:41.835 DEBUG:teuthology.orchestra.console.trial154:pexpect command: ipmitool -H trial154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T07:25:41.937 DEBUG:teuthology.orchestra.console.trial092:check power output: Chassis Power is off 2026-02-21T07:25:41.937 INFO:teuthology.orchestra.console.trial092:Power off completed 2026-02-21T07:25:41.942 DEBUG:teuthology.orchestra.console.trial154:check power output: Chassis Power is off 2026-02-21T07:25:41.942 INFO:teuthology.orchestra.console.trial154:Power off completed 2026-02-21T07:25:42.039 INFO:teuthology.orchestra.console.trial092:Power on 2026-02-21T07:25:42.039 DEBUG:teuthology.orchestra.console.trial092:pexpect command: ipmitool -H trial092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-21T07:25:42.046 INFO:teuthology.orchestra.console.trial154:Power on 2026-02-21T07:25:42.047 DEBUG:teuthology.orchestra.console.trial154:pexpect command: ipmitool -H trial154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-21T07:25:42.078 DEBUG:teuthology.orchestra.console.trial092:power on output: Chassis Power Control: Up/On 2026-02-21T07:25:42.083 DEBUG:teuthology.orchestra.console.trial154:power on output: Chassis Power Control: Up/On 2026-02-21T07:25:46.083 DEBUG:teuthology.orchestra.console.trial092:pexpect command: ipmitool -H trial092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T07:25:46.091 DEBUG:teuthology.orchestra.console.trial154:pexpect command: ipmitool -H trial154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T07:25:46.193 DEBUG:teuthology.orchestra.console.trial092:check power output: Chassis Power is on 2026-02-21T07:25:46.194 INFO:teuthology.orchestra.console.trial092:Power on completed 2026-02-21T07:25:46.199 DEBUG:teuthology.orchestra.console.trial154:check power output: Chassis Power is off 2026-02-21T07:25:46.295 INFO:teuthology.provision.fog.trial092:Waiting for deploy to finish 2026-02-21T07:25:50.203 DEBUG:teuthology.orchestra.console.trial154:pexpect command: ipmitool -H trial154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T07:25:50.313 DEBUG:teuthology.orchestra.console.trial154:check power output: Chassis Power is on 2026-02-21T07:25:50.314 INFO:teuthology.orchestra.console.trial154:Power on completed 2026-02-21T07:25:50.414 INFO:teuthology.provision.fog.trial154:Waiting for deploy to finish 2026-02-21T07:27:39.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:27:49.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:27:53.536 WARNING:teuthology.provision.fog.trial154:[Errno None] Unable to connect to port 22 on 10.20.193.154 2026-02-21T07:27:59.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:28:02.624 WARNING:teuthology.provision.fog.trial154:[Errno None] Unable to connect to port 22 on 10.20.193.154 2026-02-21T07:28:04.160 WARNING:teuthology.provision.fog.trial092:[Errno None] Unable to connect to port 22 on 10.20.193.92 2026-02-21T07:28:08.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:28:10.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:28:11.712 WARNING:teuthology.provision.fog.trial154:[Errno None] Unable to connect to port 22 on 10.20.193.154 2026-02-21T07:28:13.248 WARNING:teuthology.provision.fog.trial092:[Errno None] Unable to connect to port 22 on 10.20.193.92 2026-02-21T07:28:17.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:28:19.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:28:20.800 WARNING:teuthology.provision.fog.trial154:[Errno None] Unable to connect to port 22 on 10.20.193.154 2026-02-21T07:28:22.336 WARNING:teuthology.provision.fog.trial092:[Errno None] Unable to connect to port 22 on 10.20.193.92 2026-02-21T07:28:26.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:28:28.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:29:02.974 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-21T07:29:02.974 DEBUG:teuthology.orchestra.run.trial154:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-21T07:29:03.204 INFO:teuthology.provision.fog.trial154:Node is ready 2026-02-21T07:29:03.204 DEBUG:teuthology.orchestra.run.trial154:> hostname 2026-02-21T07:29:03.260 INFO:teuthology.orchestra.run.trial154.stdout:trial154.front.sepia.ceph.com 2026-02-21T07:29:03.261 DEBUG:teuthology.orchestra.run.trial154:> grep trial154.front.sepia.ceph.com /etc/hosts 2026-02-21T07:29:03.316 INFO:teuthology.orchestra.run.trial154.stdout:10.20.193.154 trial154.front.sepia.ceph.com trial154 2026-02-21T07:29:03.317 DEBUG:teuthology.orchestra.run.trial154:> sudo hostname trial154 2026-02-21T07:29:03.387 DEBUG:teuthology.orchestra.run.trial154:> sudo sed -i -e 's/trial154.front.sepia.ceph.com/trial154/g' /etc/hosts 2026-02-21T07:29:03.454 DEBUG:teuthology.orchestra.run.trial154:> sudo sed -i -e 's/10.20.193.154/10.20.193.154/g' /etc/hosts 2026-02-21T07:29:03.520 DEBUG:teuthology.orchestra.run.trial154:> sudo sed -i -e 's/trial154.front.sepia.ceph.com/trial154/g' /etc/hostname 2026-02-21T07:29:03.586 DEBUG:teuthology.orchestra.run.trial154:> sudo hostname trial154 2026-02-21T07:29:03.652 DEBUG:teuthology.orchestra.run.trial154:> cat /etc/os-release 2026-02-21T07:29:03.708 INFO:teuthology.orchestra.run.trial154.stdout:NAME="CentOS Stream" 2026-02-21T07:29:03.709 INFO:teuthology.orchestra.run.trial154.stdout:VERSION="9" 2026-02-21T07:29:03.709 INFO:teuthology.orchestra.run.trial154.stdout:ID="centos" 2026-02-21T07:29:03.709 INFO:teuthology.orchestra.run.trial154.stdout:ID_LIKE="rhel fedora" 2026-02-21T07:29:03.709 INFO:teuthology.orchestra.run.trial154.stdout:VERSION_ID="9" 2026-02-21T07:29:03.709 INFO:teuthology.orchestra.run.trial154.stdout:PLATFORM_ID="platform:el9" 2026-02-21T07:29:03.709 INFO:teuthology.orchestra.run.trial154.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-21T07:29:03.709 INFO:teuthology.orchestra.run.trial154.stdout:ANSI_COLOR="0;31" 2026-02-21T07:29:03.709 INFO:teuthology.orchestra.run.trial154.stdout:LOGO="fedora-logo-icon" 2026-02-21T07:29:03.709 INFO:teuthology.orchestra.run.trial154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-21T07:29:03.710 INFO:teuthology.orchestra.run.trial154.stdout:HOME_URL="https://centos.org/" 2026-02-21T07:29:03.710 INFO:teuthology.orchestra.run.trial154.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-21T07:29:03.710 INFO:teuthology.orchestra.run.trial154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-21T07:29:03.710 INFO:teuthology.orchestra.run.trial154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-21T07:29:03.711 INFO:teuthology.provision.fog.trial154:Deploy complete! 2026-02-21T07:29:03.711 DEBUG:teuthology.parallel:result is None 2026-02-21T07:29:04.509 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-21T07:29:04.509 DEBUG:teuthology.orchestra.run.trial092:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-21T07:29:04.750 INFO:teuthology.provision.fog.trial092:Node is ready 2026-02-21T07:29:04.750 DEBUG:teuthology.orchestra.run.trial092:> hostname 2026-02-21T07:29:04.809 INFO:teuthology.orchestra.run.trial092.stdout:trial092.front.sepia.ceph.com 2026-02-21T07:29:04.810 DEBUG:teuthology.orchestra.run.trial092:> grep trial092.front.sepia.ceph.com /etc/hosts 2026-02-21T07:29:04.870 INFO:teuthology.orchestra.run.trial092.stdout:10.20.193.92 trial092.front.sepia.ceph.com trial092 2026-02-21T07:29:04.871 DEBUG:teuthology.orchestra.run.trial092:> sudo hostname trial092 2026-02-21T07:29:04.945 DEBUG:teuthology.orchestra.run.trial092:> sudo sed -i -e 's/trial092.front.sepia.ceph.com/trial092/g' /etc/hosts 2026-02-21T07:29:05.014 DEBUG:teuthology.orchestra.run.trial092:> sudo sed -i -e 's/10.20.193.92/10.20.193.92/g' /etc/hosts 2026-02-21T07:29:05.082 DEBUG:teuthology.orchestra.run.trial092:> sudo sed -i -e 's/trial092.front.sepia.ceph.com/trial092/g' /etc/hostname 2026-02-21T07:29:05.152 DEBUG:teuthology.orchestra.run.trial092:> sudo hostname trial092 2026-02-21T07:29:05.220 DEBUG:teuthology.orchestra.run.trial092:> cat /etc/os-release 2026-02-21T07:29:05.281 INFO:teuthology.orchestra.run.trial092.stdout:NAME="CentOS Stream" 2026-02-21T07:29:05.281 INFO:teuthology.orchestra.run.trial092.stdout:VERSION="9" 2026-02-21T07:29:05.281 INFO:teuthology.orchestra.run.trial092.stdout:ID="centos" 2026-02-21T07:29:05.281 INFO:teuthology.orchestra.run.trial092.stdout:ID_LIKE="rhel fedora" 2026-02-21T07:29:05.281 INFO:teuthology.orchestra.run.trial092.stdout:VERSION_ID="9" 2026-02-21T07:29:05.281 INFO:teuthology.orchestra.run.trial092.stdout:PLATFORM_ID="platform:el9" 2026-02-21T07:29:05.281 INFO:teuthology.orchestra.run.trial092.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-21T07:29:05.282 INFO:teuthology.orchestra.run.trial092.stdout:ANSI_COLOR="0;31" 2026-02-21T07:29:05.282 INFO:teuthology.orchestra.run.trial092.stdout:LOGO="fedora-logo-icon" 2026-02-21T07:29:05.282 INFO:teuthology.orchestra.run.trial092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-21T07:29:05.282 INFO:teuthology.orchestra.run.trial092.stdout:HOME_URL="https://centos.org/" 2026-02-21T07:29:05.282 INFO:teuthology.orchestra.run.trial092.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-21T07:29:05.282 INFO:teuthology.orchestra.run.trial092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-21T07:29:05.282 INFO:teuthology.orchestra.run.trial092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-21T07:29:05.283 INFO:teuthology.provision.fog.trial092:Deploy complete! 2026-02-21T07:29:05.283 DEBUG:teuthology.parallel:result is None 2026-02-21T07:29:05.676 INFO:teuthology.lock.ops:Checking trial092.front.sepia.ceph.com 2026-02-21T07:29:05.677 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-21T07:29:09.714 INFO:teuthology.lock.ops:Checking trial154.front.sepia.ceph.com 2026-02-21T07:29:09.714 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-21T07:29:09.913 INFO:teuthology.lock.ops:Updating [trial092.front.sepia.ceph.com]: set os type and version on server 2026-02-21T07:29:09.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-21T07:29:09.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:29:09.978 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-21T07:29:10.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-21T07:29:10.054 DEBUG:teuthology.orchestra.run.trial092:> uname -m 2026-02-21T07:29:10.111 INFO:teuthology.orchestra.run.trial092.stdout:x86_64 2026-02-21T07:29:10.112 DEBUG:teuthology.orchestra.run.trial092:> cat /etc/os-release 2026-02-21T07:29:10.168 INFO:teuthology.orchestra.run.trial092.stdout:NAME="CentOS Stream" 2026-02-21T07:29:10.168 INFO:teuthology.orchestra.run.trial092.stdout:VERSION="9" 2026-02-21T07:29:10.168 INFO:teuthology.orchestra.run.trial092.stdout:ID="centos" 2026-02-21T07:29:10.168 INFO:teuthology.orchestra.run.trial092.stdout:ID_LIKE="rhel fedora" 2026-02-21T07:29:10.168 INFO:teuthology.orchestra.run.trial092.stdout:VERSION_ID="9" 2026-02-21T07:29:10.168 INFO:teuthology.orchestra.run.trial092.stdout:PLATFORM_ID="platform:el9" 2026-02-21T07:29:10.168 INFO:teuthology.orchestra.run.trial092.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-21T07:29:10.168 INFO:teuthology.orchestra.run.trial092.stdout:ANSI_COLOR="0;31" 2026-02-21T07:29:10.169 INFO:teuthology.orchestra.run.trial092.stdout:LOGO="fedora-logo-icon" 2026-02-21T07:29:10.169 INFO:teuthology.orchestra.run.trial092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-21T07:29:10.169 INFO:teuthology.orchestra.run.trial092.stdout:HOME_URL="https://centos.org/" 2026-02-21T07:29:10.169 INFO:teuthology.orchestra.run.trial092.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-21T07:29:10.169 INFO:teuthology.orchestra.run.trial092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-21T07:29:10.169 INFO:teuthology.orchestra.run.trial092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-21T07:29:10.170 INFO:teuthology.lock.ops:Updating trial092.front.sepia.ceph.com on lock server 2026-02-21T07:29:10.270 INFO:teuthology.lock.ops:Updating [trial154.front.sepia.ceph.com]: set os type and version on server 2026-02-21T07:29:10.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-21T07:29:10.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T07:29:10.343 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-21T07:29:10.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-21T07:29:10.417 DEBUG:teuthology.orchestra.run.trial154:> uname -m 2026-02-21T07:29:10.472 INFO:teuthology.orchestra.run.trial154.stdout:x86_64 2026-02-21T07:29:10.473 DEBUG:teuthology.orchestra.run.trial154:> cat /etc/os-release 2026-02-21T07:29:10.528 INFO:teuthology.orchestra.run.trial154.stdout:NAME="CentOS Stream" 2026-02-21T07:29:10.528 INFO:teuthology.orchestra.run.trial154.stdout:VERSION="9" 2026-02-21T07:29:10.528 INFO:teuthology.orchestra.run.trial154.stdout:ID="centos" 2026-02-21T07:29:10.529 INFO:teuthology.orchestra.run.trial154.stdout:ID_LIKE="rhel fedora" 2026-02-21T07:29:10.529 INFO:teuthology.orchestra.run.trial154.stdout:VERSION_ID="9" 2026-02-21T07:29:10.529 INFO:teuthology.orchestra.run.trial154.stdout:PLATFORM_ID="platform:el9" 2026-02-21T07:29:10.529 INFO:teuthology.orchestra.run.trial154.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-21T07:29:10.529 INFO:teuthology.orchestra.run.trial154.stdout:ANSI_COLOR="0;31" 2026-02-21T07:29:10.529 INFO:teuthology.orchestra.run.trial154.stdout:LOGO="fedora-logo-icon" 2026-02-21T07:29:10.529 INFO:teuthology.orchestra.run.trial154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-21T07:29:10.529 INFO:teuthology.orchestra.run.trial154.stdout:HOME_URL="https://centos.org/" 2026-02-21T07:29:10.529 INFO:teuthology.orchestra.run.trial154.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-21T07:29:10.529 INFO:teuthology.orchestra.run.trial154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-21T07:29:10.529 INFO:teuthology.orchestra.run.trial154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-21T07:29:10.530 INFO:teuthology.lock.ops:Updating trial154.front.sepia.ceph.com on lock server 2026-02-21T07:29:10.632 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:29:10.725 INFO:teuthology.dispatcher.supervisor:Running job 62267 2026-02-21T07:29:10.725 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_amathuri@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/amathuri-2026-02-21_07:25:29-crimson-rados:thrash-main-distro-debug-trial/62267 --name amathuri-2026-02-21_07:25:29-crimson-rados:thrash-main-distro-debug-trial --description crimson-rados:thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{pggrow} thrashosds-health workloads/small-objects} -- /home/teuthworker/mnt/teuthology/amathuri-2026-02-21_07:25:29-crimson-rados:thrash-main-distro-debug-trial/62267/orig.config.yaml 2026-02-21T07:29:10.725 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/amathuri-2026-02-21_07:25:29-crimson-rados:thrash-main-distro-debug-trial/62267 2026-02-21T07:29:10.725 INFO:teuthology.dispatcher.supervisor:Job PID: 2914532 2026-02-21T07:29:10.725 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-21T07:31:10.826 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:33:10.973 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:35:11.110 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:37:11.300 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:39:11.450 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:41:11.656 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:43:11.866 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:45:12.073 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:47:12.280 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:49:12.507 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:51:12.728 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:53:12.954 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:55:13.175 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:57:13.391 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T07:57:13.481 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-21T07:57:13.597 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-21T07:57:14.106 INFO:teuthology.orchestra.console.trial092:Power off 2026-02-21T07:57:14.106 DEBUG:teuthology.orchestra.console.trial092:pexpect command: ipmitool -H trial092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-21T07:57:14.115 INFO:teuthology.orchestra.console.trial154:Power off 2026-02-21T07:57:14.115 DEBUG:teuthology.orchestra.console.trial154:pexpect command: ipmitool -H trial154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-21T07:57:14.145 DEBUG:teuthology.orchestra.console.trial092:power off output: Chassis Power Control: Down/Off 2026-02-21T07:57:14.153 DEBUG:teuthology.orchestra.console.trial154:power off output: Chassis Power Control: Down/Off 2026-02-21T07:57:18.149 DEBUG:teuthology.orchestra.console.trial092:pexpect command: ipmitool -H trial092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T07:57:18.156 DEBUG:teuthology.orchestra.console.trial154:pexpect command: ipmitool -H trial154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T07:57:18.258 DEBUG:teuthology.orchestra.console.trial092:check power output: Chassis Power is on 2026-02-21T07:57:18.264 DEBUG:teuthology.orchestra.console.trial154:check power output: Chassis Power is on 2026-02-21T07:57:22.262 DEBUG:teuthology.orchestra.console.trial092:pexpect command: ipmitool -H trial092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T07:57:22.271 DEBUG:teuthology.orchestra.console.trial154:pexpect command: ipmitool -H trial154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T07:57:22.373 DEBUG:teuthology.orchestra.console.trial092:check power output: Chassis Power is off 2026-02-21T07:57:22.374 INFO:teuthology.orchestra.console.trial092:Power off completed 2026-02-21T07:57:22.380 DEBUG:teuthology.orchestra.console.trial154:check power output: Chassis Power is off 2026-02-21T07:57:22.380 INFO:teuthology.orchestra.console.trial154:Power off completed 2026-02-21T07:57:22.567 INFO:teuthology.lock.ops:unlocked: trial092.front.sepia.ceph.com 2026-02-21T07:57:22.580 INFO:teuthology.lock.ops:unlocked: trial154.front.sepia.ceph.com