2026-02-12T10:29:11.246 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062 2026-02-12T10:29:11.246 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:29:11.317 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:29:11.687 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7013ccf911c0>, signals=[15]) 2026-02-12T10:29:11.687 INFO:teuthology.lock.ops:Start node 'trial050.front.sepia.ceph.com' reimaging 2026-02-12T10:29:11.687 INFO:teuthology.lock.ops:Updating [trial050.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T10:29:11.687 INFO:teuthology.lock.ops:Updating trial050.front.sepia.ceph.com on lock server 2026-02-12T10:29:11.892 INFO:teuthology.lock.ops:Start node 'trial149.front.sepia.ceph.com' reimaging 2026-02-12T10:29:11.892 INFO:teuthology.lock.ops:Updating [trial149.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T10:29:11.893 INFO:teuthology.lock.ops:Updating trial149.front.sepia.ceph.com on lock server 2026-02-12T10:29:12.107 DEBUG:teuthology.provision.fog.trial050:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T10:29:12.180 INFO:teuthology.provision.fog.trial050:Scheduling deploy of centos 9.stream 2026-02-12T10:29:12.181 DEBUG:teuthology.provision.fog.trial149:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T10:29:12.247 INFO:teuthology.provision.fog.trial149:Scheduling deploy of centos 9.stream 2026-02-12T10:29:13.336 INFO:teuthology.orchestra.console.trial050:Power off 2026-02-12T10:29:13.336 DEBUG:teuthology.orchestra.console.trial050:pexpect command: ipmitool -H trial050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T10:29:13.355 INFO:teuthology.orchestra.console.trial149:Power off 2026-02-12T10:29:13.355 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T10:29:13.375 DEBUG:teuthology.orchestra.console.trial050:power off output: Chassis Power Control: Down/Off 2026-02-12T10:29:13.393 DEBUG:teuthology.orchestra.console.trial149:power off output: Chassis Power Control: Down/Off 2026-02-12T10:29:17.380 DEBUG:teuthology.orchestra.console.trial050:pexpect command: ipmitool -H trial050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:29:17.394 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:29:17.491 DEBUG:teuthology.orchestra.console.trial050:check power output: Chassis Power is off 2026-02-12T10:29:17.491 INFO:teuthology.orchestra.console.trial050:Power off completed 2026-02-12T10:29:17.502 DEBUG:teuthology.orchestra.console.trial149:check power output: Chassis Power is off 2026-02-12T10:29:17.502 INFO:teuthology.orchestra.console.trial149:Power off completed 2026-02-12T10:29:17.593 INFO:teuthology.orchestra.console.trial050:Power on 2026-02-12T10:29:17.593 DEBUG:teuthology.orchestra.console.trial050:pexpect command: ipmitool -H trial050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T10:29:17.603 INFO:teuthology.orchestra.console.trial149:Power on 2026-02-12T10:29:17.604 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T10:29:17.633 DEBUG:teuthology.orchestra.console.trial050:power on output: Chassis Power Control: Up/On 2026-02-12T10:29:17.644 DEBUG:teuthology.orchestra.console.trial149:power on output: Chassis Power Control: Up/On 2026-02-12T10:29:21.637 DEBUG:teuthology.orchestra.console.trial050:pexpect command: ipmitool -H trial050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:29:21.644 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:29:21.747 DEBUG:teuthology.orchestra.console.trial050:check power output: Chassis Power is on 2026-02-12T10:29:21.747 INFO:teuthology.orchestra.console.trial050:Power on completed 2026-02-12T10:29:21.754 DEBUG:teuthology.orchestra.console.trial149:check power output: Chassis Power is on 2026-02-12T10:29:21.754 INFO:teuthology.orchestra.console.trial149:Power on completed 2026-02-12T10:29:21.848 INFO:teuthology.provision.fog.trial050:Waiting for deploy to finish 2026-02-12T10:29:21.855 INFO:teuthology.provision.fog.trial149:Waiting for deploy to finish 2026-02-12T10:31:09.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:31:09.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:31:12.093 WARNING:teuthology.provision.fog.trial050:[Errno None] Unable to connect to port 22 on 10.20.193.50 2026-02-12T10:31:12.093 WARNING:teuthology.provision.fog.trial149:[Errno None] Unable to connect to port 22 on 10.20.193.149 2026-02-12T10:31:18.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:31:18.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:31:21.181 WARNING:teuthology.provision.fog.trial050:[Errno None] Unable to connect to port 22 on 10.20.193.50 2026-02-12T10:31:21.181 WARNING:teuthology.provision.fog.trial149:[Errno None] Unable to connect to port 22 on 10.20.193.149 2026-02-12T10:31:27.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:31:27.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:31:30.269 WARNING:teuthology.provision.fog.trial050:[Errno None] Unable to connect to port 22 on 10.20.193.50 2026-02-12T10:31:30.269 WARNING:teuthology.provision.fog.trial149:[Errno None] Unable to connect to port 22 on 10.20.193.149 2026-02-12T10:31:36.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:31:36.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:31:39.357 WARNING:teuthology.provision.fog.trial050:[Errno None] Unable to connect to port 22 on 10.20.193.50 2026-02-12T10:31:39.357 WARNING:teuthology.provision.fog.trial149:[Errno None] Unable to connect to port 22 on 10.20.193.149 2026-02-12T10:31:45.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:31:45.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:32:21.552 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T10:32:21.552 DEBUG:teuthology.orchestra.run.trial050:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T10:32:21.553 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T10:32:21.553 DEBUG:teuthology.orchestra.run.trial149:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T10:32:21.781 INFO:teuthology.provision.fog.trial149:Node is ready 2026-02-12T10:32:21.781 DEBUG:teuthology.orchestra.run.trial149:> hostname 2026-02-12T10:32:21.836 INFO:teuthology.orchestra.run.trial149.stdout:trial149.front.sepia.ceph.com 2026-02-12T10:32:21.836 DEBUG:teuthology.orchestra.run.trial149:> grep trial149.front.sepia.ceph.com /etc/hosts 2026-02-12T10:32:21.892 INFO:teuthology.orchestra.run.trial149.stdout:10.20.193.149 trial149.front.sepia.ceph.com trial149 2026-02-12T10:32:21.892 DEBUG:teuthology.orchestra.run.trial149:> sudo hostname trial149 2026-02-12T10:32:21.962 DEBUG:teuthology.orchestra.run.trial149:> sudo sed -i -e 's/trial149.front.sepia.ceph.com/trial149/g' /etc/hosts 2026-02-12T10:32:22.028 DEBUG:teuthology.orchestra.run.trial149:> sudo sed -i -e 's/10.20.193.149/10.20.193.149/g' /etc/hosts 2026-02-12T10:32:22.094 DEBUG:teuthology.orchestra.run.trial149:> sudo sed -i -e 's/trial149.front.sepia.ceph.com/trial149/g' /etc/hostname 2026-02-12T10:32:22.159 DEBUG:teuthology.orchestra.run.trial149:> sudo hostname trial149 2026-02-12T10:32:22.224 DEBUG:teuthology.orchestra.run.trial149:> cat /etc/os-release 2026-02-12T10:32:22.279 INFO:teuthology.orchestra.run.trial149.stdout:NAME="CentOS Stream" 2026-02-12T10:32:22.279 INFO:teuthology.orchestra.run.trial149.stdout:VERSION="9" 2026-02-12T10:32:22.279 INFO:teuthology.orchestra.run.trial149.stdout:ID="centos" 2026-02-12T10:32:22.279 INFO:teuthology.orchestra.run.trial149.stdout:ID_LIKE="rhel fedora" 2026-02-12T10:32:22.279 INFO:teuthology.orchestra.run.trial149.stdout:VERSION_ID="9" 2026-02-12T10:32:22.279 INFO:teuthology.orchestra.run.trial149.stdout:PLATFORM_ID="platform:el9" 2026-02-12T10:32:22.279 INFO:teuthology.orchestra.run.trial149.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T10:32:22.279 INFO:teuthology.orchestra.run.trial149.stdout:ANSI_COLOR="0;31" 2026-02-12T10:32:22.279 INFO:teuthology.orchestra.run.trial149.stdout:LOGO="fedora-logo-icon" 2026-02-12T10:32:22.279 INFO:teuthology.orchestra.run.trial149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T10:32:22.279 INFO:teuthology.orchestra.run.trial149.stdout:HOME_URL="https://centos.org/" 2026-02-12T10:32:22.279 INFO:teuthology.orchestra.run.trial149.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T10:32:22.279 INFO:teuthology.orchestra.run.trial149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T10:32:22.279 INFO:teuthology.orchestra.run.trial149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T10:32:22.280 INFO:teuthology.provision.fog.trial149:Deploy complete! 2026-02-12T10:32:22.280 DEBUG:teuthology.parallel:result is None 2026-02-12T10:32:26.613 INFO:teuthology.provision.fog.trial050:Node is ready 2026-02-12T10:32:26.613 DEBUG:teuthology.orchestra.run.trial050:> hostname 2026-02-12T10:32:26.630 INFO:teuthology.orchestra.run.trial050.stdout:trial050.front.sepia.ceph.com 2026-02-12T10:32:26.631 DEBUG:teuthology.orchestra.run.trial050:> grep trial050.front.sepia.ceph.com /etc/hosts 2026-02-12T10:32:26.687 INFO:teuthology.orchestra.run.trial050.stdout:10.20.193.50 trial050.front.sepia.ceph.com trial050 2026-02-12T10:32:26.687 DEBUG:teuthology.orchestra.run.trial050:> sudo hostname trial050 2026-02-12T10:32:26.757 DEBUG:teuthology.orchestra.run.trial050:> sudo sed -i -e 's/trial050.front.sepia.ceph.com/trial050/g' /etc/hosts 2026-02-12T10:32:26.822 DEBUG:teuthology.orchestra.run.trial050:> sudo sed -i -e 's/10.20.193.50/10.20.193.50/g' /etc/hosts 2026-02-12T10:32:26.887 DEBUG:teuthology.orchestra.run.trial050:> sudo sed -i -e 's/trial050.front.sepia.ceph.com/trial050/g' /etc/hostname 2026-02-12T10:32:26.950 DEBUG:teuthology.orchestra.run.trial050:> sudo hostname trial050 2026-02-12T10:32:27.015 DEBUG:teuthology.orchestra.run.trial050:> cat /etc/os-release 2026-02-12T10:32:27.071 INFO:teuthology.orchestra.run.trial050.stdout:NAME="CentOS Stream" 2026-02-12T10:32:27.071 INFO:teuthology.orchestra.run.trial050.stdout:VERSION="9" 2026-02-12T10:32:27.071 INFO:teuthology.orchestra.run.trial050.stdout:ID="centos" 2026-02-12T10:32:27.071 INFO:teuthology.orchestra.run.trial050.stdout:ID_LIKE="rhel fedora" 2026-02-12T10:32:27.071 INFO:teuthology.orchestra.run.trial050.stdout:VERSION_ID="9" 2026-02-12T10:32:27.072 INFO:teuthology.orchestra.run.trial050.stdout:PLATFORM_ID="platform:el9" 2026-02-12T10:32:27.072 INFO:teuthology.orchestra.run.trial050.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T10:32:27.072 INFO:teuthology.orchestra.run.trial050.stdout:ANSI_COLOR="0;31" 2026-02-12T10:32:27.072 INFO:teuthology.orchestra.run.trial050.stdout:LOGO="fedora-logo-icon" 2026-02-12T10:32:27.072 INFO:teuthology.orchestra.run.trial050.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T10:32:27.072 INFO:teuthology.orchestra.run.trial050.stdout:HOME_URL="https://centos.org/" 2026-02-12T10:32:27.072 INFO:teuthology.orchestra.run.trial050.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T10:32:27.072 INFO:teuthology.orchestra.run.trial050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T10:32:27.072 INFO:teuthology.orchestra.run.trial050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T10:32:27.073 INFO:teuthology.provision.fog.trial050:Deploy complete! 2026-02-12T10:32:27.074 DEBUG:teuthology.parallel:result is None 2026-02-12T10:32:27.474 INFO:teuthology.lock.ops:Checking trial050.front.sepia.ceph.com 2026-02-12T10:32:27.474 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T10:32:27.580 INFO:teuthology.lock.ops:Checking trial149.front.sepia.ceph.com 2026-02-12T10:32:27.580 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T10:32:27.643 INFO:teuthology.lock.ops:Updating [trial050.front.sepia.ceph.com]: set os type and version on server 2026-02-12T10:32:27.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial050.front.sepia.ceph.com' 2026-02-12T10:32:27.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:32:27.704 DEBUG:teuthology.orchestra.run.trial050:> true 2026-02-12T10:32:27.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial050.front.sepia.ceph.com' 2026-02-12T10:32:27.778 DEBUG:teuthology.orchestra.run.trial050:> uname -m 2026-02-12T10:32:27.834 INFO:teuthology.orchestra.run.trial050.stdout:x86_64 2026-02-12T10:32:27.834 DEBUG:teuthology.orchestra.run.trial050:> cat /etc/os-release 2026-02-12T10:32:27.890 INFO:teuthology.orchestra.run.trial050.stdout:NAME="CentOS Stream" 2026-02-12T10:32:27.891 INFO:teuthology.orchestra.run.trial050.stdout:VERSION="9" 2026-02-12T10:32:27.891 INFO:teuthology.orchestra.run.trial050.stdout:ID="centos" 2026-02-12T10:32:27.891 INFO:teuthology.orchestra.run.trial050.stdout:ID_LIKE="rhel fedora" 2026-02-12T10:32:27.891 INFO:teuthology.orchestra.run.trial050.stdout:VERSION_ID="9" 2026-02-12T10:32:27.891 INFO:teuthology.orchestra.run.trial050.stdout:PLATFORM_ID="platform:el9" 2026-02-12T10:32:27.891 INFO:teuthology.orchestra.run.trial050.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T10:32:27.891 INFO:teuthology.orchestra.run.trial050.stdout:ANSI_COLOR="0;31" 2026-02-12T10:32:27.891 INFO:teuthology.orchestra.run.trial050.stdout:LOGO="fedora-logo-icon" 2026-02-12T10:32:27.891 INFO:teuthology.orchestra.run.trial050.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T10:32:27.891 INFO:teuthology.orchestra.run.trial050.stdout:HOME_URL="https://centos.org/" 2026-02-12T10:32:27.891 INFO:teuthology.orchestra.run.trial050.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T10:32:27.892 INFO:teuthology.orchestra.run.trial050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T10:32:27.892 INFO:teuthology.orchestra.run.trial050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T10:32:27.892 INFO:teuthology.lock.ops:Updating trial050.front.sepia.ceph.com on lock server 2026-02-12T10:32:27.996 INFO:teuthology.lock.ops:Updating [trial149.front.sepia.ceph.com]: set os type and version on server 2026-02-12T10:32:27.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T10:32:27.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:32:28.064 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T10:32:28.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T10:32:28.137 DEBUG:teuthology.orchestra.run.trial149:> uname -m 2026-02-12T10:32:28.193 INFO:teuthology.orchestra.run.trial149.stdout:x86_64 2026-02-12T10:32:28.194 DEBUG:teuthology.orchestra.run.trial149:> cat /etc/os-release 2026-02-12T10:32:28.249 INFO:teuthology.orchestra.run.trial149.stdout:NAME="CentOS Stream" 2026-02-12T10:32:28.250 INFO:teuthology.orchestra.run.trial149.stdout:VERSION="9" 2026-02-12T10:32:28.250 INFO:teuthology.orchestra.run.trial149.stdout:ID="centos" 2026-02-12T10:32:28.250 INFO:teuthology.orchestra.run.trial149.stdout:ID_LIKE="rhel fedora" 2026-02-12T10:32:28.250 INFO:teuthology.orchestra.run.trial149.stdout:VERSION_ID="9" 2026-02-12T10:32:28.250 INFO:teuthology.orchestra.run.trial149.stdout:PLATFORM_ID="platform:el9" 2026-02-12T10:32:28.250 INFO:teuthology.orchestra.run.trial149.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T10:32:28.250 INFO:teuthology.orchestra.run.trial149.stdout:ANSI_COLOR="0;31" 2026-02-12T10:32:28.250 INFO:teuthology.orchestra.run.trial149.stdout:LOGO="fedora-logo-icon" 2026-02-12T10:32:28.250 INFO:teuthology.orchestra.run.trial149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T10:32:28.251 INFO:teuthology.orchestra.run.trial149.stdout:HOME_URL="https://centos.org/" 2026-02-12T10:32:28.251 INFO:teuthology.orchestra.run.trial149.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T10:32:28.251 INFO:teuthology.orchestra.run.trial149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T10:32:28.251 INFO:teuthology.orchestra.run.trial149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T10:32:28.251 INFO:teuthology.lock.ops:Updating trial149.front.sepia.ceph.com on lock server 2026-02-12T10:32:28.355 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:32:28.448 INFO:teuthology.dispatcher.supervisor:Running job 41798 2026-02-12T10:32:28.448 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/bin/teuthology -v --owner scheduled_matan@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41798 --name matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{default} thrashosds-health workloads/snaps-few-objects-balanced} -- /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41798/orig.config.yaml 2026-02-12T10:32:28.448 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41798 2026-02-12T10:32:28.448 INFO:teuthology.dispatcher.supervisor:Job PID: 3651414 2026-02-12T10:32:28.448 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-12T10:34:28.521 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:36:28.713 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:38:28.882 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:40:29.080 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:42:29.290 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:44:29.431 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:46:29.636 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:48:29.802 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:50:29.981 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:52:30.156 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:54:30.328 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:56:30.541 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:58:30.768 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:00:30.960 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:02:31.144 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:04:31.343 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:06:31.529 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:08:31.710 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:10:31.916 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:12:32.088 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:14:32.271 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:16:32.381 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:18:32.528 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:18:32.615 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-12T11:18:32.735 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-12T11:18:33.262 INFO:teuthology.orchestra.console.trial050:Power off 2026-02-12T11:18:33.262 DEBUG:teuthology.orchestra.console.trial050:pexpect command: ipmitool -H trial050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T11:18:33.275 INFO:teuthology.orchestra.console.trial149:Power off 2026-02-12T11:18:33.275 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T11:18:33.302 DEBUG:teuthology.orchestra.console.trial050:power off output: Chassis Power Control: Down/Off 2026-02-12T11:18:33.314 DEBUG:teuthology.orchestra.console.trial149:power off output: Chassis Power Control: Down/Off 2026-02-12T11:18:37.307 DEBUG:teuthology.orchestra.console.trial050:pexpect command: ipmitool -H trial050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T11:18:37.314 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T11:18:37.416 DEBUG:teuthology.orchestra.console.trial050:check power output: Chassis Power is on 2026-02-12T11:18:37.423 DEBUG:teuthology.orchestra.console.trial149:check power output: Chassis Power is on 2026-02-12T11:18:41.421 DEBUG:teuthology.orchestra.console.trial050:pexpect command: ipmitool -H trial050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T11:18:41.429 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T11:18:41.531 DEBUG:teuthology.orchestra.console.trial050:check power output: Chassis Power is off 2026-02-12T11:18:41.532 INFO:teuthology.orchestra.console.trial050:Power off completed 2026-02-12T11:18:41.540 DEBUG:teuthology.orchestra.console.trial149:check power output: Chassis Power is off 2026-02-12T11:18:41.540 INFO:teuthology.orchestra.console.trial149:Power off completed 2026-02-12T11:18:41.766 INFO:teuthology.lock.ops:unlocked: trial050.front.sepia.ceph.com 2026-02-12T11:18:41.781 INFO:teuthology.lock.ops:unlocked: trial149.front.sepia.ceph.com