2026-02-12T09:30:11.406 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062 2026-02-12T09:30:11.406 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:30:11.478 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:30:11.674 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x73e2d3171f80>, signals=[15]) 2026-02-12T09:30:11.674 INFO:teuthology.lock.ops:Start node 'trial058.front.sepia.ceph.com' reimaging 2026-02-12T09:30:11.674 INFO:teuthology.lock.ops:Updating [trial058.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T09:30:11.675 INFO:teuthology.lock.ops:Updating trial058.front.sepia.ceph.com on lock server 2026-02-12T09:30:11.730 INFO:teuthology.lock.ops:Start node 'trial086.front.sepia.ceph.com' reimaging 2026-02-12T09:30:11.730 INFO:teuthology.lock.ops:Updating [trial086.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T09:30:11.730 INFO:teuthology.lock.ops:Updating trial086.front.sepia.ceph.com on lock server 2026-02-12T09:30:11.957 DEBUG:teuthology.provision.fog.trial058:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T09:30:11.967 DEBUG:teuthology.provision.fog.trial086:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T09:30:12.009 INFO:teuthology.provision.fog.trial058:Scheduling deploy of centos 9.stream 2026-02-12T09:30:12.016 INFO:teuthology.provision.fog.trial086:Scheduling deploy of centos 9.stream 2026-02-12T09:30:13.142 INFO:teuthology.orchestra.console.trial086:Power off 2026-02-12T09:30:13.142 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T09:30:13.152 INFO:teuthology.orchestra.console.trial058:Power off 2026-02-12T09:30:13.152 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T09:30:13.180 DEBUG:teuthology.orchestra.console.trial086:power off output: Chassis Power Control: Down/Off 2026-02-12T09:30:13.189 DEBUG:teuthology.orchestra.console.trial058:power off output: Chassis Power Control: Down/Off 2026-02-12T09:30:17.185 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T09:30:17.192 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T09:30:17.294 DEBUG:teuthology.orchestra.console.trial086:check power output: Chassis Power is off 2026-02-12T09:30:17.294 INFO:teuthology.orchestra.console.trial086:Power off completed 2026-02-12T09:30:17.300 DEBUG:teuthology.orchestra.console.trial058:check power output: Chassis Power is off 2026-02-12T09:30:17.300 INFO:teuthology.orchestra.console.trial058:Power off completed 2026-02-12T09:30:17.395 INFO:teuthology.orchestra.console.trial086:Power on 2026-02-12T09:30:17.395 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T09:30:17.402 INFO:teuthology.orchestra.console.trial058:Power on 2026-02-12T09:30:17.402 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T09:30:17.433 DEBUG:teuthology.orchestra.console.trial086:power on output: Chassis Power Control: Up/On 2026-02-12T09:30:17.442 DEBUG:teuthology.orchestra.console.trial058:power on output: Chassis Power Control: Up/On 2026-02-12T09:30:21.438 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T09:30:21.445 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T09:30:21.548 DEBUG:teuthology.orchestra.console.trial086:check power output: Chassis Power is on 2026-02-12T09:30:21.548 INFO:teuthology.orchestra.console.trial086:Power on completed 2026-02-12T09:30:21.554 DEBUG:teuthology.orchestra.console.trial058:check power output: Chassis Power is on 2026-02-12T09:30:21.555 INFO:teuthology.orchestra.console.trial058:Power on completed 2026-02-12T09:30:21.649 INFO:teuthology.provision.fog.trial086:Waiting for deploy to finish 2026-02-12T09:30:21.655 INFO:teuthology.provision.fog.trial058:Waiting for deploy to finish 2026-02-12T09:32:09.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:32:09.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:32:12.125 WARNING:teuthology.provision.fog.trial086:[Errno None] Unable to connect to port 22 on 10.20.193.86 2026-02-12T09:32:12.189 WARNING:teuthology.provision.fog.trial058:[Errno None] Unable to connect to port 22 on 10.20.193.58 2026-02-12T09:32:18.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:32:18.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:32:21.213 WARNING:teuthology.provision.fog.trial086:[Errno None] Unable to connect to port 22 on 10.20.193.86 2026-02-12T09:32:21.277 WARNING:teuthology.provision.fog.trial058:[Errno None] Unable to connect to port 22 on 10.20.193.58 2026-02-12T09:32:27.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:32:27.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:32:30.301 WARNING:teuthology.provision.fog.trial086:[Errno None] Unable to connect to port 22 on 10.20.193.86 2026-02-12T09:32:30.365 WARNING:teuthology.provision.fog.trial058:[Errno None] Unable to connect to port 22 on 10.20.193.58 2026-02-12T09:32:36.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:32:36.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:32:39.389 WARNING:teuthology.provision.fog.trial086:[Errno None] Unable to connect to port 22 on 10.20.193.86 2026-02-12T09:32:39.453 WARNING:teuthology.provision.fog.trial058:[Errno None] Unable to connect to port 22 on 10.20.193.58 2026-02-12T09:32:45.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:32:45.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:33:21.603 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T09:33:21.603 DEBUG:teuthology.orchestra.run.trial086:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T09:33:21.622 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T09:33:21.622 DEBUG:teuthology.orchestra.run.trial058:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T09:33:21.799 INFO:teuthology.provision.fog.trial058:Node is ready 2026-02-12T09:33:21.799 DEBUG:teuthology.orchestra.run.trial058:> hostname 2026-02-12T09:33:21.856 INFO:teuthology.orchestra.run.trial058.stdout:trial058.front.sepia.ceph.com 2026-02-12T09:33:21.856 DEBUG:teuthology.orchestra.run.trial058:> grep trial058.front.sepia.ceph.com /etc/hosts 2026-02-12T09:33:21.902 INFO:teuthology.provision.fog.trial086:Node is ready 2026-02-12T09:33:21.902 DEBUG:teuthology.orchestra.run.trial086:> hostname 2026-02-12T09:33:21.913 INFO:teuthology.orchestra.run.trial058.stdout:10.20.193.58 trial058.front.sepia.ceph.com trial058 2026-02-12T09:33:21.913 DEBUG:teuthology.orchestra.run.trial058:> sudo hostname trial058 2026-02-12T09:33:21.959 INFO:teuthology.orchestra.run.trial086.stdout:trial086.front.sepia.ceph.com 2026-02-12T09:33:21.959 DEBUG:teuthology.orchestra.run.trial086:> grep trial086.front.sepia.ceph.com /etc/hosts 2026-02-12T09:33:21.984 DEBUG:teuthology.orchestra.run.trial058:> sudo sed -i -e 's/trial058.front.sepia.ceph.com/trial058/g' /etc/hosts 2026-02-12T09:33:22.031 INFO:teuthology.orchestra.run.trial086.stdout:10.20.193.86 trial086.front.sepia.ceph.com trial086 2026-02-12T09:33:22.032 DEBUG:teuthology.orchestra.run.trial086:> sudo hostname trial086 2026-02-12T09:33:22.051 DEBUG:teuthology.orchestra.run.trial058:> sudo sed -i -e 's/10.20.193.58/10.20.193.58/g' /etc/hosts 2026-02-12T09:33:22.106 DEBUG:teuthology.orchestra.run.trial086:> sudo sed -i -e 's/trial086.front.sepia.ceph.com/trial086/g' /etc/hosts 2026-02-12T09:33:22.117 DEBUG:teuthology.orchestra.run.trial058:> sudo sed -i -e 's/trial058.front.sepia.ceph.com/trial058/g' /etc/hostname 2026-02-12T09:33:22.174 DEBUG:teuthology.orchestra.run.trial086:> sudo sed -i -e 's/10.20.193.86/10.20.193.86/g' /etc/hosts 2026-02-12T09:33:22.182 DEBUG:teuthology.orchestra.run.trial058:> sudo hostname trial058 2026-02-12T09:33:22.244 DEBUG:teuthology.orchestra.run.trial086:> sudo sed -i -e 's/trial086.front.sepia.ceph.com/trial086/g' /etc/hostname 2026-02-12T09:33:22.249 DEBUG:teuthology.orchestra.run.trial058:> cat /etc/os-release 2026-02-12T09:33:22.305 INFO:teuthology.orchestra.run.trial058.stdout:NAME="CentOS Stream" 2026-02-12T09:33:22.305 INFO:teuthology.orchestra.run.trial058.stdout:VERSION="9" 2026-02-12T09:33:22.306 INFO:teuthology.orchestra.run.trial058.stdout:ID="centos" 2026-02-12T09:33:22.306 INFO:teuthology.orchestra.run.trial058.stdout:ID_LIKE="rhel fedora" 2026-02-12T09:33:22.306 INFO:teuthology.orchestra.run.trial058.stdout:VERSION_ID="9" 2026-02-12T09:33:22.306 INFO:teuthology.orchestra.run.trial058.stdout:PLATFORM_ID="platform:el9" 2026-02-12T09:33:22.306 INFO:teuthology.orchestra.run.trial058.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T09:33:22.306 INFO:teuthology.orchestra.run.trial058.stdout:ANSI_COLOR="0;31" 2026-02-12T09:33:22.306 INFO:teuthology.orchestra.run.trial058.stdout:LOGO="fedora-logo-icon" 2026-02-12T09:33:22.306 INFO:teuthology.orchestra.run.trial058.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T09:33:22.306 INFO:teuthology.orchestra.run.trial058.stdout:HOME_URL="https://centos.org/" 2026-02-12T09:33:22.306 INFO:teuthology.orchestra.run.trial058.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T09:33:22.307 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T09:33:22.307 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T09:33:22.308 INFO:teuthology.provision.fog.trial058:Deploy complete! 2026-02-12T09:33:22.309 DEBUG:teuthology.parallel:result is None 2026-02-12T09:33:22.314 DEBUG:teuthology.orchestra.run.trial086:> sudo hostname trial086 2026-02-12T09:33:22.382 DEBUG:teuthology.orchestra.run.trial086:> cat /etc/os-release 2026-02-12T09:33:22.442 INFO:teuthology.orchestra.run.trial086.stdout:NAME="CentOS Stream" 2026-02-12T09:33:22.442 INFO:teuthology.orchestra.run.trial086.stdout:VERSION="9" 2026-02-12T09:33:22.442 INFO:teuthology.orchestra.run.trial086.stdout:ID="centos" 2026-02-12T09:33:22.443 INFO:teuthology.orchestra.run.trial086.stdout:ID_LIKE="rhel fedora" 2026-02-12T09:33:22.443 INFO:teuthology.orchestra.run.trial086.stdout:VERSION_ID="9" 2026-02-12T09:33:22.443 INFO:teuthology.orchestra.run.trial086.stdout:PLATFORM_ID="platform:el9" 2026-02-12T09:33:22.443 INFO:teuthology.orchestra.run.trial086.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T09:33:22.443 INFO:teuthology.orchestra.run.trial086.stdout:ANSI_COLOR="0;31" 2026-02-12T09:33:22.443 INFO:teuthology.orchestra.run.trial086.stdout:LOGO="fedora-logo-icon" 2026-02-12T09:33:22.443 INFO:teuthology.orchestra.run.trial086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T09:33:22.443 INFO:teuthology.orchestra.run.trial086.stdout:HOME_URL="https://centos.org/" 2026-02-12T09:33:22.443 INFO:teuthology.orchestra.run.trial086.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T09:33:22.443 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T09:33:22.443 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T09:33:22.444 INFO:teuthology.provision.fog.trial086:Deploy complete! 2026-02-12T09:33:22.445 DEBUG:teuthology.parallel:result is None 2026-02-12T09:33:22.841 INFO:teuthology.lock.ops:Checking trial058.front.sepia.ceph.com 2026-02-12T09:33:22.841 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T09:33:22.932 INFO:teuthology.lock.ops:Checking trial086.front.sepia.ceph.com 2026-02-12T09:33:22.932 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T09:33:22.993 INFO:teuthology.lock.ops:Updating [trial058.front.sepia.ceph.com]: set os type and version on server 2026-02-12T09:33:22.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial058.front.sepia.ceph.com' 2026-02-12T09:33:22.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:33:23.053 DEBUG:teuthology.orchestra.run.trial058:> true 2026-02-12T09:33:23.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial058.front.sepia.ceph.com' 2026-02-12T09:33:23.130 DEBUG:teuthology.orchestra.run.trial058:> uname -m 2026-02-12T09:33:23.186 INFO:teuthology.orchestra.run.trial058.stdout:x86_64 2026-02-12T09:33:23.186 DEBUG:teuthology.orchestra.run.trial058:> cat /etc/os-release 2026-02-12T09:33:23.242 INFO:teuthology.orchestra.run.trial058.stdout:NAME="CentOS Stream" 2026-02-12T09:33:23.242 INFO:teuthology.orchestra.run.trial058.stdout:VERSION="9" 2026-02-12T09:33:23.242 INFO:teuthology.orchestra.run.trial058.stdout:ID="centos" 2026-02-12T09:33:23.242 INFO:teuthology.orchestra.run.trial058.stdout:ID_LIKE="rhel fedora" 2026-02-12T09:33:23.242 INFO:teuthology.orchestra.run.trial058.stdout:VERSION_ID="9" 2026-02-12T09:33:23.243 INFO:teuthology.orchestra.run.trial058.stdout:PLATFORM_ID="platform:el9" 2026-02-12T09:33:23.243 INFO:teuthology.orchestra.run.trial058.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T09:33:23.243 INFO:teuthology.orchestra.run.trial058.stdout:ANSI_COLOR="0;31" 2026-02-12T09:33:23.243 INFO:teuthology.orchestra.run.trial058.stdout:LOGO="fedora-logo-icon" 2026-02-12T09:33:23.243 INFO:teuthology.orchestra.run.trial058.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T09:33:23.243 INFO:teuthology.orchestra.run.trial058.stdout:HOME_URL="https://centos.org/" 2026-02-12T09:33:23.243 INFO:teuthology.orchestra.run.trial058.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T09:33:23.243 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T09:33:23.243 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T09:33:23.244 INFO:teuthology.lock.ops:Updating trial058.front.sepia.ceph.com on lock server 2026-02-12T09:33:23.315 INFO:teuthology.lock.ops:Updating [trial086.front.sepia.ceph.com]: set os type and version on server 2026-02-12T09:33:23.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-12T09:33:23.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:33:23.382 DEBUG:teuthology.orchestra.run.trial086:> true 2026-02-12T09:33:23.455 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-12T09:33:23.455 DEBUG:teuthology.orchestra.run.trial086:> uname -m 2026-02-12T09:33:23.515 INFO:teuthology.orchestra.run.trial086.stdout:x86_64 2026-02-12T09:33:23.515 DEBUG:teuthology.orchestra.run.trial086:> cat /etc/os-release 2026-02-12T09:33:23.574 INFO:teuthology.orchestra.run.trial086.stdout:NAME="CentOS Stream" 2026-02-12T09:33:23.575 INFO:teuthology.orchestra.run.trial086.stdout:VERSION="9" 2026-02-12T09:33:23.575 INFO:teuthology.orchestra.run.trial086.stdout:ID="centos" 2026-02-12T09:33:23.575 INFO:teuthology.orchestra.run.trial086.stdout:ID_LIKE="rhel fedora" 2026-02-12T09:33:23.575 INFO:teuthology.orchestra.run.trial086.stdout:VERSION_ID="9" 2026-02-12T09:33:23.575 INFO:teuthology.orchestra.run.trial086.stdout:PLATFORM_ID="platform:el9" 2026-02-12T09:33:23.575 INFO:teuthology.orchestra.run.trial086.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T09:33:23.575 INFO:teuthology.orchestra.run.trial086.stdout:ANSI_COLOR="0;31" 2026-02-12T09:33:23.575 INFO:teuthology.orchestra.run.trial086.stdout:LOGO="fedora-logo-icon" 2026-02-12T09:33:23.575 INFO:teuthology.orchestra.run.trial086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T09:33:23.575 INFO:teuthology.orchestra.run.trial086.stdout:HOME_URL="https://centos.org/" 2026-02-12T09:33:23.576 INFO:teuthology.orchestra.run.trial086.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T09:33:23.576 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T09:33:23.576 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T09:33:23.576 INFO:teuthology.lock.ops:Updating trial086.front.sepia.ceph.com on lock server 2026-02-12T09:33:23.682 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:33:23.781 INFO:teuthology.dispatcher.supervisor:Running job 41681 2026-02-12T09:33:23.781 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/bin/teuthology -v --owner scheduled_matan@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41681 --name matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{default} thrashosds-health workloads/snaps-few-objects-localized} -- /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41681/orig.config.yaml 2026-02-12T09:33:23.782 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41681 2026-02-12T09:33:23.782 INFO:teuthology.dispatcher.supervisor:Job PID: 3479903 2026-02-12T09:33:23.782 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-12T09:35:23.882 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:37:24.061 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:39:24.162 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:41:24.329 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:43:24.533 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:45:24.735 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:47:24.933 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:49:25.148 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:51:25.321 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:53:25.515 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:55:25.631 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:57:25.798 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:59:25.955 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:01:26.157 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:03:26.361 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:05:26.568 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:07:26.758 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:09:26.899 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:11:27.112 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:13:27.320 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:15:27.533 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:17:27.718 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:19:27.920 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:21:28.131 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:21:28.220 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-12T10:21:28.334 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-12T10:21:28.850 INFO:teuthology.orchestra.console.trial086:Power off 2026-02-12T10:21:28.850 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T10:21:28.862 INFO:teuthology.orchestra.console.trial058:Power off 2026-02-12T10:21:28.862 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T10:21:28.889 DEBUG:teuthology.orchestra.console.trial086:power off output: Chassis Power Control: Down/Off 2026-02-12T10:21:28.899 DEBUG:teuthology.orchestra.console.trial058:power off output: Chassis Power Control: Down/Off 2026-02-12T10:21:32.894 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:21:32.901 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:21:33.003 DEBUG:teuthology.orchestra.console.trial086:check power output: Chassis Power is on 2026-02-12T10:21:33.009 DEBUG:teuthology.orchestra.console.trial058:check power output: Chassis Power is on 2026-02-12T10:21:37.009 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:21:37.017 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:21:37.119 DEBUG:teuthology.orchestra.console.trial086:check power output: Chassis Power is off 2026-02-12T10:21:37.119 INFO:teuthology.orchestra.console.trial086:Power off completed 2026-02-12T10:21:37.126 DEBUG:teuthology.orchestra.console.trial058:check power output: Chassis Power is off 2026-02-12T10:21:37.126 INFO:teuthology.orchestra.console.trial058:Power off completed 2026-02-12T10:21:37.364 INFO:teuthology.lock.ops:unlocked: trial086.front.sepia.ceph.com 2026-02-12T10:21:37.376 INFO:teuthology.lock.ops:unlocked: trial058.front.sepia.ceph.com