2026-02-12T09:44:02.884 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062 2026-02-12T09:44:02.884 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:44:02.956 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:44:03.148 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7039e7d7f2e0>, signals=[15]) 2026-02-12T09:44:03.148 INFO:teuthology.lock.ops:Start node 'trial183.front.sepia.ceph.com' reimaging 2026-02-12T09:44:03.149 INFO:teuthology.lock.ops:Updating [trial183.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T09:44:03.149 INFO:teuthology.lock.ops:Updating trial183.front.sepia.ceph.com on lock server 2026-02-12T09:44:03.206 INFO:teuthology.lock.ops:Start node 'trial193.front.sepia.ceph.com' reimaging 2026-02-12T09:44:03.206 INFO:teuthology.lock.ops:Updating [trial193.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T09:44:03.206 INFO:teuthology.lock.ops:Updating trial193.front.sepia.ceph.com on lock server 2026-02-12T09:44:03.432 DEBUG:teuthology.provision.fog.trial183:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T09:44:03.445 DEBUG:teuthology.provision.fog.trial193:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T09:44:03.483 INFO:teuthology.provision.fog.trial183:Scheduling deploy of centos 9.stream 2026-02-12T09:44:03.496 INFO:teuthology.provision.fog.trial193:Scheduling deploy of centos 9.stream 2026-02-12T09:44:04.725 INFO:teuthology.orchestra.console.trial193:Power off 2026-02-12T09:44:04.725 DEBUG:teuthology.orchestra.console.trial193:pexpect command: ipmitool -H trial193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T09:44:04.746 INFO:teuthology.orchestra.console.trial183:Power off 2026-02-12T09:44:04.746 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T09:44:04.764 DEBUG:teuthology.orchestra.console.trial193:power off output: Chassis Power Control: Down/Off 2026-02-12T09:44:04.784 DEBUG:teuthology.orchestra.console.trial183:power off output: Chassis Power Control: Down/Off 2026-02-12T09:44:08.769 DEBUG:teuthology.orchestra.console.trial193:pexpect command: ipmitool -H trial193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T09:44:08.785 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T09:44:08.879 DEBUG:teuthology.orchestra.console.trial193:check power output: Chassis Power is off 2026-02-12T09:44:08.879 INFO:teuthology.orchestra.console.trial193:Power off completed 2026-02-12T09:44:08.892 DEBUG:teuthology.orchestra.console.trial183:check power output: Chassis Power is off 2026-02-12T09:44:08.892 INFO:teuthology.orchestra.console.trial183:Power off completed 2026-02-12T09:44:08.980 INFO:teuthology.orchestra.console.trial193:Power on 2026-02-12T09:44:08.980 DEBUG:teuthology.orchestra.console.trial193:pexpect command: ipmitool -H trial193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T09:44:08.993 INFO:teuthology.orchestra.console.trial183:Power on 2026-02-12T09:44:08.994 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T09:44:09.022 DEBUG:teuthology.orchestra.console.trial193:power on output: Chassis Power Control: Up/On 2026-02-12T09:44:09.032 DEBUG:teuthology.orchestra.console.trial183:power on output: Chassis Power Control: Up/On 2026-02-12T09:44:13.027 DEBUG:teuthology.orchestra.console.trial193:pexpect command: ipmitool -H trial193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T09:44:13.036 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T09:44:13.138 DEBUG:teuthology.orchestra.console.trial193:check power output: Chassis Power is on 2026-02-12T09:44:13.139 INFO:teuthology.orchestra.console.trial193:Power on completed 2026-02-12T09:44:13.145 DEBUG:teuthology.orchestra.console.trial183:check power output: Chassis Power is on 2026-02-12T09:44:13.145 INFO:teuthology.orchestra.console.trial183:Power on completed 2026-02-12T09:44:13.240 INFO:teuthology.provision.fog.trial193:Waiting for deploy to finish 2026-02-12T09:44:13.245 INFO:teuthology.provision.fog.trial183:Waiting for deploy to finish 2026-02-12T09:46:00.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:46:00.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:46:03.549 WARNING:teuthology.provision.fog.trial183:[Errno None] Unable to connect to port 22 on 10.20.193.183 2026-02-12T09:46:03.549 WARNING:teuthology.provision.fog.trial193:[Errno None] Unable to connect to port 22 on 10.20.193.193 2026-02-12T09:46:09.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:46:09.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:46:12.637 WARNING:teuthology.provision.fog.trial193:[Errno None] Unable to connect to port 22 on 10.20.193.193 2026-02-12T09:46:12.637 WARNING:teuthology.provision.fog.trial183:[Errno None] Unable to connect to port 22 on 10.20.193.183 2026-02-12T09:46:18.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:46:18.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:46:21.725 WARNING:teuthology.provision.fog.trial193:[Errno None] Unable to connect to port 22 on 10.20.193.193 2026-02-12T09:46:21.725 WARNING:teuthology.provision.fog.trial183:[Errno None] Unable to connect to port 22 on 10.20.193.183 2026-02-12T09:46:27.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:46:27.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:46:30.813 WARNING:teuthology.provision.fog.trial193:[Errno None] Unable to connect to port 22 on 10.20.193.193 2026-02-12T09:46:30.813 WARNING:teuthology.provision.fog.trial183:[Errno None] Unable to connect to port 22 on 10.20.193.183 2026-02-12T09:46:36.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:46:36.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:47:13.099 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T09:47:13.099 DEBUG:teuthology.orchestra.run.trial183:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T09:47:13.100 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T09:47:13.100 DEBUG:teuthology.orchestra.run.trial193:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T09:47:13.270 INFO:teuthology.provision.fog.trial183:Node is ready 2026-02-12T09:47:13.270 DEBUG:teuthology.orchestra.run.trial183:> hostname 2026-02-12T09:47:13.326 INFO:teuthology.orchestra.run.trial183.stdout:trial183.front.sepia.ceph.com 2026-02-12T09:47:13.327 DEBUG:teuthology.orchestra.run.trial183:> grep trial183.front.sepia.ceph.com /etc/hosts 2026-02-12T09:47:13.382 INFO:teuthology.orchestra.run.trial183.stdout:10.20.193.183 trial183.front.sepia.ceph.com trial183 2026-02-12T09:47:13.383 DEBUG:teuthology.orchestra.run.trial183:> sudo hostname trial183 2026-02-12T09:47:13.452 DEBUG:teuthology.orchestra.run.trial183:> sudo sed -i -e 's/trial183.front.sepia.ceph.com/trial183/g' /etc/hosts 2026-02-12T09:47:13.517 DEBUG:teuthology.orchestra.run.trial183:> sudo sed -i -e 's/10.20.193.183/10.20.193.183/g' /etc/hosts 2026-02-12T09:47:13.596 DEBUG:teuthology.orchestra.run.trial183:> sudo sed -i -e 's/trial183.front.sepia.ceph.com/trial183/g' /etc/hostname 2026-02-12T09:47:13.662 DEBUG:teuthology.orchestra.run.trial183:> sudo hostname trial183 2026-02-12T09:47:13.725 DEBUG:teuthology.orchestra.run.trial183:> cat /etc/os-release 2026-02-12T09:47:13.782 INFO:teuthology.orchestra.run.trial183.stdout:NAME="CentOS Stream" 2026-02-12T09:47:13.782 INFO:teuthology.orchestra.run.trial183.stdout:VERSION="9" 2026-02-12T09:47:13.782 INFO:teuthology.orchestra.run.trial183.stdout:ID="centos" 2026-02-12T09:47:13.782 INFO:teuthology.orchestra.run.trial183.stdout:ID_LIKE="rhel fedora" 2026-02-12T09:47:13.782 INFO:teuthology.orchestra.run.trial183.stdout:VERSION_ID="9" 2026-02-12T09:47:13.782 INFO:teuthology.orchestra.run.trial183.stdout:PLATFORM_ID="platform:el9" 2026-02-12T09:47:13.782 INFO:teuthology.orchestra.run.trial183.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T09:47:13.783 INFO:teuthology.orchestra.run.trial183.stdout:ANSI_COLOR="0;31" 2026-02-12T09:47:13.783 INFO:teuthology.orchestra.run.trial183.stdout:LOGO="fedora-logo-icon" 2026-02-12T09:47:13.783 INFO:teuthology.orchestra.run.trial183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T09:47:13.783 INFO:teuthology.orchestra.run.trial183.stdout:HOME_URL="https://centos.org/" 2026-02-12T09:47:13.783 INFO:teuthology.orchestra.run.trial183.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T09:47:13.783 INFO:teuthology.orchestra.run.trial183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T09:47:13.783 INFO:teuthology.orchestra.run.trial183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T09:47:13.784 INFO:teuthology.provision.fog.trial183:Deploy complete! 2026-02-12T09:47:13.785 DEBUG:teuthology.parallel:result is None 2026-02-12T09:47:18.407 INFO:teuthology.provision.fog.trial193:Node is ready 2026-02-12T09:47:18.408 DEBUG:teuthology.orchestra.run.trial193:> hostname 2026-02-12T09:47:18.424 INFO:teuthology.orchestra.run.trial193.stdout:trial193.front.sepia.ceph.com 2026-02-12T09:47:18.425 DEBUG:teuthology.orchestra.run.trial193:> grep trial193.front.sepia.ceph.com /etc/hosts 2026-02-12T09:47:18.481 INFO:teuthology.orchestra.run.trial193.stdout:10.20.193.193 trial193.front.sepia.ceph.com trial193 2026-02-12T09:47:18.481 DEBUG:teuthology.orchestra.run.trial193:> sudo hostname trial193 2026-02-12T09:47:18.550 DEBUG:teuthology.orchestra.run.trial193:> sudo sed -i -e 's/trial193.front.sepia.ceph.com/trial193/g' /etc/hosts 2026-02-12T09:47:18.614 DEBUG:teuthology.orchestra.run.trial193:> sudo sed -i -e 's/10.20.193.193/10.20.193.193/g' /etc/hosts 2026-02-12T09:47:18.678 DEBUG:teuthology.orchestra.run.trial193:> sudo sed -i -e 's/trial193.front.sepia.ceph.com/trial193/g' /etc/hostname 2026-02-12T09:47:18.742 DEBUG:teuthology.orchestra.run.trial193:> sudo hostname trial193 2026-02-12T09:47:18.805 DEBUG:teuthology.orchestra.run.trial193:> cat /etc/os-release 2026-02-12T09:47:18.861 INFO:teuthology.orchestra.run.trial193.stdout:NAME="CentOS Stream" 2026-02-12T09:47:18.861 INFO:teuthology.orchestra.run.trial193.stdout:VERSION="9" 2026-02-12T09:47:18.861 INFO:teuthology.orchestra.run.trial193.stdout:ID="centos" 2026-02-12T09:47:18.861 INFO:teuthology.orchestra.run.trial193.stdout:ID_LIKE="rhel fedora" 2026-02-12T09:47:18.861 INFO:teuthology.orchestra.run.trial193.stdout:VERSION_ID="9" 2026-02-12T09:47:18.861 INFO:teuthology.orchestra.run.trial193.stdout:PLATFORM_ID="platform:el9" 2026-02-12T09:47:18.861 INFO:teuthology.orchestra.run.trial193.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T09:47:18.861 INFO:teuthology.orchestra.run.trial193.stdout:ANSI_COLOR="0;31" 2026-02-12T09:47:18.861 INFO:teuthology.orchestra.run.trial193.stdout:LOGO="fedora-logo-icon" 2026-02-12T09:47:18.861 INFO:teuthology.orchestra.run.trial193.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T09:47:18.861 INFO:teuthology.orchestra.run.trial193.stdout:HOME_URL="https://centos.org/" 2026-02-12T09:47:18.861 INFO:teuthology.orchestra.run.trial193.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T09:47:18.861 INFO:teuthology.orchestra.run.trial193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T09:47:18.861 INFO:teuthology.orchestra.run.trial193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T09:47:18.861 INFO:teuthology.provision.fog.trial193:Deploy complete! 2026-02-12T09:47:18.862 DEBUG:teuthology.parallel:result is None 2026-02-12T09:47:19.227 INFO:teuthology.lock.ops:Checking trial183.front.sepia.ceph.com 2026-02-12T09:47:19.227 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T09:47:19.301 INFO:teuthology.lock.ops:Checking trial193.front.sepia.ceph.com 2026-02-12T09:47:19.301 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T09:47:19.360 INFO:teuthology.lock.ops:Updating [trial183.front.sepia.ceph.com]: set os type and version on server 2026-02-12T09:47:19.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial183.front.sepia.ceph.com' 2026-02-12T09:47:19.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:47:19.421 DEBUG:teuthology.orchestra.run.trial183:> true 2026-02-12T09:47:19.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial183.front.sepia.ceph.com' 2026-02-12T09:47:19.496 DEBUG:teuthology.orchestra.run.trial183:> uname -m 2026-02-12T09:47:19.552 INFO:teuthology.orchestra.run.trial183.stdout:x86_64 2026-02-12T09:47:19.552 DEBUG:teuthology.orchestra.run.trial183:> cat /etc/os-release 2026-02-12T09:47:19.607 INFO:teuthology.orchestra.run.trial183.stdout:NAME="CentOS Stream" 2026-02-12T09:47:19.607 INFO:teuthology.orchestra.run.trial183.stdout:VERSION="9" 2026-02-12T09:47:19.607 INFO:teuthology.orchestra.run.trial183.stdout:ID="centos" 2026-02-12T09:47:19.607 INFO:teuthology.orchestra.run.trial183.stdout:ID_LIKE="rhel fedora" 2026-02-12T09:47:19.607 INFO:teuthology.orchestra.run.trial183.stdout:VERSION_ID="9" 2026-02-12T09:47:19.607 INFO:teuthology.orchestra.run.trial183.stdout:PLATFORM_ID="platform:el9" 2026-02-12T09:47:19.607 INFO:teuthology.orchestra.run.trial183.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T09:47:19.607 INFO:teuthology.orchestra.run.trial183.stdout:ANSI_COLOR="0;31" 2026-02-12T09:47:19.608 INFO:teuthology.orchestra.run.trial183.stdout:LOGO="fedora-logo-icon" 2026-02-12T09:47:19.608 INFO:teuthology.orchestra.run.trial183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T09:47:19.608 INFO:teuthology.orchestra.run.trial183.stdout:HOME_URL="https://centos.org/" 2026-02-12T09:47:19.608 INFO:teuthology.orchestra.run.trial183.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T09:47:19.608 INFO:teuthology.orchestra.run.trial183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T09:47:19.608 INFO:teuthology.orchestra.run.trial183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T09:47:19.608 INFO:teuthology.lock.ops:Updating trial183.front.sepia.ceph.com on lock server 2026-02-12T09:47:19.681 INFO:teuthology.lock.ops:Updating [trial193.front.sepia.ceph.com]: set os type and version on server 2026-02-12T09:47:19.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T09:47:19.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T09:47:19.743 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T09:47:19.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T09:47:19.817 DEBUG:teuthology.orchestra.run.trial193:> uname -m 2026-02-12T09:47:19.872 INFO:teuthology.orchestra.run.trial193.stdout:x86_64 2026-02-12T09:47:19.872 DEBUG:teuthology.orchestra.run.trial193:> cat /etc/os-release 2026-02-12T09:47:19.929 INFO:teuthology.orchestra.run.trial193.stdout:NAME="CentOS Stream" 2026-02-12T09:47:19.929 INFO:teuthology.orchestra.run.trial193.stdout:VERSION="9" 2026-02-12T09:47:19.929 INFO:teuthology.orchestra.run.trial193.stdout:ID="centos" 2026-02-12T09:47:19.929 INFO:teuthology.orchestra.run.trial193.stdout:ID_LIKE="rhel fedora" 2026-02-12T09:47:19.929 INFO:teuthology.orchestra.run.trial193.stdout:VERSION_ID="9" 2026-02-12T09:47:19.929 INFO:teuthology.orchestra.run.trial193.stdout:PLATFORM_ID="platform:el9" 2026-02-12T09:47:19.929 INFO:teuthology.orchestra.run.trial193.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T09:47:19.930 INFO:teuthology.orchestra.run.trial193.stdout:ANSI_COLOR="0;31" 2026-02-12T09:47:19.930 INFO:teuthology.orchestra.run.trial193.stdout:LOGO="fedora-logo-icon" 2026-02-12T09:47:19.930 INFO:teuthology.orchestra.run.trial193.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T09:47:19.930 INFO:teuthology.orchestra.run.trial193.stdout:HOME_URL="https://centos.org/" 2026-02-12T09:47:19.930 INFO:teuthology.orchestra.run.trial193.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T09:47:19.930 INFO:teuthology.orchestra.run.trial193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T09:47:19.930 INFO:teuthology.orchestra.run.trial193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T09:47:19.931 INFO:teuthology.lock.ops:Updating trial193.front.sepia.ceph.com on lock server 2026-02-12T09:47:20.034 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:47:20.130 INFO:teuthology.dispatcher.supervisor:Running job 41714 2026-02-12T09:47:20.130 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/bin/teuthology -v --owner scheduled_matan@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41714 --name matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{pggrow} thrashosds-health workloads/pool-snaps-few-objects} -- /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41714/orig.config.yaml 2026-02-12T09:47:20.131 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41714 2026-02-12T09:47:20.131 INFO:teuthology.dispatcher.supervisor:Job PID: 3520182 2026-02-12T09:47:20.131 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-12T09:49:20.231 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:51:20.445 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:53:20.617 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:55:20.794 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:57:20.913 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:59:21.120 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:01:21.341 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:03:21.488 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:05:21.694 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:07:21.901 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:09:22.128 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:11:22.342 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:13:22.511 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:15:22.629 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:17:22.825 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:17:22.901 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-12T10:17:23.016 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-12T10:17:23.545 INFO:teuthology.orchestra.console.trial183:Power off 2026-02-12T10:17:23.545 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T10:17:23.564 INFO:teuthology.orchestra.console.trial193:Power off 2026-02-12T10:17:23.564 DEBUG:teuthology.orchestra.console.trial193:pexpect command: ipmitool -H trial193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T10:17:23.582 DEBUG:teuthology.orchestra.console.trial183:power off output: Chassis Power Control: Down/Off 2026-02-12T10:17:23.601 DEBUG:teuthology.orchestra.console.trial193:power off output: Chassis Power Control: Down/Off 2026-02-12T10:17:27.586 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:17:27.603 DEBUG:teuthology.orchestra.console.trial193:pexpect command: ipmitool -H trial193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:17:27.697 DEBUG:teuthology.orchestra.console.trial183:check power output: Chassis Power is on 2026-02-12T10:17:27.712 DEBUG:teuthology.orchestra.console.trial193:check power output: Chassis Power is on 2026-02-12T10:17:31.702 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:17:31.714 DEBUG:teuthology.orchestra.console.trial193:pexpect command: ipmitool -H trial193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:17:31.813 DEBUG:teuthology.orchestra.console.trial183:check power output: Chassis Power is off 2026-02-12T10:17:31.814 INFO:teuthology.orchestra.console.trial183:Power off completed 2026-02-12T10:17:31.824 DEBUG:teuthology.orchestra.console.trial193:check power output: Chassis Power is off 2026-02-12T10:17:31.825 INFO:teuthology.orchestra.console.trial193:Power off completed 2026-02-12T10:17:32.073 INFO:teuthology.lock.ops:unlocked: trial183.front.sepia.ceph.com 2026-02-12T10:17:32.165 INFO:teuthology.lock.ops:unlocked: trial193.front.sepia.ceph.com