2026-02-12T08:39:36.810 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062 2026-02-12T08:39:36.810 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T08:39:36.882 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T08:39:37.076 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7d9f5a8931a0>, signals=[15]) 2026-02-12T08:39:37.076 INFO:teuthology.lock.ops:Start node 'trial069.front.sepia.ceph.com' reimaging 2026-02-12T08:39:37.076 INFO:teuthology.lock.ops:Updating [trial069.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T08:39:37.076 INFO:teuthology.lock.ops:Updating trial069.front.sepia.ceph.com on lock server 2026-02-12T08:39:37.133 INFO:teuthology.lock.ops:Start node 'trial191.front.sepia.ceph.com' reimaging 2026-02-12T08:39:37.133 INFO:teuthology.lock.ops:Updating [trial191.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T08:39:37.134 INFO:teuthology.lock.ops:Updating trial191.front.sepia.ceph.com on lock server 2026-02-12T08:39:37.344 DEBUG:teuthology.provision.fog.trial069:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T08:39:37.348 DEBUG:teuthology.provision.fog.trial191:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T08:39:37.376 INFO:teuthology.provision.fog.trial191:Scheduling deploy of centos 9.stream 2026-02-12T08:39:37.397 INFO:teuthology.provision.fog.trial069:Scheduling deploy of centos 9.stream 2026-02-12T08:39:38.416 INFO:teuthology.orchestra.console.trial191:Power off 2026-02-12T08:39:38.416 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T08:39:38.435 INFO:teuthology.orchestra.console.trial069:Power off 2026-02-12T08:39:38.435 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T08:39:38.455 DEBUG:teuthology.orchestra.console.trial191:power off output: Chassis Power Control: Down/Off 2026-02-12T08:39:38.474 DEBUG:teuthology.orchestra.console.trial069:power off output: Chassis Power Control: Down/Off 2026-02-12T08:39:42.460 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T08:39:42.474 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T08:39:42.569 DEBUG:teuthology.orchestra.console.trial191:check power output: Chassis Power is off 2026-02-12T08:39:42.570 INFO:teuthology.orchestra.console.trial191:Power off completed 2026-02-12T08:39:42.583 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is off 2026-02-12T08:39:42.583 INFO:teuthology.orchestra.console.trial069:Power off completed 2026-02-12T08:39:42.670 INFO:teuthology.orchestra.console.trial191:Power on 2026-02-12T08:39:42.671 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T08:39:42.684 INFO:teuthology.orchestra.console.trial069:Power on 2026-02-12T08:39:42.684 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T08:39:42.711 DEBUG:teuthology.orchestra.console.trial191:power on output: Chassis Power Control: Up/On 2026-02-12T08:39:42.725 DEBUG:teuthology.orchestra.console.trial069:power on output: Chassis Power Control: Up/On 2026-02-12T08:39:46.716 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T08:39:46.726 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T08:39:46.825 DEBUG:teuthology.orchestra.console.trial191:check power output: Chassis Power is on 2026-02-12T08:39:46.825 INFO:teuthology.orchestra.console.trial191:Power on completed 2026-02-12T08:39:46.835 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is on 2026-02-12T08:39:46.835 INFO:teuthology.orchestra.console.trial069:Power on completed 2026-02-12T08:39:46.926 INFO:teuthology.provision.fog.trial191:Waiting for deploy to finish 2026-02-12T08:39:46.936 INFO:teuthology.provision.fog.trial069:Waiting for deploy to finish 2026-02-12T08:41:34.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:41:34.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:41:37.117 WARNING:teuthology.provision.fog.trial069:[Errno None] Unable to connect to port 22 on 10.20.193.69 2026-02-12T08:41:37.117 WARNING:teuthology.provision.fog.trial191:[Errno None] Unable to connect to port 22 on 10.20.193.191 2026-02-12T08:41:43.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:41:43.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:41:46.205 WARNING:teuthology.provision.fog.trial069:[Errno None] Unable to connect to port 22 on 10.20.193.69 2026-02-12T08:41:46.205 WARNING:teuthology.provision.fog.trial191:[Errno None] Unable to connect to port 22 on 10.20.193.191 2026-02-12T08:41:52.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:41:52.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:41:55.293 WARNING:teuthology.provision.fog.trial069:[Errno None] Unable to connect to port 22 on 10.20.193.69 2026-02-12T08:41:55.293 WARNING:teuthology.provision.fog.trial191:[Errno None] Unable to connect to port 22 on 10.20.193.191 2026-02-12T08:42:01.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:42:01.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:42:04.381 WARNING:teuthology.provision.fog.trial069:[Errno None] Unable to connect to port 22 on 10.20.193.69 2026-02-12T08:42:04.381 WARNING:teuthology.provision.fog.trial191:[Errno None] Unable to connect to port 22 on 10.20.193.191 2026-02-12T08:42:10.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:42:10.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:42:46.430 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T08:42:46.431 DEBUG:teuthology.orchestra.run.trial191:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T08:42:46.521 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T08:42:46.521 DEBUG:teuthology.orchestra.run.trial069:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T08:42:46.685 INFO:teuthology.provision.fog.trial191:Node is ready 2026-02-12T08:42:46.685 DEBUG:teuthology.orchestra.run.trial191:> hostname 2026-02-12T08:42:46.742 INFO:teuthology.orchestra.run.trial191.stdout:trial191.front.sepia.ceph.com 2026-02-12T08:42:46.743 DEBUG:teuthology.orchestra.run.trial191:> grep trial191.front.sepia.ceph.com /etc/hosts 2026-02-12T08:42:46.751 INFO:teuthology.provision.fog.trial069:Node is ready 2026-02-12T08:42:46.751 DEBUG:teuthology.orchestra.run.trial069:> hostname 2026-02-12T08:42:46.798 INFO:teuthology.orchestra.run.trial191.stdout:10.20.193.191 trial191.front.sepia.ceph.com trial191 2026-02-12T08:42:46.799 DEBUG:teuthology.orchestra.run.trial191:> sudo hostname trial191 2026-02-12T08:42:46.808 INFO:teuthology.orchestra.run.trial069.stdout:trial069.front.sepia.ceph.com 2026-02-12T08:42:46.809 DEBUG:teuthology.orchestra.run.trial069:> grep trial069.front.sepia.ceph.com /etc/hosts 2026-02-12T08:42:46.866 INFO:teuthology.orchestra.run.trial069.stdout:10.20.193.69 trial069.front.sepia.ceph.com trial069 2026-02-12T08:42:46.866 DEBUG:teuthology.orchestra.run.trial069:> sudo hostname trial069 2026-02-12T08:42:46.870 DEBUG:teuthology.orchestra.run.trial191:> sudo sed -i -e 's/trial191.front.sepia.ceph.com/trial191/g' /etc/hosts 2026-02-12T08:42:46.936 DEBUG:teuthology.orchestra.run.trial191:> sudo sed -i -e 's/10.20.193.191/10.20.193.191/g' /etc/hosts 2026-02-12T08:42:46.937 DEBUG:teuthology.orchestra.run.trial069:> sudo sed -i -e 's/trial069.front.sepia.ceph.com/trial069/g' /etc/hosts 2026-02-12T08:42:47.000 DEBUG:teuthology.orchestra.run.trial191:> sudo sed -i -e 's/trial191.front.sepia.ceph.com/trial191/g' /etc/hostname 2026-02-12T08:42:47.002 DEBUG:teuthology.orchestra.run.trial069:> sudo sed -i -e 's/10.20.193.69/10.20.193.69/g' /etc/hosts 2026-02-12T08:42:47.065 DEBUG:teuthology.orchestra.run.trial191:> sudo hostname trial191 2026-02-12T08:42:47.066 DEBUG:teuthology.orchestra.run.trial069:> sudo sed -i -e 's/trial069.front.sepia.ceph.com/trial069/g' /etc/hostname 2026-02-12T08:42:47.130 DEBUG:teuthology.orchestra.run.trial191:> cat /etc/os-release 2026-02-12T08:42:47.131 DEBUG:teuthology.orchestra.run.trial069:> sudo hostname trial069 2026-02-12T08:42:47.187 INFO:teuthology.orchestra.run.trial191.stdout:NAME="CentOS Stream" 2026-02-12T08:42:47.187 INFO:teuthology.orchestra.run.trial191.stdout:VERSION="9" 2026-02-12T08:42:47.187 INFO:teuthology.orchestra.run.trial191.stdout:ID="centos" 2026-02-12T08:42:47.187 INFO:teuthology.orchestra.run.trial191.stdout:ID_LIKE="rhel fedora" 2026-02-12T08:42:47.188 INFO:teuthology.orchestra.run.trial191.stdout:VERSION_ID="9" 2026-02-12T08:42:47.188 INFO:teuthology.orchestra.run.trial191.stdout:PLATFORM_ID="platform:el9" 2026-02-12T08:42:47.188 INFO:teuthology.orchestra.run.trial191.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T08:42:47.188 INFO:teuthology.orchestra.run.trial191.stdout:ANSI_COLOR="0;31" 2026-02-12T08:42:47.188 INFO:teuthology.orchestra.run.trial191.stdout:LOGO="fedora-logo-icon" 2026-02-12T08:42:47.188 INFO:teuthology.orchestra.run.trial191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T08:42:47.188 INFO:teuthology.orchestra.run.trial191.stdout:HOME_URL="https://centos.org/" 2026-02-12T08:42:47.188 INFO:teuthology.orchestra.run.trial191.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T08:42:47.188 INFO:teuthology.orchestra.run.trial191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T08:42:47.188 INFO:teuthology.orchestra.run.trial191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T08:42:47.189 INFO:teuthology.provision.fog.trial191:Deploy complete! 2026-02-12T08:42:47.191 DEBUG:teuthology.parallel:result is None 2026-02-12T08:42:47.198 DEBUG:teuthology.orchestra.run.trial069:> cat /etc/os-release 2026-02-12T08:42:47.255 INFO:teuthology.orchestra.run.trial069.stdout:NAME="CentOS Stream" 2026-02-12T08:42:47.255 INFO:teuthology.orchestra.run.trial069.stdout:VERSION="9" 2026-02-12T08:42:47.255 INFO:teuthology.orchestra.run.trial069.stdout:ID="centos" 2026-02-12T08:42:47.255 INFO:teuthology.orchestra.run.trial069.stdout:ID_LIKE="rhel fedora" 2026-02-12T08:42:47.255 INFO:teuthology.orchestra.run.trial069.stdout:VERSION_ID="9" 2026-02-12T08:42:47.255 INFO:teuthology.orchestra.run.trial069.stdout:PLATFORM_ID="platform:el9" 2026-02-12T08:42:47.255 INFO:teuthology.orchestra.run.trial069.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T08:42:47.256 INFO:teuthology.orchestra.run.trial069.stdout:ANSI_COLOR="0;31" 2026-02-12T08:42:47.256 INFO:teuthology.orchestra.run.trial069.stdout:LOGO="fedora-logo-icon" 2026-02-12T08:42:47.256 INFO:teuthology.orchestra.run.trial069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T08:42:47.256 INFO:teuthology.orchestra.run.trial069.stdout:HOME_URL="https://centos.org/" 2026-02-12T08:42:47.256 INFO:teuthology.orchestra.run.trial069.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T08:42:47.256 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T08:42:47.256 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T08:42:47.257 INFO:teuthology.provision.fog.trial069:Deploy complete! 2026-02-12T08:42:47.257 DEBUG:teuthology.parallel:result is None 2026-02-12T08:42:47.695 INFO:teuthology.lock.ops:Checking trial069.front.sepia.ceph.com 2026-02-12T08:42:47.696 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T08:42:47.794 INFO:teuthology.lock.ops:Checking trial191.front.sepia.ceph.com 2026-02-12T08:42:47.794 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T08:42:47.857 INFO:teuthology.lock.ops:Updating [trial069.front.sepia.ceph.com]: set os type and version on server 2026-02-12T08:42:47.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial069.front.sepia.ceph.com' 2026-02-12T08:42:47.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:42:47.923 DEBUG:teuthology.orchestra.run.trial069:> true 2026-02-12T08:42:48.007 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial069.front.sepia.ceph.com' 2026-02-12T08:42:48.007 DEBUG:teuthology.orchestra.run.trial069:> uname -m 2026-02-12T08:42:48.061 INFO:teuthology.orchestra.run.trial069.stdout:x86_64 2026-02-12T08:42:48.062 DEBUG:teuthology.orchestra.run.trial069:> cat /etc/os-release 2026-02-12T08:42:48.117 INFO:teuthology.orchestra.run.trial069.stdout:NAME="CentOS Stream" 2026-02-12T08:42:48.117 INFO:teuthology.orchestra.run.trial069.stdout:VERSION="9" 2026-02-12T08:42:48.117 INFO:teuthology.orchestra.run.trial069.stdout:ID="centos" 2026-02-12T08:42:48.117 INFO:teuthology.orchestra.run.trial069.stdout:ID_LIKE="rhel fedora" 2026-02-12T08:42:48.117 INFO:teuthology.orchestra.run.trial069.stdout:VERSION_ID="9" 2026-02-12T08:42:48.117 INFO:teuthology.orchestra.run.trial069.stdout:PLATFORM_ID="platform:el9" 2026-02-12T08:42:48.117 INFO:teuthology.orchestra.run.trial069.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T08:42:48.118 INFO:teuthology.orchestra.run.trial069.stdout:ANSI_COLOR="0;31" 2026-02-12T08:42:48.118 INFO:teuthology.orchestra.run.trial069.stdout:LOGO="fedora-logo-icon" 2026-02-12T08:42:48.118 INFO:teuthology.orchestra.run.trial069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T08:42:48.118 INFO:teuthology.orchestra.run.trial069.stdout:HOME_URL="https://centos.org/" 2026-02-12T08:42:48.118 INFO:teuthology.orchestra.run.trial069.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T08:42:48.118 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T08:42:48.118 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T08:42:48.119 INFO:teuthology.lock.ops:Updating trial069.front.sepia.ceph.com on lock server 2026-02-12T08:42:48.220 INFO:teuthology.lock.ops:Updating [trial191.front.sepia.ceph.com]: set os type and version on server 2026-02-12T08:42:48.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial191.front.sepia.ceph.com' 2026-02-12T08:42:48.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T08:42:48.288 DEBUG:teuthology.orchestra.run.trial191:> true 2026-02-12T08:42:48.371 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial191.front.sepia.ceph.com' 2026-02-12T08:42:48.371 DEBUG:teuthology.orchestra.run.trial191:> uname -m 2026-02-12T08:42:48.429 INFO:teuthology.orchestra.run.trial191.stdout:x86_64 2026-02-12T08:42:48.429 DEBUG:teuthology.orchestra.run.trial191:> cat /etc/os-release 2026-02-12T08:42:48.486 INFO:teuthology.orchestra.run.trial191.stdout:NAME="CentOS Stream" 2026-02-12T08:42:48.486 INFO:teuthology.orchestra.run.trial191.stdout:VERSION="9" 2026-02-12T08:42:48.486 INFO:teuthology.orchestra.run.trial191.stdout:ID="centos" 2026-02-12T08:42:48.486 INFO:teuthology.orchestra.run.trial191.stdout:ID_LIKE="rhel fedora" 2026-02-12T08:42:48.486 INFO:teuthology.orchestra.run.trial191.stdout:VERSION_ID="9" 2026-02-12T08:42:48.486 INFO:teuthology.orchestra.run.trial191.stdout:PLATFORM_ID="platform:el9" 2026-02-12T08:42:48.486 INFO:teuthology.orchestra.run.trial191.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T08:42:48.486 INFO:teuthology.orchestra.run.trial191.stdout:ANSI_COLOR="0;31" 2026-02-12T08:42:48.486 INFO:teuthology.orchestra.run.trial191.stdout:LOGO="fedora-logo-icon" 2026-02-12T08:42:48.487 INFO:teuthology.orchestra.run.trial191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T08:42:48.487 INFO:teuthology.orchestra.run.trial191.stdout:HOME_URL="https://centos.org/" 2026-02-12T08:42:48.487 INFO:teuthology.orchestra.run.trial191.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T08:42:48.487 INFO:teuthology.orchestra.run.trial191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T08:42:48.487 INFO:teuthology.orchestra.run.trial191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T08:42:48.488 INFO:teuthology.lock.ops:Updating trial191.front.sepia.ceph.com on lock server 2026-02-12T08:42:48.590 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T08:42:48.690 INFO:teuthology.dispatcher.supervisor:Running job 41577 2026-02-12T08:42:48.690 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/bin/teuthology -v --owner scheduled_matan@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41577 --name matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{default} thrashosds-health workloads/small-objects} -- /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41577/orig.config.yaml 2026-02-12T08:42:48.691 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41577 2026-02-12T08:42:48.691 INFO:teuthology.dispatcher.supervisor:Job PID: 3363442 2026-02-12T08:42:48.691 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-12T08:44:48.791 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T08:46:48.944 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T08:48:49.148 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T08:50:49.325 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T08:52:49.541 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T08:54:49.748 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T08:56:49.948 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T08:58:50.156 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:00:50.328 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:02:50.528 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:04:50.638 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:06:50.781 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:08:50.892 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T09:08:50.988 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-12T09:08:51.106 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-12T09:08:51.603 INFO:teuthology.orchestra.console.trial069:Power off 2026-02-12T09:08:51.603 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T09:08:51.624 INFO:teuthology.orchestra.console.trial191:Power off 2026-02-12T09:08:51.624 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T09:08:51.645 DEBUG:teuthology.orchestra.console.trial069:power off output: Chassis Power Control: Down/Off 2026-02-12T09:08:51.662 DEBUG:teuthology.orchestra.console.trial191:power off output: Chassis Power Control: Down/Off 2026-02-12T09:08:55.651 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T09:08:55.663 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T09:08:55.761 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is on 2026-02-12T09:08:55.772 DEBUG:teuthology.orchestra.console.trial191:check power output: Chassis Power is on 2026-02-12T09:08:59.766 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T09:08:59.774 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T09:08:59.875 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is off 2026-02-12T09:08:59.876 INFO:teuthology.orchestra.console.trial069:Power off completed 2026-02-12T09:08:59.885 DEBUG:teuthology.orchestra.console.trial191:check power output: Chassis Power is off 2026-02-12T09:08:59.885 INFO:teuthology.orchestra.console.trial191:Power off completed 2026-02-12T09:09:00.120 INFO:teuthology.lock.ops:unlocked: trial069.front.sepia.ceph.com 2026-02-12T09:09:00.134 INFO:teuthology.lock.ops:unlocked: trial191.front.sepia.ceph.com