2026-02-12T09:44:23.939 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062
2026-02-12T09:44:23.939 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:44:24.012 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:44:24.204 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7019f6848ce0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7019f607c4a0>, signals=[15])
2026-02-12T09:44:24.204 INFO:teuthology.lock.ops:Start node 'trial044.front.sepia.ceph.com' reimaging
2026-02-12T09:44:24.204 INFO:teuthology.lock.ops:Updating [trial044.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T09:44:24.205 INFO:teuthology.lock.ops:Updating trial044.front.sepia.ceph.com on lock server
2026-02-12T09:44:24.261 INFO:teuthology.lock.ops:Start node 'trial098.front.sepia.ceph.com' reimaging
2026-02-12T09:44:24.261 INFO:teuthology.lock.ops:Updating [trial098.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T09:44:24.261 INFO:teuthology.lock.ops:Updating trial098.front.sepia.ceph.com on lock server
2026-02-12T09:44:24.490 DEBUG:teuthology.provision.fog.trial044:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T09:44:24.499 DEBUG:teuthology.provision.fog.trial098:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T09:44:24.511 INFO:teuthology.provision.fog.trial044:Scheduling deploy of centos 9.stream
2026-02-12T09:44:24.551 INFO:teuthology.provision.fog.trial098:Scheduling deploy of centos 9.stream
2026-02-12T09:44:25.579 INFO:teuthology.orchestra.console.trial098:Power off
2026-02-12T09:44:25.579 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T09:44:25.618 DEBUG:teuthology.orchestra.console.trial098:power off output: Chassis Power Control: Down/Off
2026-02-12T09:44:25.679 INFO:teuthology.orchestra.console.trial044:Power off
2026-02-12T09:44:25.679 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T09:44:25.716 DEBUG:teuthology.orchestra.console.trial044:power off output: Chassis Power Control: Down/Off
2026-02-12T09:44:29.623 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:44:29.717 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:44:29.732 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is off
2026-02-12T09:44:29.732 INFO:teuthology.orchestra.console.trial098:Power off completed
2026-02-12T09:44:29.826 DEBUG:teuthology.orchestra.console.trial044:check power output: Chassis Power is off
2026-02-12T09:44:29.827 INFO:teuthology.orchestra.console.trial044:Power off completed
2026-02-12T09:44:29.833 INFO:teuthology.orchestra.console.trial098:Power on
2026-02-12T09:44:29.833 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T09:44:29.873 DEBUG:teuthology.orchestra.console.trial098:power on output: Chassis Power Control: Up/On
2026-02-12T09:44:29.927 INFO:teuthology.orchestra.console.trial044:Power on
2026-02-12T09:44:29.928 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T09:44:29.970 DEBUG:teuthology.orchestra.console.trial044:power on output: Chassis Power Control: Up/On
2026-02-12T09:44:33.877 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:44:33.971 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:44:33.988 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is on
2026-02-12T09:44:33.988 INFO:teuthology.orchestra.console.trial098:Power on completed
2026-02-12T09:44:34.081 DEBUG:teuthology.orchestra.console.trial044:check power output: Chassis Power is on
2026-02-12T09:44:34.081 INFO:teuthology.orchestra.console.trial044:Power on completed
2026-02-12T09:44:34.088 INFO:teuthology.provision.fog.trial098:Waiting for deploy to finish
2026-02-12T09:44:34.182 INFO:teuthology.provision.fog.trial044:Waiting for deploy to finish
2026-02-12T09:46:21.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:46:21.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:46:24.477 WARNING:teuthology.provision.fog.trial098:[Errno None] Unable to connect to port 22 on 10.20.193.98
2026-02-12T09:46:24.541 WARNING:teuthology.provision.fog.trial044:[Errno None] Unable to connect to port 22 on 10.20.193.44
2026-02-12T09:46:30.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:46:30.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:46:33.565 WARNING:teuthology.provision.fog.trial098:[Errno None] Unable to connect to port 22 on 10.20.193.98
2026-02-12T09:46:33.629 WARNING:teuthology.provision.fog.trial044:[Errno None] Unable to connect to port 22 on 10.20.193.44
2026-02-12T09:46:39.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:46:39.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:46:42.653 WARNING:teuthology.provision.fog.trial098:[Errno None] Unable to connect to port 22 on 10.20.193.98
2026-02-12T09:46:42.717 WARNING:teuthology.provision.fog.trial044:[Errno None] Unable to connect to port 22 on 10.20.193.44
2026-02-12T09:46:48.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:46:48.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:46:51.741 WARNING:teuthology.provision.fog.trial098:[Errno None] Unable to connect to port 22 on 10.20.193.98
2026-02-12T09:46:51.805 WARNING:teuthology.provision.fog.trial044:[Errno None] Unable to connect to port 22 on 10.20.193.44
2026-02-12T09:46:57.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:46:57.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:47:33.533 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T09:47:33.533 DEBUG:teuthology.orchestra.run.trial098:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T09:47:33.819 INFO:teuthology.provision.fog.trial098:Node is ready
2026-02-12T09:47:33.820 DEBUG:teuthology.orchestra.run.trial098:> hostname
2026-02-12T09:47:33.876 INFO:teuthology.orchestra.run.trial098.stdout:trial098.front.sepia.ceph.com
2026-02-12T09:47:33.877 DEBUG:teuthology.orchestra.run.trial098:> grep trial098.front.sepia.ceph.com /etc/hosts
2026-02-12T09:47:33.933 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98 trial098.front.sepia.ceph.com trial098
2026-02-12T09:47:33.934 DEBUG:teuthology.orchestra.run.trial098:> sudo hostname trial098
2026-02-12T09:47:34.050 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T09:47:34.050 DEBUG:teuthology.orchestra.run.trial044:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T09:47:34.063 DEBUG:teuthology.orchestra.run.trial098:> sudo sed -i -e 's/trial098.front.sepia.ceph.com/trial098/g' /etc/hosts
2026-02-12T09:47:34.131 DEBUG:teuthology.orchestra.run.trial098:> sudo sed -i -e 's/10.20.193.98/10.20.193.98/g' /etc/hosts
2026-02-12T09:47:34.195 DEBUG:teuthology.orchestra.run.trial098:> sudo sed -i -e 's/trial098.front.sepia.ceph.com/trial098/g' /etc/hostname
2026-02-12T09:47:34.205 INFO:teuthology.provision.fog.trial044:Node is ready
2026-02-12T09:47:34.206 DEBUG:teuthology.orchestra.run.trial044:> hostname
2026-02-12T09:47:34.263 INFO:teuthology.orchestra.run.trial044.stdout:trial044.front.sepia.ceph.com
2026-02-12T09:47:34.263 DEBUG:teuthology.orchestra.run.trial044:> grep trial044.front.sepia.ceph.com /etc/hosts
2026-02-12T09:47:34.264 DEBUG:teuthology.orchestra.run.trial098:> sudo hostname trial098
2026-02-12T09:47:34.318 INFO:teuthology.orchestra.run.trial044.stdout:10.20.193.44 trial044.front.sepia.ceph.com trial044
2026-02-12T09:47:34.319 DEBUG:teuthology.orchestra.run.trial044:> sudo hostname trial044
2026-02-12T09:47:34.329 DEBUG:teuthology.orchestra.run.trial098:> cat /etc/os-release
2026-02-12T09:47:34.387 INFO:teuthology.orchestra.run.trial098.stdout:NAME="CentOS Stream"
2026-02-12T09:47:34.387 INFO:teuthology.orchestra.run.trial098.stdout:VERSION="9"
2026-02-12T09:47:34.387 INFO:teuthology.orchestra.run.trial098.stdout:ID="centos"
2026-02-12T09:47:34.387 INFO:teuthology.orchestra.run.trial098.stdout:ID_LIKE="rhel fedora"
2026-02-12T09:47:34.388 INFO:teuthology.orchestra.run.trial098.stdout:VERSION_ID="9"
2026-02-12T09:47:34.388 INFO:teuthology.orchestra.run.trial098.stdout:PLATFORM_ID="platform:el9"
2026-02-12T09:47:34.388 INFO:teuthology.orchestra.run.trial098.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T09:47:34.388 INFO:teuthology.orchestra.run.trial098.stdout:ANSI_COLOR="0;31"
2026-02-12T09:47:34.388 INFO:teuthology.orchestra.run.trial098.stdout:LOGO="fedora-logo-icon"
2026-02-12T09:47:34.388 INFO:teuthology.orchestra.run.trial098.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T09:47:34.388 INFO:teuthology.orchestra.run.trial098.stdout:HOME_URL="https://centos.org/"
2026-02-12T09:47:34.388 INFO:teuthology.orchestra.run.trial098.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T09:47:34.388 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T09:47:34.388 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T09:47:34.389 INFO:teuthology.provision.fog.trial098:Deploy complete!
2026-02-12T09:47:34.390 DEBUG:teuthology.parallel:result is None
2026-02-12T09:47:34.394 DEBUG:teuthology.orchestra.run.trial044:> sudo sed -i -e 's/trial044.front.sepia.ceph.com/trial044/g' /etc/hosts
2026-02-12T09:47:34.460 DEBUG:teuthology.orchestra.run.trial044:> sudo sed -i -e 's/10.20.193.44/10.20.193.44/g' /etc/hosts
2026-02-12T09:47:34.527 DEBUG:teuthology.orchestra.run.trial044:> sudo sed -i -e 's/trial044.front.sepia.ceph.com/trial044/g' /etc/hostname
2026-02-12T09:47:34.593 DEBUG:teuthology.orchestra.run.trial044:> sudo hostname trial044
2026-02-12T09:47:34.657 DEBUG:teuthology.orchestra.run.trial044:> cat /etc/os-release
2026-02-12T09:47:34.713 INFO:teuthology.orchestra.run.trial044.stdout:NAME="CentOS Stream"
2026-02-12T09:47:34.714 INFO:teuthology.orchestra.run.trial044.stdout:VERSION="9"
2026-02-12T09:47:34.714 INFO:teuthology.orchestra.run.trial044.stdout:ID="centos"
2026-02-12T09:47:34.714 INFO:teuthology.orchestra.run.trial044.stdout:ID_LIKE="rhel fedora"
2026-02-12T09:47:34.714 INFO:teuthology.orchestra.run.trial044.stdout:VERSION_ID="9"
2026-02-12T09:47:34.714 INFO:teuthology.orchestra.run.trial044.stdout:PLATFORM_ID="platform:el9"
2026-02-12T09:47:34.714 INFO:teuthology.orchestra.run.trial044.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T09:47:34.714 INFO:teuthology.orchestra.run.trial044.stdout:ANSI_COLOR="0;31"
2026-02-12T09:47:34.714 INFO:teuthology.orchestra.run.trial044.stdout:LOGO="fedora-logo-icon"
2026-02-12T09:47:34.714 INFO:teuthology.orchestra.run.trial044.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T09:47:34.714 INFO:teuthology.orchestra.run.trial044.stdout:HOME_URL="https://centos.org/"
2026-02-12T09:47:34.715 INFO:teuthology.orchestra.run.trial044.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T09:47:34.715 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T09:47:34.715 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T09:47:34.715 INFO:teuthology.provision.fog.trial044:Deploy complete!
2026-02-12T09:47:34.716 DEBUG:teuthology.parallel:result is None
2026-02-12T09:47:35.114 INFO:teuthology.lock.ops:Checking trial044.front.sepia.ceph.com
2026-02-12T09:47:35.114 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T09:47:35.213 INFO:teuthology.lock.ops:Checking trial098.front.sepia.ceph.com
2026-02-12T09:47:35.213 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T09:47:35.276 INFO:teuthology.lock.ops:Updating [trial044.front.sepia.ceph.com]: set os type and version on server
2026-02-12T09:47:35.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial044.front.sepia.ceph.com'
2026-02-12T09:47:35.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:47:35.337 DEBUG:teuthology.orchestra.run.trial044:> true
2026-02-12T09:47:35.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial044.front.sepia.ceph.com'
2026-02-12T09:47:35.412 DEBUG:teuthology.orchestra.run.trial044:> uname -m
2026-02-12T09:47:35.470 INFO:teuthology.orchestra.run.trial044.stdout:x86_64
2026-02-12T09:47:35.470 DEBUG:teuthology.orchestra.run.trial044:> cat /etc/os-release
2026-02-12T09:47:35.526 INFO:teuthology.orchestra.run.trial044.stdout:NAME="CentOS Stream"
2026-02-12T09:47:35.526 INFO:teuthology.orchestra.run.trial044.stdout:VERSION="9"
2026-02-12T09:47:35.526 INFO:teuthology.orchestra.run.trial044.stdout:ID="centos"
2026-02-12T09:47:35.526 INFO:teuthology.orchestra.run.trial044.stdout:ID_LIKE="rhel fedora"
2026-02-12T09:47:35.526 INFO:teuthology.orchestra.run.trial044.stdout:VERSION_ID="9"
2026-02-12T09:47:35.527 INFO:teuthology.orchestra.run.trial044.stdout:PLATFORM_ID="platform:el9"
2026-02-12T09:47:35.527 INFO:teuthology.orchestra.run.trial044.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T09:47:35.527 INFO:teuthology.orchestra.run.trial044.stdout:ANSI_COLOR="0;31"
2026-02-12T09:47:35.527 INFO:teuthology.orchestra.run.trial044.stdout:LOGO="fedora-logo-icon"
2026-02-12T09:47:35.527 INFO:teuthology.orchestra.run.trial044.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T09:47:35.527 INFO:teuthology.orchestra.run.trial044.stdout:HOME_URL="https://centos.org/"
2026-02-12T09:47:35.527 INFO:teuthology.orchestra.run.trial044.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T09:47:35.527 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T09:47:35.527 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T09:47:35.528 INFO:teuthology.lock.ops:Updating trial044.front.sepia.ceph.com on lock server
2026-02-12T09:47:35.631 INFO:teuthology.lock.ops:Updating [trial098.front.sepia.ceph.com]: set os type and version on server
2026-02-12T09:47:35.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial098.front.sepia.ceph.com'
2026-02-12T09:47:35.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:47:35.701 DEBUG:teuthology.orchestra.run.trial098:> true
2026-02-12T09:47:35.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial098.front.sepia.ceph.com'
2026-02-12T09:47:35.775 DEBUG:teuthology.orchestra.run.trial098:> uname -m
2026-02-12T09:47:35.831 INFO:teuthology.orchestra.run.trial098.stdout:x86_64
2026-02-12T09:47:35.831 DEBUG:teuthology.orchestra.run.trial098:> cat /etc/os-release
2026-02-12T09:47:35.887 INFO:teuthology.orchestra.run.trial098.stdout:NAME="CentOS Stream"
2026-02-12T09:47:35.888 INFO:teuthology.orchestra.run.trial098.stdout:VERSION="9"
2026-02-12T09:47:35.888 INFO:teuthology.orchestra.run.trial098.stdout:ID="centos"
2026-02-12T09:47:35.888 INFO:teuthology.orchestra.run.trial098.stdout:ID_LIKE="rhel fedora"
2026-02-12T09:47:35.888 INFO:teuthology.orchestra.run.trial098.stdout:VERSION_ID="9"
2026-02-12T09:47:35.888 INFO:teuthology.orchestra.run.trial098.stdout:PLATFORM_ID="platform:el9"
2026-02-12T09:47:35.888 INFO:teuthology.orchestra.run.trial098.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T09:47:35.888 INFO:teuthology.orchestra.run.trial098.stdout:ANSI_COLOR="0;31"
2026-02-12T09:47:35.888 INFO:teuthology.orchestra.run.trial098.stdout:LOGO="fedora-logo-icon"
2026-02-12T09:47:35.888 INFO:teuthology.orchestra.run.trial098.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T09:47:35.888 INFO:teuthology.orchestra.run.trial098.stdout:HOME_URL="https://centos.org/"
2026-02-12T09:47:35.888 INFO:teuthology.orchestra.run.trial098.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T09:47:35.889 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T09:47:35.889 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T09:47:35.889 INFO:teuthology.lock.ops:Updating trial098.front.sepia.ceph.com on lock server
2026-02-12T09:47:35.992 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:47:36.090 INFO:teuthology.dispatcher.supervisor:Running job 41716
2026-02-12T09:47:36.090 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/bin/teuthology -v --owner scheduled_matan@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41716 --name matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/crimson_bluestore thrashers/{pggrow} thrashosds-health workloads/radosbench-high-concurrency} -- /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41716/orig.config.yaml
2026-02-12T09:47:36.090 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41716
2026-02-12T09:47:36.090 INFO:teuthology.dispatcher.supervisor:Job PID: 3520719
2026-02-12T09:47:36.090 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T09:49:36.190 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:51:36.396 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:53:36.611 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:55:36.804 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:57:37.015 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:59:37.195 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:01:37.319 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:03:37.459 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:05:37.638 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:07:37.840 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:09:38.017 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:11:38.126 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:13:38.324 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:15:38.431 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:17:38.644 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:19:38.769 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:19:38.846 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-12T10:19:38.962 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T10:19:39.497 INFO:teuthology.orchestra.console.trial044:Power off
2026-02-12T10:19:39.497 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T10:19:39.521 INFO:teuthology.orchestra.console.trial098:Power off
2026-02-12T10:19:39.522 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T10:19:39.538 DEBUG:teuthology.orchestra.console.trial044:power off output: Chassis Power Control: Down/Off
2026-02-12T10:19:39.561 DEBUG:teuthology.orchestra.console.trial098:power off output: Chassis Power Control: Down/Off
2026-02-12T10:19:43.543 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:19:43.561 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:19:43.651 DEBUG:teuthology.orchestra.console.trial044:check power output: Chassis Power is on
2026-02-12T10:19:43.669 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is on
2026-02-12T10:19:47.656 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:19:47.670 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:19:47.764 DEBUG:teuthology.orchestra.console.trial044:check power output: Chassis Power is off
2026-02-12T10:19:47.765 INFO:teuthology.orchestra.console.trial044:Power off completed
2026-02-12T10:19:47.777 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is off
2026-02-12T10:19:47.777 INFO:teuthology.orchestra.console.trial098:Power off completed
2026-02-12T10:19:48.008 INFO:teuthology.lock.ops:unlocked: trial044.front.sepia.ceph.com
2026-02-12T10:19:48.021 INFO:teuthology.lock.ops:unlocked: trial098.front.sepia.ceph.com