2026-02-12T10:18:27.582 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062
2026-02-12T10:18:27.583 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:18:27.656 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:18:27.855 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7e3c52b27c80>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7e3c523787c0>, signals=[15])
2026-02-12T10:18:27.855 INFO:teuthology.lock.ops:Start node 'trial057.front.sepia.ceph.com' reimaging
2026-02-12T10:18:27.855 INFO:teuthology.lock.ops:Updating [trial057.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T10:18:27.855 INFO:teuthology.lock.ops:Updating trial057.front.sepia.ceph.com on lock server
2026-02-12T10:18:27.913 INFO:teuthology.lock.ops:Start node 'trial197.front.sepia.ceph.com' reimaging
2026-02-12T10:18:27.913 INFO:teuthology.lock.ops:Updating [trial197.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T10:18:27.913 INFO:teuthology.lock.ops:Updating trial197.front.sepia.ceph.com on lock server
2026-02-12T10:18:28.152 DEBUG:teuthology.provision.fog.trial057:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T10:18:28.173 DEBUG:teuthology.provision.fog.trial197:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T10:18:28.211 INFO:teuthology.provision.fog.trial057:Scheduling deploy of centos 9.stream
2026-02-12T10:18:28.229 INFO:teuthology.provision.fog.trial197:Scheduling deploy of centos 9.stream
2026-02-12T10:18:29.117 INFO:teuthology.orchestra.console.trial197:Power off
2026-02-12T10:18:29.117 DEBUG:teuthology.orchestra.console.trial197:pexpect command: ipmitool -H trial197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T10:18:29.171 DEBUG:teuthology.orchestra.console.trial197:power off output: Chassis Power Control: Down/Off
2026-02-12T10:18:29.184 INFO:teuthology.orchestra.console.trial057:Power off
2026-02-12T10:18:29.184 DEBUG:teuthology.orchestra.console.trial057:pexpect command: ipmitool -H trial057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T10:18:29.221 DEBUG:teuthology.orchestra.console.trial057:power off output: Chassis Power Control: Down/Off
2026-02-12T10:18:33.176 DEBUG:teuthology.orchestra.console.trial197:pexpect command: ipmitool -H trial197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:18:33.222 DEBUG:teuthology.orchestra.console.trial057:pexpect command: ipmitool -H trial057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:18:33.285 DEBUG:teuthology.orchestra.console.trial197:check power output: Chassis Power is off
2026-02-12T10:18:33.285 INFO:teuthology.orchestra.console.trial197:Power off completed
2026-02-12T10:18:33.330 DEBUG:teuthology.orchestra.console.trial057:check power output: Chassis Power is off
2026-02-12T10:18:33.330 INFO:teuthology.orchestra.console.trial057:Power off completed
2026-02-12T10:18:33.386 INFO:teuthology.orchestra.console.trial197:Power on
2026-02-12T10:18:33.386 DEBUG:teuthology.orchestra.console.trial197:pexpect command: ipmitool -H trial197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T10:18:33.426 DEBUG:teuthology.orchestra.console.trial197:power on output: Chassis Power Control: Up/On
2026-02-12T10:18:33.431 INFO:teuthology.orchestra.console.trial057:Power on
2026-02-12T10:18:33.431 DEBUG:teuthology.orchestra.console.trial057:pexpect command: ipmitool -H trial057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T10:18:33.471 DEBUG:teuthology.orchestra.console.trial057:power on output: Chassis Power Control: Up/On
2026-02-12T10:18:37.430 DEBUG:teuthology.orchestra.console.trial197:pexpect command: ipmitool -H trial197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:18:37.471 DEBUG:teuthology.orchestra.console.trial057:pexpect command: ipmitool -H trial057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:18:37.539 DEBUG:teuthology.orchestra.console.trial197:check power output: Chassis Power is on
2026-02-12T10:18:37.539 INFO:teuthology.orchestra.console.trial197:Power on completed
2026-02-12T10:18:37.579 DEBUG:teuthology.orchestra.console.trial057:check power output: Chassis Power is on
2026-02-12T10:18:37.580 INFO:teuthology.orchestra.console.trial057:Power on completed
2026-02-12T10:18:37.640 INFO:teuthology.provision.fog.trial197:Waiting for deploy to finish
2026-02-12T10:18:37.680 INFO:teuthology.provision.fog.trial057:Waiting for deploy to finish
2026-02-12T10:20:24.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:20:25.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial197.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:20:27.997 WARNING:teuthology.provision.fog.trial057:[Errno None] Unable to connect to port 22 on 10.20.193.57
2026-02-12T10:20:28.125 WARNING:teuthology.provision.fog.trial197:[Errno None] Unable to connect to port 22 on 10.20.193.197
2026-02-12T10:20:34.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:20:34.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial197.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:20:37.085 WARNING:teuthology.provision.fog.trial057:[Errno None] Unable to connect to port 22 on 10.20.193.57
2026-02-12T10:20:37.213 WARNING:teuthology.provision.fog.trial197:[Errno None] Unable to connect to port 22 on 10.20.193.197
2026-02-12T10:20:43.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:20:43.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial197.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:20:46.173 WARNING:teuthology.provision.fog.trial057:[Errno None] Unable to connect to port 22 on 10.20.193.57
2026-02-12T10:20:46.301 WARNING:teuthology.provision.fog.trial197:[Errno None] Unable to connect to port 22 on 10.20.193.197
2026-02-12T10:20:52.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:20:52.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial197.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:20:55.261 WARNING:teuthology.provision.fog.trial057:[Errno None] Unable to connect to port 22 on 10.20.193.57
2026-02-12T10:20:55.389 WARNING:teuthology.provision.fog.trial197:[Errno None] Unable to connect to port 22 on 10.20.193.197
2026-02-12T10:21:01.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:21:01.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial197.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:21:37.482 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T10:21:37.482 DEBUG:teuthology.orchestra.run.trial197:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T10:21:37.516 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T10:21:37.516 DEBUG:teuthology.orchestra.run.trial057:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T10:21:37.674 INFO:teuthology.provision.fog.trial057:Node is ready
2026-02-12T10:21:37.675 DEBUG:teuthology.orchestra.run.trial057:> hostname
2026-02-12T10:21:37.711 INFO:teuthology.provision.fog.trial197:Node is ready
2026-02-12T10:21:37.711 DEBUG:teuthology.orchestra.run.trial197:> hostname
2026-02-12T10:21:37.735 INFO:teuthology.orchestra.run.trial057.stdout:trial057.front.sepia.ceph.com
2026-02-12T10:21:37.735 DEBUG:teuthology.orchestra.run.trial057:> grep trial057.front.sepia.ceph.com /etc/hosts
2026-02-12T10:21:37.768 INFO:teuthology.orchestra.run.trial197.stdout:trial197.front.sepia.ceph.com
2026-02-12T10:21:37.769 DEBUG:teuthology.orchestra.run.trial197:> grep trial197.front.sepia.ceph.com /etc/hosts
2026-02-12T10:21:37.794 INFO:teuthology.orchestra.run.trial057.stdout:10.20.193.57 trial057.front.sepia.ceph.com trial057
2026-02-12T10:21:37.794 DEBUG:teuthology.orchestra.run.trial057:> sudo hostname trial057
2026-02-12T10:21:37.825 INFO:teuthology.orchestra.run.trial197.stdout:10.20.193.197 trial197.front.sepia.ceph.com trial197
2026-02-12T10:21:37.826 DEBUG:teuthology.orchestra.run.trial197:> sudo hostname trial197
2026-02-12T10:21:37.867 DEBUG:teuthology.orchestra.run.trial057:> sudo sed -i -e 's/trial057.front.sepia.ceph.com/trial057/g' /etc/hosts
2026-02-12T10:21:37.899 DEBUG:teuthology.orchestra.run.trial197:> sudo sed -i -e 's/trial197.front.sepia.ceph.com/trial197/g' /etc/hosts
2026-02-12T10:21:37.936 DEBUG:teuthology.orchestra.run.trial057:> sudo sed -i -e 's/10.20.193.57/10.20.193.57/g' /etc/hosts
2026-02-12T10:21:37.964 DEBUG:teuthology.orchestra.run.trial197:> sudo sed -i -e 's/10.20.193.197/10.20.193.197/g' /etc/hosts
2026-02-12T10:21:38.004 DEBUG:teuthology.orchestra.run.trial057:> sudo sed -i -e 's/trial057.front.sepia.ceph.com/trial057/g' /etc/hostname
2026-02-12T10:21:38.029 DEBUG:teuthology.orchestra.run.trial197:> sudo sed -i -e 's/trial197.front.sepia.ceph.com/trial197/g' /etc/hostname
2026-02-12T10:21:38.072 DEBUG:teuthology.orchestra.run.trial057:> sudo hostname trial057
2026-02-12T10:21:38.096 DEBUG:teuthology.orchestra.run.trial197:> sudo hostname trial197
2026-02-12T10:21:38.140 DEBUG:teuthology.orchestra.run.trial057:> cat /etc/os-release
2026-02-12T10:21:38.161 DEBUG:teuthology.orchestra.run.trial197:> cat /etc/os-release
2026-02-12T10:21:38.200 INFO:teuthology.orchestra.run.trial057.stdout:NAME="CentOS Stream"
2026-02-12T10:21:38.200 INFO:teuthology.orchestra.run.trial057.stdout:VERSION="9"
2026-02-12T10:21:38.200 INFO:teuthology.orchestra.run.trial057.stdout:ID="centos"
2026-02-12T10:21:38.200 INFO:teuthology.orchestra.run.trial057.stdout:ID_LIKE="rhel fedora"
2026-02-12T10:21:38.200 INFO:teuthology.orchestra.run.trial057.stdout:VERSION_ID="9"
2026-02-12T10:21:38.200 INFO:teuthology.orchestra.run.trial057.stdout:PLATFORM_ID="platform:el9"
2026-02-12T10:21:38.200 INFO:teuthology.orchestra.run.trial057.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T10:21:38.201 INFO:teuthology.orchestra.run.trial057.stdout:ANSI_COLOR="0;31"
2026-02-12T10:21:38.201 INFO:teuthology.orchestra.run.trial057.stdout:LOGO="fedora-logo-icon"
2026-02-12T10:21:38.201 INFO:teuthology.orchestra.run.trial057.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T10:21:38.201 INFO:teuthology.orchestra.run.trial057.stdout:HOME_URL="https://centos.org/"
2026-02-12T10:21:38.201 INFO:teuthology.orchestra.run.trial057.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T10:21:38.201 INFO:teuthology.orchestra.run.trial057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T10:21:38.201 INFO:teuthology.orchestra.run.trial057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T10:21:38.202 INFO:teuthology.provision.fog.trial057:Deploy complete!
2026-02-12T10:21:38.203 DEBUG:teuthology.parallel:result is None
2026-02-12T10:21:38.219 INFO:teuthology.orchestra.run.trial197.stdout:NAME="CentOS Stream"
2026-02-12T10:21:38.220 INFO:teuthology.orchestra.run.trial197.stdout:VERSION="9"
2026-02-12T10:21:38.220 INFO:teuthology.orchestra.run.trial197.stdout:ID="centos"
2026-02-12T10:21:38.220 INFO:teuthology.orchestra.run.trial197.stdout:ID_LIKE="rhel fedora"
2026-02-12T10:21:38.220 INFO:teuthology.orchestra.run.trial197.stdout:VERSION_ID="9"
2026-02-12T10:21:38.220 INFO:teuthology.orchestra.run.trial197.stdout:PLATFORM_ID="platform:el9"
2026-02-12T10:21:38.220 INFO:teuthology.orchestra.run.trial197.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T10:21:38.220 INFO:teuthology.orchestra.run.trial197.stdout:ANSI_COLOR="0;31"
2026-02-12T10:21:38.220 INFO:teuthology.orchestra.run.trial197.stdout:LOGO="fedora-logo-icon"
2026-02-12T10:21:38.220 INFO:teuthology.orchestra.run.trial197.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T10:21:38.221 INFO:teuthology.orchestra.run.trial197.stdout:HOME_URL="https://centos.org/"
2026-02-12T10:21:38.221 INFO:teuthology.orchestra.run.trial197.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T10:21:38.221 INFO:teuthology.orchestra.run.trial197.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T10:21:38.221 INFO:teuthology.orchestra.run.trial197.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T10:21:38.221 INFO:teuthology.provision.fog.trial197:Deploy complete!
2026-02-12T10:21:38.222 DEBUG:teuthology.parallel:result is None
2026-02-12T10:21:38.624 INFO:teuthology.lock.ops:Checking trial057.front.sepia.ceph.com
2026-02-12T10:21:38.624 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T10:21:38.726 INFO:teuthology.lock.ops:Checking trial197.front.sepia.ceph.com
2026-02-12T10:21:38.726 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T10:21:38.788 INFO:teuthology.lock.ops:Updating [trial057.front.sepia.ceph.com]: set os type and version on server
2026-02-12T10:21:38.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial057.front.sepia.ceph.com'
2026-02-12T10:21:38.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:21:38.851 DEBUG:teuthology.orchestra.run.trial057:> true
2026-02-12T10:21:38.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial057.front.sepia.ceph.com'
2026-02-12T10:21:38.928 DEBUG:teuthology.orchestra.run.trial057:> uname -m
2026-02-12T10:21:39.032 INFO:teuthology.orchestra.run.trial057.stdout:x86_64
2026-02-12T10:21:39.032 DEBUG:teuthology.orchestra.run.trial057:> cat /etc/os-release
2026-02-12T10:21:39.077 INFO:teuthology.orchestra.run.trial057.stdout:NAME="CentOS Stream"
2026-02-12T10:21:39.077 INFO:teuthology.orchestra.run.trial057.stdout:VERSION="9"
2026-02-12T10:21:39.077 INFO:teuthology.orchestra.run.trial057.stdout:ID="centos"
2026-02-12T10:21:39.077 INFO:teuthology.orchestra.run.trial057.stdout:ID_LIKE="rhel fedora"
2026-02-12T10:21:39.078 INFO:teuthology.orchestra.run.trial057.stdout:VERSION_ID="9"
2026-02-12T10:21:39.078 INFO:teuthology.orchestra.run.trial057.stdout:PLATFORM_ID="platform:el9"
2026-02-12T10:21:39.078 INFO:teuthology.orchestra.run.trial057.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T10:21:39.078 INFO:teuthology.orchestra.run.trial057.stdout:ANSI_COLOR="0;31"
2026-02-12T10:21:39.078 INFO:teuthology.orchestra.run.trial057.stdout:LOGO="fedora-logo-icon"
2026-02-12T10:21:39.078 INFO:teuthology.orchestra.run.trial057.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T10:21:39.078 INFO:teuthology.orchestra.run.trial057.stdout:HOME_URL="https://centos.org/"
2026-02-12T10:21:39.078 INFO:teuthology.orchestra.run.trial057.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T10:21:39.078 INFO:teuthology.orchestra.run.trial057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T10:21:39.078 INFO:teuthology.orchestra.run.trial057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T10:21:39.079 INFO:teuthology.lock.ops:Updating trial057.front.sepia.ceph.com on lock server
2026-02-12T10:21:39.185 INFO:teuthology.lock.ops:Updating [trial197.front.sepia.ceph.com]: set os type and version on server
2026-02-12T10:21:39.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial197.front.sepia.ceph.com'
2026-02-12T10:21:39.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial197.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:21:39.256 DEBUG:teuthology.orchestra.run.trial197:> true
2026-02-12T10:21:39.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial197.front.sepia.ceph.com'
2026-02-12T10:21:39.344 DEBUG:teuthology.orchestra.run.trial197:> uname -m
2026-02-12T10:21:39.401 INFO:teuthology.orchestra.run.trial197.stdout:x86_64
2026-02-12T10:21:39.402 DEBUG:teuthology.orchestra.run.trial197:> cat /etc/os-release
2026-02-12T10:21:39.458 INFO:teuthology.orchestra.run.trial197.stdout:NAME="CentOS Stream"
2026-02-12T10:21:39.458 INFO:teuthology.orchestra.run.trial197.stdout:VERSION="9"
2026-02-12T10:21:39.459 INFO:teuthology.orchestra.run.trial197.stdout:ID="centos"
2026-02-12T10:21:39.459 INFO:teuthology.orchestra.run.trial197.stdout:ID_LIKE="rhel fedora"
2026-02-12T10:21:39.459 INFO:teuthology.orchestra.run.trial197.stdout:VERSION_ID="9"
2026-02-12T10:21:39.459 INFO:teuthology.orchestra.run.trial197.stdout:PLATFORM_ID="platform:el9"
2026-02-12T10:21:39.459 INFO:teuthology.orchestra.run.trial197.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T10:21:39.459 INFO:teuthology.orchestra.run.trial197.stdout:ANSI_COLOR="0;31"
2026-02-12T10:21:39.459 INFO:teuthology.orchestra.run.trial197.stdout:LOGO="fedora-logo-icon"
2026-02-12T10:21:39.459 INFO:teuthology.orchestra.run.trial197.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T10:21:39.459 INFO:teuthology.orchestra.run.trial197.stdout:HOME_URL="https://centos.org/"
2026-02-12T10:21:39.459 INFO:teuthology.orchestra.run.trial197.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T10:21:39.459 INFO:teuthology.orchestra.run.trial197.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T10:21:39.460 INFO:teuthology.orchestra.run.trial197.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T10:21:39.460 INFO:teuthology.lock.ops:Updating trial197.front.sepia.ceph.com on lock server
2026-02-12T10:21:39.565 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:21:39.659 INFO:teuthology.dispatcher.supervisor:Running job 41762
2026-02-12T10:21:39.659 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/bin/teuthology -v --owner scheduled_matan@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41762 --name matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/crimson_bluestore thrashers/{default} thrashosds-health workloads/pool-snaps-few-objects} -- /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41762/orig.config.yaml
2026-02-12T10:21:39.659 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41762
2026-02-12T10:21:39.659 INFO:teuthology.dispatcher.supervisor:Job PID: 3611270
2026-02-12T10:21:39.659 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T10:23:39.760 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:25:39.954 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:27:40.124 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:29:40.283 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:31:40.445 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:33:40.649 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:35:40.765 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:37:40.932 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:39:41.093 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:41:41.292 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:43:41.499 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:45:41.707 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:47:41.904 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:49:42.055 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:51:42.254 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:53:42.461 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:55:42.681 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:57:42.874 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:59:43.069 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:01:43.272 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:03:43.478 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:05:43.665 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:07:43.840 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:09:44.026 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:11:44.171 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:13:44.246 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:15:44.360 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:17:44.510 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:19:44.720 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:21:44.901 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:23:45.132 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:23:45.231 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-12T11:23:45.348 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T11:23:45.858 INFO:teuthology.orchestra.console.trial197:Power off
2026-02-12T11:23:45.858 DEBUG:teuthology.orchestra.console.trial197:pexpect command: ipmitool -H trial197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T11:23:45.875 INFO:teuthology.orchestra.console.trial057:Power off
2026-02-12T11:23:45.875 DEBUG:teuthology.orchestra.console.trial057:pexpect command: ipmitool -H trial057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T11:23:45.897 DEBUG:teuthology.orchestra.console.trial197:power off output: Chassis Power Control: Down/Off
2026-02-12T11:23:45.915 DEBUG:teuthology.orchestra.console.trial057:power off output: Chassis Power Control: Down/Off
2026-02-12T11:23:49.902 DEBUG:teuthology.orchestra.console.trial197:pexpect command: ipmitool -H trial197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:23:49.915 DEBUG:teuthology.orchestra.console.trial057:pexpect command: ipmitool -H trial057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:23:50.010 DEBUG:teuthology.orchestra.console.trial197:check power output: Chassis Power is on
2026-02-12T11:23:50.024 DEBUG:teuthology.orchestra.console.trial057:check power output: Chassis Power is on
2026-02-12T11:23:54.015 DEBUG:teuthology.orchestra.console.trial197:pexpect command: ipmitool -H trial197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:23:54.025 DEBUG:teuthology.orchestra.console.trial057:pexpect command: ipmitool -H trial057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:23:54.126 DEBUG:teuthology.orchestra.console.trial197:check power output: Chassis Power is off
2026-02-12T11:23:54.126 INFO:teuthology.orchestra.console.trial197:Power off completed
2026-02-12T11:23:54.136 DEBUG:teuthology.orchestra.console.trial057:check power output: Chassis Power is off
2026-02-12T11:23:54.136 INFO:teuthology.orchestra.console.trial057:Power off completed
2026-02-12T11:23:54.377 INFO:teuthology.lock.ops:unlocked: trial197.front.sepia.ceph.com
2026-02-12T11:23:54.389 INFO:teuthology.lock.ops:unlocked: trial057.front.sepia.ceph.com