2026-02-12T10:23:33.117 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062
2026-02-12T10:23:33.117 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:23:33.188 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:23:33.378 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x70a5619d77a0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x70a561240400>, signals=[15])
2026-02-12T10:23:33.378 INFO:teuthology.lock.ops:Start node 'trial151.front.sepia.ceph.com' reimaging
2026-02-12T10:23:33.378 INFO:teuthology.lock.ops:Updating [trial151.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T10:23:33.378 INFO:teuthology.lock.ops:Updating trial151.front.sepia.ceph.com on lock server
2026-02-12T10:23:33.434 INFO:teuthology.lock.ops:Start node 'trial188.front.sepia.ceph.com' reimaging
2026-02-12T10:23:33.434 INFO:teuthology.lock.ops:Updating [trial188.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T10:23:33.434 INFO:teuthology.lock.ops:Updating trial188.front.sepia.ceph.com on lock server
2026-02-12T10:23:33.661 DEBUG:teuthology.provision.fog.trial151:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T10:23:33.712 INFO:teuthology.provision.fog.trial151:Scheduling deploy of centos 9.stream
2026-02-12T10:23:33.850 DEBUG:teuthology.provision.fog.trial188:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T10:23:33.903 INFO:teuthology.provision.fog.trial188:Scheduling deploy of centos 9.stream
2026-02-12T10:23:34.651 INFO:teuthology.orchestra.console.trial151:Power off
2026-02-12T10:23:34.651 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T10:23:34.689 DEBUG:teuthology.orchestra.console.trial151:power off output: Chassis Power Control: Down/Off
2026-02-12T10:23:35.000 INFO:teuthology.orchestra.console.trial188:Power off
2026-02-12T10:23:35.000 DEBUG:teuthology.orchestra.console.trial188:pexpect command: ipmitool -H trial188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T10:23:35.037 DEBUG:teuthology.orchestra.console.trial188:power off output: Chassis Power Control: Down/Off
2026-02-12T10:23:38.694 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:23:38.804 DEBUG:teuthology.orchestra.console.trial151:check power output: Chassis Power is off
2026-02-12T10:23:38.804 INFO:teuthology.orchestra.console.trial151:Power off completed
2026-02-12T10:23:38.905 INFO:teuthology.orchestra.console.trial151:Power on
2026-02-12T10:23:38.905 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T10:23:38.945 DEBUG:teuthology.orchestra.console.trial151:power on output: Chassis Power Control: Up/On
2026-02-12T10:23:39.038 DEBUG:teuthology.orchestra.console.trial188:pexpect command: ipmitool -H trial188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:23:39.148 DEBUG:teuthology.orchestra.console.trial188:check power output: Chassis Power is off
2026-02-12T10:23:39.148 INFO:teuthology.orchestra.console.trial188:Power off completed
2026-02-12T10:23:39.248 INFO:teuthology.orchestra.console.trial188:Power on
2026-02-12T10:23:39.249 DEBUG:teuthology.orchestra.console.trial188:pexpect command: ipmitool -H trial188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T10:23:39.290 DEBUG:teuthology.orchestra.console.trial188:power on output: Chassis Power Control: Up/On
2026-02-12T10:23:42.949 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:23:43.059 DEBUG:teuthology.orchestra.console.trial151:check power output: Chassis Power is on
2026-02-12T10:23:43.059 INFO:teuthology.orchestra.console.trial151:Power on completed
2026-02-12T10:23:43.160 INFO:teuthology.provision.fog.trial151:Waiting for deploy to finish
2026-02-12T10:23:43.291 DEBUG:teuthology.orchestra.console.trial188:pexpect command: ipmitool -H trial188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:23:43.400 DEBUG:teuthology.orchestra.console.trial188:check power output: Chassis Power is on
2026-02-12T10:23:43.401 INFO:teuthology.orchestra.console.trial188:Power on completed
2026-02-12T10:23:43.502 INFO:teuthology.provision.fog.trial188:Waiting for deploy to finish
2026-02-12T10:25:30.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:25:30.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:25:33.469 WARNING:teuthology.provision.fog.trial151:[Errno None] Unable to connect to port 22 on 10.20.193.151
2026-02-12T10:25:33.725 WARNING:teuthology.provision.fog.trial188:[Errno None] Unable to connect to port 22 on 10.20.193.188
2026-02-12T10:25:39.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:25:39.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:25:42.557 WARNING:teuthology.provision.fog.trial151:[Errno None] Unable to connect to port 22 on 10.20.193.151
2026-02-12T10:25:42.813 WARNING:teuthology.provision.fog.trial188:[Errno None] Unable to connect to port 22 on 10.20.193.188
2026-02-12T10:25:48.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:25:48.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:25:51.645 WARNING:teuthology.provision.fog.trial151:[Errno None] Unable to connect to port 22 on 10.20.193.151
2026-02-12T10:25:51.901 WARNING:teuthology.provision.fog.trial188:[Errno None] Unable to connect to port 22 on 10.20.193.188
2026-02-12T10:25:57.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:25:57.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:26:00.733 WARNING:teuthology.provision.fog.trial151:[Errno None] Unable to connect to port 22 on 10.20.193.151
2026-02-12T10:26:00.989 WARNING:teuthology.provision.fog.trial188:[Errno None] Unable to connect to port 22 on 10.20.193.188
2026-02-12T10:26:06.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:26:06.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:26:42.590 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T10:26:42.591 DEBUG:teuthology.orchestra.run.trial151:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T10:26:42.887 INFO:teuthology.provision.fog.trial151:Node is ready
2026-02-12T10:26:42.887 DEBUG:teuthology.orchestra.run.trial151:> hostname
2026-02-12T10:26:42.905 INFO:teuthology.orchestra.run.trial151.stdout:trial151.front.sepia.ceph.com
2026-02-12T10:26:42.905 DEBUG:teuthology.orchestra.run.trial151:> grep trial151.front.sepia.ceph.com /etc/hosts
2026-02-12T10:26:42.961 INFO:teuthology.orchestra.run.trial151.stdout:10.20.193.151 trial151.front.sepia.ceph.com trial151
2026-02-12T10:26:42.962 DEBUG:teuthology.orchestra.run.trial151:> sudo hostname trial151
2026-02-12T10:26:43.101 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T10:26:43.101 DEBUG:teuthology.orchestra.run.trial188:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T10:26:43.113 DEBUG:teuthology.orchestra.run.trial151:> sudo sed -i -e 's/trial151.front.sepia.ceph.com/trial151/g' /etc/hosts
2026-02-12T10:26:43.178 DEBUG:teuthology.orchestra.run.trial151:> sudo sed -i -e 's/10.20.193.151/10.20.193.151/g' /etc/hosts
2026-02-12T10:26:43.243 DEBUG:teuthology.orchestra.run.trial151:> sudo sed -i -e 's/trial151.front.sepia.ceph.com/trial151/g' /etc/hostname
2026-02-12T10:26:43.308 DEBUG:teuthology.orchestra.run.trial151:> sudo hostname trial151
2026-02-12T10:26:43.361 INFO:teuthology.provision.fog.trial188:Node is ready
2026-02-12T10:26:43.361 DEBUG:teuthology.orchestra.run.trial188:> hostname
2026-02-12T10:26:43.374 DEBUG:teuthology.orchestra.run.trial151:> cat /etc/os-release
2026-02-12T10:26:43.412 INFO:teuthology.orchestra.run.trial188.stdout:trial188.front.sepia.ceph.com
2026-02-12T10:26:43.413 DEBUG:teuthology.orchestra.run.trial188:> grep trial188.front.sepia.ceph.com /etc/hosts
2026-02-12T10:26:43.431 INFO:teuthology.orchestra.run.trial151.stdout:NAME="CentOS Stream"
2026-02-12T10:26:43.431 INFO:teuthology.orchestra.run.trial151.stdout:VERSION="9"
2026-02-12T10:26:43.431 INFO:teuthology.orchestra.run.trial151.stdout:ID="centos"
2026-02-12T10:26:43.431 INFO:teuthology.orchestra.run.trial151.stdout:ID_LIKE="rhel fedora"
2026-02-12T10:26:43.431 INFO:teuthology.orchestra.run.trial151.stdout:VERSION_ID="9"
2026-02-12T10:26:43.431 INFO:teuthology.orchestra.run.trial151.stdout:PLATFORM_ID="platform:el9"
2026-02-12T10:26:43.431 INFO:teuthology.orchestra.run.trial151.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T10:26:43.431 INFO:teuthology.orchestra.run.trial151.stdout:ANSI_COLOR="0;31"
2026-02-12T10:26:43.432 INFO:teuthology.orchestra.run.trial151.stdout:LOGO="fedora-logo-icon"
2026-02-12T10:26:43.432 INFO:teuthology.orchestra.run.trial151.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T10:26:43.432 INFO:teuthology.orchestra.run.trial151.stdout:HOME_URL="https://centos.org/"
2026-02-12T10:26:43.432 INFO:teuthology.orchestra.run.trial151.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T10:26:43.432 INFO:teuthology.orchestra.run.trial151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T10:26:43.432 INFO:teuthology.orchestra.run.trial151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T10:26:43.433 INFO:teuthology.provision.fog.trial151:Deploy complete!
2026-02-12T10:26:43.434 DEBUG:teuthology.parallel:result is None
2026-02-12T10:26:43.470 INFO:teuthology.orchestra.run.trial188.stdout:10.20.193.188 trial188.front.sepia.ceph.com trial188
2026-02-12T10:26:43.471 DEBUG:teuthology.orchestra.run.trial188:> sudo hostname trial188
2026-02-12T10:26:43.511 DEBUG:teuthology.orchestra.run.trial188:> sudo sed -i -e 's/trial188.front.sepia.ceph.com/trial188/g' /etc/hosts
2026-02-12T10:26:43.577 DEBUG:teuthology.orchestra.run.trial188:> sudo sed -i -e 's/10.20.193.188/10.20.193.188/g' /etc/hosts
2026-02-12T10:26:43.643 DEBUG:teuthology.orchestra.run.trial188:> sudo sed -i -e 's/trial188.front.sepia.ceph.com/trial188/g' /etc/hostname
2026-02-12T10:26:43.716 DEBUG:teuthology.orchestra.run.trial188:> sudo hostname trial188
2026-02-12T10:26:43.781 DEBUG:teuthology.orchestra.run.trial188:> cat /etc/os-release
2026-02-12T10:26:43.836 INFO:teuthology.orchestra.run.trial188.stdout:NAME="CentOS Stream"
2026-02-12T10:26:43.836 INFO:teuthology.orchestra.run.trial188.stdout:VERSION="9"
2026-02-12T10:26:43.836 INFO:teuthology.orchestra.run.trial188.stdout:ID="centos"
2026-02-12T10:26:43.836 INFO:teuthology.orchestra.run.trial188.stdout:ID_LIKE="rhel fedora"
2026-02-12T10:26:43.836 INFO:teuthology.orchestra.run.trial188.stdout:VERSION_ID="9"
2026-02-12T10:26:43.837 INFO:teuthology.orchestra.run.trial188.stdout:PLATFORM_ID="platform:el9"
2026-02-12T10:26:43.837 INFO:teuthology.orchestra.run.trial188.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T10:26:43.837 INFO:teuthology.orchestra.run.trial188.stdout:ANSI_COLOR="0;31"
2026-02-12T10:26:43.837 INFO:teuthology.orchestra.run.trial188.stdout:LOGO="fedora-logo-icon"
2026-02-12T10:26:43.837 INFO:teuthology.orchestra.run.trial188.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T10:26:43.837 INFO:teuthology.orchestra.run.trial188.stdout:HOME_URL="https://centos.org/"
2026-02-12T10:26:43.837 INFO:teuthology.orchestra.run.trial188.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T10:26:43.837 INFO:teuthology.orchestra.run.trial188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T10:26:43.837 INFO:teuthology.orchestra.run.trial188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T10:26:43.838 INFO:teuthology.provision.fog.trial188:Deploy complete!
2026-02-12T10:26:43.839 DEBUG:teuthology.parallel:result is None
2026-02-12T10:26:44.256 INFO:teuthology.lock.ops:Checking trial151.front.sepia.ceph.com
2026-02-12T10:26:44.257 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T10:26:44.364 INFO:teuthology.lock.ops:Checking trial188.front.sepia.ceph.com
2026-02-12T10:26:44.364 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T10:26:44.427 INFO:teuthology.lock.ops:Updating [trial151.front.sepia.ceph.com]: set os type and version on server
2026-02-12T10:26:44.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial151.front.sepia.ceph.com'
2026-02-12T10:26:44.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:26:44.486 DEBUG:teuthology.orchestra.run.trial151:> true
2026-02-12T10:26:44.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial151.front.sepia.ceph.com'
2026-02-12T10:26:44.560 DEBUG:teuthology.orchestra.run.trial151:> uname -m
2026-02-12T10:26:44.615 INFO:teuthology.orchestra.run.trial151.stdout:x86_64
2026-02-12T10:26:44.615 DEBUG:teuthology.orchestra.run.trial151:> cat /etc/os-release
2026-02-12T10:26:44.670 INFO:teuthology.orchestra.run.trial151.stdout:NAME="CentOS Stream"
2026-02-12T10:26:44.670 INFO:teuthology.orchestra.run.trial151.stdout:VERSION="9"
2026-02-12T10:26:44.671 INFO:teuthology.orchestra.run.trial151.stdout:ID="centos"
2026-02-12T10:26:44.671 INFO:teuthology.orchestra.run.trial151.stdout:ID_LIKE="rhel fedora"
2026-02-12T10:26:44.671 INFO:teuthology.orchestra.run.trial151.stdout:VERSION_ID="9"
2026-02-12T10:26:44.671 INFO:teuthology.orchestra.run.trial151.stdout:PLATFORM_ID="platform:el9"
2026-02-12T10:26:44.671 INFO:teuthology.orchestra.run.trial151.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T10:26:44.671 INFO:teuthology.orchestra.run.trial151.stdout:ANSI_COLOR="0;31"
2026-02-12T10:26:44.671 INFO:teuthology.orchestra.run.trial151.stdout:LOGO="fedora-logo-icon"
2026-02-12T10:26:44.671 INFO:teuthology.orchestra.run.trial151.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T10:26:44.671 INFO:teuthology.orchestra.run.trial151.stdout:HOME_URL="https://centos.org/"
2026-02-12T10:26:44.671 INFO:teuthology.orchestra.run.trial151.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T10:26:44.671 INFO:teuthology.orchestra.run.trial151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T10:26:44.671 INFO:teuthology.orchestra.run.trial151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T10:26:44.671 INFO:teuthology.lock.ops:Updating trial151.front.sepia.ceph.com on lock server
2026-02-12T10:26:44.730 INFO:teuthology.lock.ops:Updating [trial188.front.sepia.ceph.com]: set os type and version on server
2026-02-12T10:26:44.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com'
2026-02-12T10:26:44.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:26:44.791 DEBUG:teuthology.orchestra.run.trial188:> true
2026-02-12T10:26:44.863 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com'
2026-02-12T10:26:44.863 DEBUG:teuthology.orchestra.run.trial188:> uname -m
2026-02-12T10:26:44.919 INFO:teuthology.orchestra.run.trial188.stdout:x86_64
2026-02-12T10:26:44.919 DEBUG:teuthology.orchestra.run.trial188:> cat /etc/os-release
2026-02-12T10:26:44.975 INFO:teuthology.orchestra.run.trial188.stdout:NAME="CentOS Stream"
2026-02-12T10:26:44.975 INFO:teuthology.orchestra.run.trial188.stdout:VERSION="9"
2026-02-12T10:26:44.975 INFO:teuthology.orchestra.run.trial188.stdout:ID="centos"
2026-02-12T10:26:44.975 INFO:teuthology.orchestra.run.trial188.stdout:ID_LIKE="rhel fedora"
2026-02-12T10:26:44.975 INFO:teuthology.orchestra.run.trial188.stdout:VERSION_ID="9"
2026-02-12T10:26:44.975 INFO:teuthology.orchestra.run.trial188.stdout:PLATFORM_ID="platform:el9"
2026-02-12T10:26:44.975 INFO:teuthology.orchestra.run.trial188.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T10:26:44.975 INFO:teuthology.orchestra.run.trial188.stdout:ANSI_COLOR="0;31"
2026-02-12T10:26:44.975 INFO:teuthology.orchestra.run.trial188.stdout:LOGO="fedora-logo-icon"
2026-02-12T10:26:44.975 INFO:teuthology.orchestra.run.trial188.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T10:26:44.975 INFO:teuthology.orchestra.run.trial188.stdout:HOME_URL="https://centos.org/"
2026-02-12T10:26:44.975 INFO:teuthology.orchestra.run.trial188.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T10:26:44.975 INFO:teuthology.orchestra.run.trial188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T10:26:44.975 INFO:teuthology.orchestra.run.trial188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T10:26:44.975 INFO:teuthology.lock.ops:Updating trial188.front.sepia.ceph.com on lock server
2026-02-12T10:26:45.040 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:26:45.122 INFO:teuthology.dispatcher.supervisor:Running job 41786
2026-02-12T10:26:45.122 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/bin/teuthology -v --owner scheduled_matan@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41786 --name matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/pool-snaps-few-objects} -- /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41786/orig.config.yaml
2026-02-12T10:26:45.123 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41786
2026-02-12T10:26:45.123 INFO:teuthology.dispatcher.supervisor:Job PID: 3628271
2026-02-12T10:26:45.123 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T10:28:45.187 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:30:45.377 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:32:45.503 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:34:45.670 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:36:46.263 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:38:46.463 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:40:46.644 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:42:46.797 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:44:46.996 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:46:47.182 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:48:47.352 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:50:47.555 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:52:47.715 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:54:47.905 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:56:48.079 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:58:48.297 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:58:48.385 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-12T10:58:48.503 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T10:58:49.009 INFO:teuthology.orchestra.console.trial151:Power off
2026-02-12T10:58:49.009 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T10:58:49.067 DEBUG:teuthology.orchestra.console.trial151:power off output: Chassis Power Control: Down/Off
2026-02-12T10:58:49.081 INFO:teuthology.orchestra.console.trial188:Power off
2026-02-12T10:58:49.081 DEBUG:teuthology.orchestra.console.trial188:pexpect command: ipmitool -H trial188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T10:58:49.120 DEBUG:teuthology.orchestra.console.trial188:power off output: Chassis Power Control: Down/Off
2026-02-12T10:58:53.072 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:58:53.122 DEBUG:teuthology.orchestra.console.trial188:pexpect command: ipmitool -H trial188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:58:53.181 DEBUG:teuthology.orchestra.console.trial151:check power output: Chassis Power is on
2026-02-12T10:58:53.229 DEBUG:teuthology.orchestra.console.trial188:check power output: Chassis Power is on
2026-02-12T10:58:57.187 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:58:57.230 DEBUG:teuthology.orchestra.console.trial188:pexpect command: ipmitool -H trial188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:58:57.297 DEBUG:teuthology.orchestra.console.trial151:check power output: Chassis Power is off
2026-02-12T10:58:57.298 INFO:teuthology.orchestra.console.trial151:Power off completed
2026-02-12T10:58:57.339 DEBUG:teuthology.orchestra.console.trial188:check power output: Chassis Power is off
2026-02-12T10:58:57.340 INFO:teuthology.orchestra.console.trial188:Power off completed
2026-02-12T10:58:57.545 INFO:teuthology.lock.ops:unlocked: trial151.front.sepia.ceph.com
2026-02-12T10:58:57.558 INFO:teuthology.lock.ops:unlocked: trial188.front.sepia.ceph.com