2026-02-12T08:27:22.511 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062
2026-02-12T08:27:22.511 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:27:22.582 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:27:22.771 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f8386583980>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f8385d6f9c0>, signals=[15])
2026-02-12T08:27:22.771 INFO:teuthology.lock.ops:Start node 'trial130.front.sepia.ceph.com' reimaging
2026-02-12T08:27:22.771 INFO:teuthology.lock.ops:Updating [trial130.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T08:27:22.771 INFO:teuthology.lock.ops:Updating trial130.front.sepia.ceph.com on lock server
2026-02-12T08:27:22.827 INFO:teuthology.lock.ops:Start node 'trial183.front.sepia.ceph.com' reimaging
2026-02-12T08:27:22.827 INFO:teuthology.lock.ops:Updating [trial183.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T08:27:22.827 INFO:teuthology.lock.ops:Updating trial183.front.sepia.ceph.com on lock server
2026-02-12T08:27:23.033 DEBUG:teuthology.provision.fog.trial130:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T08:27:23.061 DEBUG:teuthology.provision.fog.trial183:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T08:27:23.084 INFO:teuthology.provision.fog.trial130:Scheduling deploy of centos 9.stream
2026-02-12T08:27:23.111 INFO:teuthology.provision.fog.trial183:Scheduling deploy of centos 9.stream
2026-02-12T08:27:24.190 INFO:teuthology.orchestra.console.trial130:Power off
2026-02-12T08:27:24.190 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T08:27:24.199 INFO:teuthology.orchestra.console.trial183:Power off
2026-02-12T08:27:24.200 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T08:27:24.228 DEBUG:teuthology.orchestra.console.trial130:power off output: Chassis Power Control: Down/Off
2026-02-12T08:27:24.239 DEBUG:teuthology.orchestra.console.trial183:power off output: Chassis Power Control: Down/Off
2026-02-12T08:27:28.230 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T08:27:28.240 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T08:27:28.340 DEBUG:teuthology.orchestra.console.trial130:check power output: Chassis Power is off
2026-02-12T08:27:28.340 INFO:teuthology.orchestra.console.trial130:Power off completed
2026-02-12T08:27:28.347 DEBUG:teuthology.orchestra.console.trial183:check power output: Chassis Power is off
2026-02-12T08:27:28.347 INFO:teuthology.orchestra.console.trial183:Power off completed
2026-02-12T08:27:28.442 INFO:teuthology.orchestra.console.trial130:Power on
2026-02-12T08:27:28.442 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T08:27:28.450 INFO:teuthology.orchestra.console.trial183:Power on
2026-02-12T08:27:28.451 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T08:27:28.482 DEBUG:teuthology.orchestra.console.trial130:power on output: Chassis Power Control: Up/On
2026-02-12T08:27:28.490 DEBUG:teuthology.orchestra.console.trial183:power on output: Chassis Power Control: Up/On
2026-02-12T08:27:32.485 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T08:27:32.493 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T08:27:32.595 DEBUG:teuthology.orchestra.console.trial130:check power output: Chassis Power is on
2026-02-12T08:27:32.596 INFO:teuthology.orchestra.console.trial130:Power on completed
2026-02-12T08:27:32.601 DEBUG:teuthology.orchestra.console.trial183:check power output: Chassis Power is on
2026-02-12T08:27:32.601 INFO:teuthology.orchestra.console.trial183:Power on completed
2026-02-12T08:27:32.697 INFO:teuthology.provision.fog.trial130:Waiting for deploy to finish
2026-02-12T08:27:32.702 INFO:teuthology.provision.fog.trial183:Waiting for deploy to finish
2026-02-12T08:29:20.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:29:20.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:29:23.165 WARNING:teuthology.provision.fog.trial130:[Errno None] Unable to connect to port 22 on 10.20.193.130
2026-02-12T08:29:23.229 WARNING:teuthology.provision.fog.trial183:[Errno None] Unable to connect to port 22 on 10.20.193.183
2026-02-12T08:29:29.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:29:29.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:29:32.253 WARNING:teuthology.provision.fog.trial130:[Errno None] Unable to connect to port 22 on 10.20.193.130
2026-02-12T08:29:32.317 WARNING:teuthology.provision.fog.trial183:[Errno None] Unable to connect to port 22 on 10.20.193.183
2026-02-12T08:29:38.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:29:38.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:29:41.341 WARNING:teuthology.provision.fog.trial130:[Errno None] Unable to connect to port 22 on 10.20.193.130
2026-02-12T08:29:41.405 WARNING:teuthology.provision.fog.trial183:[Errno None] Unable to connect to port 22 on 10.20.193.183
2026-02-12T08:29:47.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:29:47.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:29:50.429 WARNING:teuthology.provision.fog.trial130:[Errno None] Unable to connect to port 22 on 10.20.193.130
2026-02-12T08:29:50.493 WARNING:teuthology.provision.fog.trial183:[Errno None] Unable to connect to port 22 on 10.20.193.183
2026-02-12T08:29:56.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:29:56.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:30:32.180 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T08:30:32.181 DEBUG:teuthology.orchestra.run.trial130:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T08:30:32.402 INFO:teuthology.provision.fog.trial130:Node is ready
2026-02-12T08:30:32.402 DEBUG:teuthology.orchestra.run.trial130:> hostname
2026-02-12T08:30:32.458 INFO:teuthology.orchestra.run.trial130.stdout:trial130.front.sepia.ceph.com
2026-02-12T08:30:32.458 DEBUG:teuthology.orchestra.run.trial130:> grep trial130.front.sepia.ceph.com /etc/hosts
2026-02-12T08:30:32.514 INFO:teuthology.orchestra.run.trial130.stdout:10.20.193.130 trial130.front.sepia.ceph.com trial130
2026-02-12T08:30:32.514 DEBUG:teuthology.orchestra.run.trial130:> sudo hostname trial130
2026-02-12T08:30:32.583 DEBUG:teuthology.orchestra.run.trial130:> sudo sed -i -e 's/trial130.front.sepia.ceph.com/trial130/g' /etc/hosts
2026-02-12T08:30:32.668 DEBUG:teuthology.orchestra.run.trial130:> sudo sed -i -e 's/10.20.193.130/10.20.193.130/g' /etc/hosts
2026-02-12T08:30:32.686 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T08:30:32.686 DEBUG:teuthology.orchestra.run.trial183:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T08:30:32.732 DEBUG:teuthology.orchestra.run.trial130:> sudo sed -i -e 's/trial130.front.sepia.ceph.com/trial130/g' /etc/hostname
2026-02-12T08:30:32.797 DEBUG:teuthology.orchestra.run.trial130:> sudo hostname trial130
2026-02-12T08:30:32.845 INFO:teuthology.provision.fog.trial183:Node is ready
2026-02-12T08:30:32.845 DEBUG:teuthology.orchestra.run.trial183:> hostname
2026-02-12T08:30:32.860 DEBUG:teuthology.orchestra.run.trial130:> cat /etc/os-release
2026-02-12T08:30:32.901 INFO:teuthology.orchestra.run.trial183.stdout:trial183.front.sepia.ceph.com
2026-02-12T08:30:32.901 DEBUG:teuthology.orchestra.run.trial183:> grep trial183.front.sepia.ceph.com /etc/hosts
2026-02-12T08:30:32.917 INFO:teuthology.orchestra.run.trial130.stdout:NAME="CentOS Stream"
2026-02-12T08:30:32.917 INFO:teuthology.orchestra.run.trial130.stdout:VERSION="9"
2026-02-12T08:30:32.917 INFO:teuthology.orchestra.run.trial130.stdout:ID="centos"
2026-02-12T08:30:32.917 INFO:teuthology.orchestra.run.trial130.stdout:ID_LIKE="rhel fedora"
2026-02-12T08:30:32.918 INFO:teuthology.orchestra.run.trial130.stdout:VERSION_ID="9"
2026-02-12T08:30:32.918 INFO:teuthology.orchestra.run.trial130.stdout:PLATFORM_ID="platform:el9"
2026-02-12T08:30:32.918 INFO:teuthology.orchestra.run.trial130.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T08:30:32.918 INFO:teuthology.orchestra.run.trial130.stdout:ANSI_COLOR="0;31"
2026-02-12T08:30:32.918 INFO:teuthology.orchestra.run.trial130.stdout:LOGO="fedora-logo-icon"
2026-02-12T08:30:32.918 INFO:teuthology.orchestra.run.trial130.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T08:30:32.918 INFO:teuthology.orchestra.run.trial130.stdout:HOME_URL="https://centos.org/"
2026-02-12T08:30:32.918 INFO:teuthology.orchestra.run.trial130.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T08:30:32.918 INFO:teuthology.orchestra.run.trial130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T08:30:32.918 INFO:teuthology.orchestra.run.trial130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T08:30:32.918 INFO:teuthology.provision.fog.trial130:Deploy complete!
2026-02-12T08:30:32.918 DEBUG:teuthology.parallel:result is None
2026-02-12T08:30:32.957 INFO:teuthology.orchestra.run.trial183.stdout:10.20.193.183 trial183.front.sepia.ceph.com trial183
2026-02-12T08:30:32.957 DEBUG:teuthology.orchestra.run.trial183:> sudo hostname trial183
2026-02-12T08:30:33.026 DEBUG:teuthology.orchestra.run.trial183:> sudo sed -i -e 's/trial183.front.sepia.ceph.com/trial183/g' /etc/hosts
2026-02-12T08:30:33.091 DEBUG:teuthology.orchestra.run.trial183:> sudo sed -i -e 's/10.20.193.183/10.20.193.183/g' /etc/hosts
2026-02-12T08:30:33.154 DEBUG:teuthology.orchestra.run.trial183:> sudo sed -i -e 's/trial183.front.sepia.ceph.com/trial183/g' /etc/hostname
2026-02-12T08:30:33.218 DEBUG:teuthology.orchestra.run.trial183:> sudo hostname trial183
2026-02-12T08:30:33.282 DEBUG:teuthology.orchestra.run.trial183:> cat /etc/os-release
2026-02-12T08:30:33.339 INFO:teuthology.orchestra.run.trial183.stdout:NAME="CentOS Stream"
2026-02-12T08:30:33.339 INFO:teuthology.orchestra.run.trial183.stdout:VERSION="9"
2026-02-12T08:30:33.339 INFO:teuthology.orchestra.run.trial183.stdout:ID="centos"
2026-02-12T08:30:33.339 INFO:teuthology.orchestra.run.trial183.stdout:ID_LIKE="rhel fedora"
2026-02-12T08:30:33.339 INFO:teuthology.orchestra.run.trial183.stdout:VERSION_ID="9"
2026-02-12T08:30:33.339 INFO:teuthology.orchestra.run.trial183.stdout:PLATFORM_ID="platform:el9"
2026-02-12T08:30:33.339 INFO:teuthology.orchestra.run.trial183.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T08:30:33.340 INFO:teuthology.orchestra.run.trial183.stdout:ANSI_COLOR="0;31"
2026-02-12T08:30:33.340 INFO:teuthology.orchestra.run.trial183.stdout:LOGO="fedora-logo-icon"
2026-02-12T08:30:33.340 INFO:teuthology.orchestra.run.trial183.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T08:30:33.340 INFO:teuthology.orchestra.run.trial183.stdout:HOME_URL="https://centos.org/"
2026-02-12T08:30:33.340 INFO:teuthology.orchestra.run.trial183.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T08:30:33.340 INFO:teuthology.orchestra.run.trial183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T08:30:33.340 INFO:teuthology.orchestra.run.trial183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T08:30:33.341 INFO:teuthology.provision.fog.trial183:Deploy complete!
2026-02-12T08:30:33.341 DEBUG:teuthology.parallel:result is None
2026-02-12T08:30:33.697 INFO:teuthology.lock.ops:Checking trial130.front.sepia.ceph.com
2026-02-12T08:30:33.697 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T08:30:33.787 INFO:teuthology.lock.ops:Checking trial183.front.sepia.ceph.com
2026-02-12T08:30:33.787 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T08:30:33.845 INFO:teuthology.lock.ops:Updating [trial130.front.sepia.ceph.com]: set os type and version on server
2026-02-12T08:30:33.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial130.front.sepia.ceph.com'
2026-02-12T08:30:33.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:30:33.919 DEBUG:teuthology.orchestra.run.trial130:> true
2026-02-12T08:30:34.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial130.front.sepia.ceph.com'
2026-02-12T08:30:34.015 DEBUG:teuthology.orchestra.run.trial130:> uname -m
2026-02-12T08:30:34.071 INFO:teuthology.orchestra.run.trial130.stdout:x86_64
2026-02-12T08:30:34.072 DEBUG:teuthology.orchestra.run.trial130:> cat /etc/os-release
2026-02-12T08:30:34.128 INFO:teuthology.orchestra.run.trial130.stdout:NAME="CentOS Stream"
2026-02-12T08:30:34.128 INFO:teuthology.orchestra.run.trial130.stdout:VERSION="9"
2026-02-12T08:30:34.128 INFO:teuthology.orchestra.run.trial130.stdout:ID="centos"
2026-02-12T08:30:34.128 INFO:teuthology.orchestra.run.trial130.stdout:ID_LIKE="rhel fedora"
2026-02-12T08:30:34.128 INFO:teuthology.orchestra.run.trial130.stdout:VERSION_ID="9"
2026-02-12T08:30:34.129 INFO:teuthology.orchestra.run.trial130.stdout:PLATFORM_ID="platform:el9"
2026-02-12T08:30:34.129 INFO:teuthology.orchestra.run.trial130.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T08:30:34.129 INFO:teuthology.orchestra.run.trial130.stdout:ANSI_COLOR="0;31"
2026-02-12T08:30:34.129 INFO:teuthology.orchestra.run.trial130.stdout:LOGO="fedora-logo-icon"
2026-02-12T08:30:34.129 INFO:teuthology.orchestra.run.trial130.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T08:30:34.129 INFO:teuthology.orchestra.run.trial130.stdout:HOME_URL="https://centos.org/"
2026-02-12T08:30:34.129 INFO:teuthology.orchestra.run.trial130.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T08:30:34.129 INFO:teuthology.orchestra.run.trial130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T08:30:34.129 INFO:teuthology.orchestra.run.trial130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T08:30:34.130 INFO:teuthology.lock.ops:Updating trial130.front.sepia.ceph.com on lock server
2026-02-12T08:30:34.233 INFO:teuthology.lock.ops:Updating [trial183.front.sepia.ceph.com]: set os type and version on server
2026-02-12T08:30:34.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial183.front.sepia.ceph.com'
2026-02-12T08:30:34.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:30:34.303 DEBUG:teuthology.orchestra.run.trial183:> true
2026-02-12T08:30:34.373 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial183.front.sepia.ceph.com'
2026-02-12T08:30:34.373 DEBUG:teuthology.orchestra.run.trial183:> uname -m
2026-02-12T08:30:34.429 INFO:teuthology.orchestra.run.trial183.stdout:x86_64
2026-02-12T08:30:34.429 DEBUG:teuthology.orchestra.run.trial183:> cat /etc/os-release
2026-02-12T08:30:34.486 INFO:teuthology.orchestra.run.trial183.stdout:NAME="CentOS Stream"
2026-02-12T08:30:34.486 INFO:teuthology.orchestra.run.trial183.stdout:VERSION="9"
2026-02-12T08:30:34.486 INFO:teuthology.orchestra.run.trial183.stdout:ID="centos"
2026-02-12T08:30:34.486 INFO:teuthology.orchestra.run.trial183.stdout:ID_LIKE="rhel fedora"
2026-02-12T08:30:34.486 INFO:teuthology.orchestra.run.trial183.stdout:VERSION_ID="9"
2026-02-12T08:30:34.486 INFO:teuthology.orchestra.run.trial183.stdout:PLATFORM_ID="platform:el9"
2026-02-12T08:30:34.487 INFO:teuthology.orchestra.run.trial183.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T08:30:34.487 INFO:teuthology.orchestra.run.trial183.stdout:ANSI_COLOR="0;31"
2026-02-12T08:30:34.487 INFO:teuthology.orchestra.run.trial183.stdout:LOGO="fedora-logo-icon"
2026-02-12T08:30:34.487 INFO:teuthology.orchestra.run.trial183.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T08:30:34.487 INFO:teuthology.orchestra.run.trial183.stdout:HOME_URL="https://centos.org/"
2026-02-12T08:30:34.487 INFO:teuthology.orchestra.run.trial183.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T08:30:34.487 INFO:teuthology.orchestra.run.trial183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T08:30:34.487 INFO:teuthology.orchestra.run.trial183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T08:30:34.488 INFO:teuthology.lock.ops:Updating trial183.front.sepia.ceph.com on lock server
2026-02-12T08:30:34.592 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:30:34.687 INFO:teuthology.dispatcher.supervisor:Running job 41536
2026-02-12T08:30:34.687 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/bin/teuthology -v --owner scheduled_matan@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41536 --name matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/crimson_bluestore thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects} -- /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41536/orig.config.yaml
2026-02-12T08:30:34.687 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41536
2026-02-12T08:30:34.687 INFO:teuthology.dispatcher.supervisor:Job PID: 3316280
2026-02-12T08:30:34.687 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T08:32:34.787 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:34:34.875 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:36:35.052 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:38:35.262 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:40:35.430 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:42:35.639 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:44:35.786 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:46:35.872 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:48:36.070 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:50:36.274 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:52:36.472 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:54:36.579 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:56:36.778 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:58:36.985 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:00:37.172 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:02:37.354 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:04:37.474 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:06:37.669 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:08:37.853 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:08:37.964 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-12T09:08:38.085 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T09:08:38.589 INFO:teuthology.orchestra.console.trial130:Power off
2026-02-12T09:08:38.589 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T09:08:38.606 INFO:teuthology.orchestra.console.trial183:Power off
2026-02-12T09:08:38.606 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T09:08:38.630 DEBUG:teuthology.orchestra.console.trial130:power off output: Chassis Power Control: Down/Off
2026-02-12T09:08:38.642 DEBUG:teuthology.orchestra.console.trial183:power off output: Chassis Power Control: Down/Off
2026-02-12T09:08:42.635 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:08:42.642 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:08:42.743 DEBUG:teuthology.orchestra.console.trial130:check power output: Chassis Power is on
2026-02-12T09:08:42.750 DEBUG:teuthology.orchestra.console.trial183:check power output: Chassis Power is on
2026-02-12T09:08:46.749 DEBUG:teuthology.orchestra.console.trial130:pexpect command: ipmitool -H trial130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:08:46.757 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:08:46.859 DEBUG:teuthology.orchestra.console.trial130:check power output: Chassis Power is off
2026-02-12T09:08:46.859 INFO:teuthology.orchestra.console.trial130:Power off completed
2026-02-12T09:08:46.867 DEBUG:teuthology.orchestra.console.trial183:check power output: Chassis Power is off
2026-02-12T09:08:46.867 INFO:teuthology.orchestra.console.trial183:Power off completed
2026-02-12T09:08:47.108 INFO:teuthology.lock.ops:unlocked: trial130.front.sepia.ceph.com
2026-02-12T09:08:47.122 INFO:teuthology.lock.ops:unlocked: trial183.front.sepia.ceph.com