2026-02-12T08:53:41.862 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062
2026-02-12T08:53:41.863 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:53:41.934 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:53:42.122 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7cd01f300b00>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7cd01eb85580>, signals=[15])
2026-02-12T08:53:42.122 INFO:teuthology.lock.ops:Start node 'trial138.front.sepia.ceph.com' reimaging
2026-02-12T08:53:42.122 INFO:teuthology.lock.ops:Updating [trial138.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T08:53:42.122 INFO:teuthology.lock.ops:Updating trial138.front.sepia.ceph.com on lock server
2026-02-12T08:53:42.179 INFO:teuthology.lock.ops:Start node 'trial159.front.sepia.ceph.com' reimaging
2026-02-12T08:53:42.179 INFO:teuthology.lock.ops:Updating [trial159.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T08:53:42.179 INFO:teuthology.lock.ops:Updating trial159.front.sepia.ceph.com on lock server
2026-02-12T08:53:42.388 DEBUG:teuthology.provision.fog.trial138:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T08:53:42.399 DEBUG:teuthology.provision.fog.trial159:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T08:53:42.439 INFO:teuthology.provision.fog.trial138:Scheduling deploy of centos 9.stream
2026-02-12T08:53:42.462 INFO:teuthology.provision.fog.trial159:Scheduling deploy of centos 9.stream
2026-02-12T08:53:43.412 INFO:teuthology.orchestra.console.trial138:Power off
2026-02-12T08:53:43.412 DEBUG:teuthology.orchestra.console.trial138:pexpect command: ipmitool -H trial138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T08:53:43.490 DEBUG:teuthology.orchestra.console.trial138:power off output: Chassis Power Control: Down/Off
2026-02-12T08:53:43.503 INFO:teuthology.orchestra.console.trial159:Power off
2026-02-12T08:53:43.503 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T08:53:43.540 DEBUG:teuthology.orchestra.console.trial159:power off output: Chassis Power Control: Down/Off
2026-02-12T08:53:47.494 DEBUG:teuthology.orchestra.console.trial138:pexpect command: ipmitool -H trial138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T08:53:47.540 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T08:53:47.602 DEBUG:teuthology.orchestra.console.trial138:check power output: Chassis Power is off
2026-02-12T08:53:47.603 INFO:teuthology.orchestra.console.trial138:Power off completed
2026-02-12T08:53:47.647 DEBUG:teuthology.orchestra.console.trial159:check power output: Chassis Power is off
2026-02-12T08:53:47.648 INFO:teuthology.orchestra.console.trial159:Power off completed
2026-02-12T08:53:47.704 INFO:teuthology.orchestra.console.trial138:Power on
2026-02-12T08:53:47.704 DEBUG:teuthology.orchestra.console.trial138:pexpect command: ipmitool -H trial138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T08:53:47.744 DEBUG:teuthology.orchestra.console.trial138:power on output: Chassis Power Control: Up/On
2026-02-12T08:53:47.749 INFO:teuthology.orchestra.console.trial159:Power on
2026-02-12T08:53:47.749 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T08:53:47.789 DEBUG:teuthology.orchestra.console.trial159:power on output: Chassis Power Control: Up/On
2026-02-12T08:53:51.749 DEBUG:teuthology.orchestra.console.trial138:pexpect command: ipmitool -H trial138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T08:53:51.791 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T08:53:51.859 DEBUG:teuthology.orchestra.console.trial138:check power output: Chassis Power is on
2026-02-12T08:53:51.860 INFO:teuthology.orchestra.console.trial138:Power on completed
2026-02-12T08:53:51.899 DEBUG:teuthology.orchestra.console.trial159:check power output: Chassis Power is on
2026-02-12T08:53:51.899 INFO:teuthology.orchestra.console.trial159:Power on completed
2026-02-12T08:53:51.961 INFO:teuthology.provision.fog.trial138:Waiting for deploy to finish
2026-02-12T08:53:52.001 INFO:teuthology.provision.fog.trial159:Waiting for deploy to finish
2026-02-12T08:55:39.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:55:39.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:55:42.429 WARNING:teuthology.provision.fog.trial159:[Errno None] Unable to connect to port 22 on 10.20.193.159
2026-02-12T08:55:42.429 WARNING:teuthology.provision.fog.trial138:[Errno None] Unable to connect to port 22 on 10.20.193.138
2026-02-12T08:55:48.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:55:48.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:55:51.518 WARNING:teuthology.provision.fog.trial159:[Errno None] Unable to connect to port 22 on 10.20.193.159
2026-02-12T08:55:51.518 WARNING:teuthology.provision.fog.trial138:[Errno None] Unable to connect to port 22 on 10.20.193.138
2026-02-12T08:55:57.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:55:57.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:56:00.605 WARNING:teuthology.provision.fog.trial159:[Errno None] Unable to connect to port 22 on 10.20.193.159
2026-02-12T08:56:00.605 WARNING:teuthology.provision.fog.trial138:[Errno None] Unable to connect to port 22 on 10.20.193.138
2026-02-12T08:56:06.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:56:06.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:56:09.693 WARNING:teuthology.provision.fog.trial159:[Errno None] Unable to connect to port 22 on 10.20.193.159
2026-02-12T08:56:09.693 WARNING:teuthology.provision.fog.trial138:[Errno None] Unable to connect to port 22 on 10.20.193.138
2026-02-12T08:56:15.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:56:15.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:56:51.787 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T08:56:51.788 DEBUG:teuthology.orchestra.run.trial159:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T08:56:51.788 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T08:56:51.788 DEBUG:teuthology.orchestra.run.trial138:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T08:56:56.857 INFO:teuthology.provision.fog.trial159:Node is ready
2026-02-12T08:56:56.857 DEBUG:teuthology.orchestra.run.trial159:> hostname
2026-02-12T08:56:56.875 INFO:teuthology.orchestra.run.trial159.stdout:trial159.front.sepia.ceph.com
2026-02-12T08:56:56.875 DEBUG:teuthology.orchestra.run.trial159:> grep trial159.front.sepia.ceph.com /etc/hosts
2026-02-12T08:56:56.932 INFO:teuthology.orchestra.run.trial159.stdout:10.20.193.159 trial159.front.sepia.ceph.com trial159
2026-02-12T08:56:56.932 DEBUG:teuthology.orchestra.run.trial159:> sudo hostname trial159
2026-02-12T08:56:56.952 INFO:teuthology.provision.fog.trial138:Node is ready
2026-02-12T08:56:56.952 DEBUG:teuthology.orchestra.run.trial138:> hostname
2026-02-12T08:56:56.970 INFO:teuthology.orchestra.run.trial138.stdout:trial138.front.sepia.ceph.com
2026-02-12T08:56:56.971 DEBUG:teuthology.orchestra.run.trial138:> grep trial138.front.sepia.ceph.com /etc/hosts
2026-02-12T08:56:57.003 DEBUG:teuthology.orchestra.run.trial159:> sudo sed -i -e 's/trial159.front.sepia.ceph.com/trial159/g' /etc/hosts
2026-02-12T08:56:57.026 INFO:teuthology.orchestra.run.trial138.stdout:10.20.193.138 trial138.front.sepia.ceph.com trial138
2026-02-12T08:56:57.026 DEBUG:teuthology.orchestra.run.trial138:> sudo hostname trial138
2026-02-12T08:56:57.069 DEBUG:teuthology.orchestra.run.trial159:> sudo sed -i -e 's/10.20.193.159/10.20.193.159/g' /etc/hosts
2026-02-12T08:56:57.097 DEBUG:teuthology.orchestra.run.trial138:> sudo sed -i -e 's/trial138.front.sepia.ceph.com/trial138/g' /etc/hosts
2026-02-12T08:56:57.134 DEBUG:teuthology.orchestra.run.trial159:> sudo sed -i -e 's/trial159.front.sepia.ceph.com/trial159/g' /etc/hostname
2026-02-12T08:56:57.160 DEBUG:teuthology.orchestra.run.trial138:> sudo sed -i -e 's/10.20.193.138/10.20.193.138/g' /etc/hosts
2026-02-12T08:56:57.198 DEBUG:teuthology.orchestra.run.trial159:> sudo hostname trial159
2026-02-12T08:56:57.225 DEBUG:teuthology.orchestra.run.trial138:> sudo sed -i -e 's/trial138.front.sepia.ceph.com/trial138/g' /etc/hostname
2026-02-12T08:56:57.263 DEBUG:teuthology.orchestra.run.trial159:> cat /etc/os-release
2026-02-12T08:56:57.289 DEBUG:teuthology.orchestra.run.trial138:> sudo hostname trial138
2026-02-12T08:56:57.319 INFO:teuthology.orchestra.run.trial159.stdout:NAME="CentOS Stream"
2026-02-12T08:56:57.319 INFO:teuthology.orchestra.run.trial159.stdout:VERSION="9"
2026-02-12T08:56:57.319 INFO:teuthology.orchestra.run.trial159.stdout:ID="centos"
2026-02-12T08:56:57.319 INFO:teuthology.orchestra.run.trial159.stdout:ID_LIKE="rhel fedora"
2026-02-12T08:56:57.319 INFO:teuthology.orchestra.run.trial159.stdout:VERSION_ID="9"
2026-02-12T08:56:57.319 INFO:teuthology.orchestra.run.trial159.stdout:PLATFORM_ID="platform:el9"
2026-02-12T08:56:57.319 INFO:teuthology.orchestra.run.trial159.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T08:56:57.319 INFO:teuthology.orchestra.run.trial159.stdout:ANSI_COLOR="0;31"
2026-02-12T08:56:57.319 INFO:teuthology.orchestra.run.trial159.stdout:LOGO="fedora-logo-icon"
2026-02-12T08:56:57.320 INFO:teuthology.orchestra.run.trial159.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T08:56:57.320 INFO:teuthology.orchestra.run.trial159.stdout:HOME_URL="https://centos.org/"
2026-02-12T08:56:57.320 INFO:teuthology.orchestra.run.trial159.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T08:56:57.320 INFO:teuthology.orchestra.run.trial159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T08:56:57.320 INFO:teuthology.orchestra.run.trial159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T08:56:57.321 INFO:teuthology.provision.fog.trial159:Deploy complete!
2026-02-12T08:56:57.322 DEBUG:teuthology.parallel:result is None
2026-02-12T08:56:57.353 DEBUG:teuthology.orchestra.run.trial138:> cat /etc/os-release
2026-02-12T08:56:57.410 INFO:teuthology.orchestra.run.trial138.stdout:NAME="CentOS Stream"
2026-02-12T08:56:57.410 INFO:teuthology.orchestra.run.trial138.stdout:VERSION="9"
2026-02-12T08:56:57.410 INFO:teuthology.orchestra.run.trial138.stdout:ID="centos"
2026-02-12T08:56:57.410 INFO:teuthology.orchestra.run.trial138.stdout:ID_LIKE="rhel fedora"
2026-02-12T08:56:57.410 INFO:teuthology.orchestra.run.trial138.stdout:VERSION_ID="9"
2026-02-12T08:56:57.410 INFO:teuthology.orchestra.run.trial138.stdout:PLATFORM_ID="platform:el9"
2026-02-12T08:56:57.410 INFO:teuthology.orchestra.run.trial138.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T08:56:57.410 INFO:teuthology.orchestra.run.trial138.stdout:ANSI_COLOR="0;31"
2026-02-12T08:56:57.411 INFO:teuthology.orchestra.run.trial138.stdout:LOGO="fedora-logo-icon"
2026-02-12T08:56:57.411 INFO:teuthology.orchestra.run.trial138.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T08:56:57.411 INFO:teuthology.orchestra.run.trial138.stdout:HOME_URL="https://centos.org/"
2026-02-12T08:56:57.411 INFO:teuthology.orchestra.run.trial138.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T08:56:57.411 INFO:teuthology.orchestra.run.trial138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T08:56:57.411 INFO:teuthology.orchestra.run.trial138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T08:56:57.411 INFO:teuthology.provision.fog.trial138:Deploy complete!
2026-02-12T08:56:57.412 DEBUG:teuthology.parallel:result is None
2026-02-12T08:56:57.809 INFO:teuthology.lock.ops:Checking trial138.front.sepia.ceph.com
2026-02-12T08:56:57.809 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T08:56:57.922 INFO:teuthology.lock.ops:Checking trial159.front.sepia.ceph.com
2026-02-12T08:56:57.922 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T08:56:57.982 INFO:teuthology.lock.ops:Updating [trial138.front.sepia.ceph.com]: set os type and version on server
2026-02-12T08:56:57.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com'
2026-02-12T08:56:57.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:56:58.043 DEBUG:teuthology.orchestra.run.trial138:> true
2026-02-12T08:56:58.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com'
2026-02-12T08:56:58.122 DEBUG:teuthology.orchestra.run.trial138:> uname -m
2026-02-12T08:56:58.177 INFO:teuthology.orchestra.run.trial138.stdout:x86_64
2026-02-12T08:56:58.177 DEBUG:teuthology.orchestra.run.trial138:> cat /etc/os-release
2026-02-12T08:56:58.233 INFO:teuthology.orchestra.run.trial138.stdout:NAME="CentOS Stream"
2026-02-12T08:56:58.233 INFO:teuthology.orchestra.run.trial138.stdout:VERSION="9"
2026-02-12T08:56:58.233 INFO:teuthology.orchestra.run.trial138.stdout:ID="centos"
2026-02-12T08:56:58.233 INFO:teuthology.orchestra.run.trial138.stdout:ID_LIKE="rhel fedora"
2026-02-12T08:56:58.233 INFO:teuthology.orchestra.run.trial138.stdout:VERSION_ID="9"
2026-02-12T08:56:58.233 INFO:teuthology.orchestra.run.trial138.stdout:PLATFORM_ID="platform:el9"
2026-02-12T08:56:58.233 INFO:teuthology.orchestra.run.trial138.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T08:56:58.233 INFO:teuthology.orchestra.run.trial138.stdout:ANSI_COLOR="0;31"
2026-02-12T08:56:58.233 INFO:teuthology.orchestra.run.trial138.stdout:LOGO="fedora-logo-icon"
2026-02-12T08:56:58.234 INFO:teuthology.orchestra.run.trial138.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T08:56:58.234 INFO:teuthology.orchestra.run.trial138.stdout:HOME_URL="https://centos.org/"
2026-02-12T08:56:58.234 INFO:teuthology.orchestra.run.trial138.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T08:56:58.234 INFO:teuthology.orchestra.run.trial138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T08:56:58.234 INFO:teuthology.orchestra.run.trial138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T08:56:58.235 INFO:teuthology.lock.ops:Updating trial138.front.sepia.ceph.com on lock server
2026-02-12T08:56:58.338 INFO:teuthology.lock.ops:Updating [trial159.front.sepia.ceph.com]: set os type and version on server
2026-02-12T08:56:58.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial159.front.sepia.ceph.com'
2026-02-12T08:56:58.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:56:58.409 DEBUG:teuthology.orchestra.run.trial159:> true
2026-02-12T08:56:58.483 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial159.front.sepia.ceph.com'
2026-02-12T08:56:58.483 DEBUG:teuthology.orchestra.run.trial159:> uname -m
2026-02-12T08:56:58.539 INFO:teuthology.orchestra.run.trial159.stdout:x86_64
2026-02-12T08:56:58.539 DEBUG:teuthology.orchestra.run.trial159:> cat /etc/os-release
2026-02-12T08:56:58.595 INFO:teuthology.orchestra.run.trial159.stdout:NAME="CentOS Stream"
2026-02-12T08:56:58.595 INFO:teuthology.orchestra.run.trial159.stdout:VERSION="9"
2026-02-12T08:56:58.595 INFO:teuthology.orchestra.run.trial159.stdout:ID="centos"
2026-02-12T08:56:58.595 INFO:teuthology.orchestra.run.trial159.stdout:ID_LIKE="rhel fedora"
2026-02-12T08:56:58.595 INFO:teuthology.orchestra.run.trial159.stdout:VERSION_ID="9"
2026-02-12T08:56:58.596 INFO:teuthology.orchestra.run.trial159.stdout:PLATFORM_ID="platform:el9"
2026-02-12T08:56:58.596 INFO:teuthology.orchestra.run.trial159.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T08:56:58.596 INFO:teuthology.orchestra.run.trial159.stdout:ANSI_COLOR="0;31"
2026-02-12T08:56:58.596 INFO:teuthology.orchestra.run.trial159.stdout:LOGO="fedora-logo-icon"
2026-02-12T08:56:58.596 INFO:teuthology.orchestra.run.trial159.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T08:56:58.596 INFO:teuthology.orchestra.run.trial159.stdout:HOME_URL="https://centos.org/"
2026-02-12T08:56:58.596 INFO:teuthology.orchestra.run.trial159.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T08:56:58.596 INFO:teuthology.orchestra.run.trial159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T08:56:58.596 INFO:teuthology.orchestra.run.trial159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T08:56:58.597 INFO:teuthology.lock.ops:Updating trial159.front.sepia.ceph.com on lock server
2026-02-12T08:56:58.698 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:56:58.791 INFO:teuthology.dispatcher.supervisor:Running job 41591
2026-02-12T08:56:58.792 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/bin/teuthology -v --owner scheduled_matan@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41591 --name matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{pggrow} thrashosds-health workloads/pool-snaps-few-objects} -- /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41591/orig.config.yaml
2026-02-12T08:56:58.792 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41591
2026-02-12T08:56:58.792 INFO:teuthology.dispatcher.supervisor:Job PID: 3388008
2026-02-12T08:56:58.792 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T08:58:58.888 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:00:59.056 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:02:59.232 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:04:59.424 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:06:59.617 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:08:59.786 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:10:59.959 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:13:00.125 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:15:00.288 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:17:00.439 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:19:00.596 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:21:00.946 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:23:01.149 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:25:01.313 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:27:01.486 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:27:01.559 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-12T09:27:01.672 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T09:27:02.190 INFO:teuthology.orchestra.console.trial159:Power off
2026-02-12T09:27:02.190 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T09:27:02.199 INFO:teuthology.orchestra.console.trial138:Power off
2026-02-12T09:27:02.199 DEBUG:teuthology.orchestra.console.trial138:pexpect command: ipmitool -H trial138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T09:27:02.228 DEBUG:teuthology.orchestra.console.trial159:power off output: Chassis Power Control: Down/Off
2026-02-12T09:27:02.236 DEBUG:teuthology.orchestra.console.trial138:power off output: Chassis Power Control: Down/Off
2026-02-12T09:27:06.233 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:27:06.240 DEBUG:teuthology.orchestra.console.trial138:pexpect command: ipmitool -H trial138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:27:06.342 DEBUG:teuthology.orchestra.console.trial159:check power output: Chassis Power is on
2026-02-12T09:27:06.347 DEBUG:teuthology.orchestra.console.trial138:check power output: Chassis Power is on
2026-02-12T09:27:10.346 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:27:10.353 DEBUG:teuthology.orchestra.console.trial138:pexpect command: ipmitool -H trial138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:27:10.454 DEBUG:teuthology.orchestra.console.trial159:check power output: Chassis Power is off
2026-02-12T09:27:10.455 INFO:teuthology.orchestra.console.trial159:Power off completed
2026-02-12T09:27:10.460 DEBUG:teuthology.orchestra.console.trial138:check power output: Chassis Power is off
2026-02-12T09:27:10.460 INFO:teuthology.orchestra.console.trial138:Power off completed
2026-02-12T09:27:10.661 INFO:teuthology.lock.ops:unlocked: trial159.front.sepia.ceph.com
2026-02-12T09:27:10.674 INFO:teuthology.lock.ops:unlocked: trial138.front.sepia.ceph.com