2026-02-12T09:39:36.651 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062
2026-02-12T09:39:36.651 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:39:36.724 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:39:36.915 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7880742561e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x788073a756c0>, signals=[15])
2026-02-12T09:39:36.915 INFO:teuthology.lock.ops:Start node 'trial040.front.sepia.ceph.com' reimaging
2026-02-12T09:39:36.915 INFO:teuthology.lock.ops:Updating [trial040.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T09:39:36.915 INFO:teuthology.lock.ops:Updating trial040.front.sepia.ceph.com on lock server
2026-02-12T09:39:36.972 INFO:teuthology.lock.ops:Start node 'trial047.front.sepia.ceph.com' reimaging
2026-02-12T09:39:36.972 INFO:teuthology.lock.ops:Updating [trial047.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T09:39:36.972 INFO:teuthology.lock.ops:Updating trial047.front.sepia.ceph.com on lock server
2026-02-12T09:39:37.204 DEBUG:teuthology.provision.fog.trial040:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T09:39:37.212 DEBUG:teuthology.provision.fog.trial047:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T09:39:37.257 INFO:teuthology.provision.fog.trial040:Scheduling deploy of centos 9.stream
2026-02-12T09:39:37.264 INFO:teuthology.provision.fog.trial047:Scheduling deploy of centos 9.stream
2026-02-12T09:39:38.232 INFO:teuthology.orchestra.console.trial040:Power off
2026-02-12T09:39:38.232 DEBUG:teuthology.orchestra.console.trial040:pexpect command: ipmitool -H trial040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T09:39:38.251 INFO:teuthology.orchestra.console.trial047:Power off
2026-02-12T09:39:38.252 DEBUG:teuthology.orchestra.console.trial047:pexpect command: ipmitool -H trial047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T09:39:38.272 DEBUG:teuthology.orchestra.console.trial040:power off output: Chassis Power Control: Down/Off
2026-02-12T09:39:38.289 DEBUG:teuthology.orchestra.console.trial047:power off output: Chassis Power Control: Down/Off
2026-02-12T09:39:42.276 DEBUG:teuthology.orchestra.console.trial040:pexpect command: ipmitool -H trial040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:39:42.290 DEBUG:teuthology.orchestra.console.trial047:pexpect command: ipmitool -H trial047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:39:42.384 DEBUG:teuthology.orchestra.console.trial040:check power output: Chassis Power is off
2026-02-12T09:39:42.385 INFO:teuthology.orchestra.console.trial040:Power off completed
2026-02-12T09:39:42.398 DEBUG:teuthology.orchestra.console.trial047:check power output: Chassis Power is off
2026-02-12T09:39:42.398 INFO:teuthology.orchestra.console.trial047:Power off completed
2026-02-12T09:39:42.485 INFO:teuthology.orchestra.console.trial040:Power on
2026-02-12T09:39:42.486 DEBUG:teuthology.orchestra.console.trial040:pexpect command: ipmitool -H trial040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T09:39:42.499 INFO:teuthology.orchestra.console.trial047:Power on
2026-02-12T09:39:42.500 DEBUG:teuthology.orchestra.console.trial047:pexpect command: ipmitool -H trial047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T09:39:42.552 DEBUG:teuthology.orchestra.console.trial047:power on output: Chassis Power Control: Up/On
2026-02-12T09:39:42.594 DEBUG:teuthology.orchestra.console.trial040:power on output: Chassis Power Control: Up/On
2026-02-12T09:39:46.556 DEBUG:teuthology.orchestra.console.trial047:pexpect command: ipmitool -H trial047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:39:46.595 DEBUG:teuthology.orchestra.console.trial040:pexpect command: ipmitool -H trial040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:39:46.665 DEBUG:teuthology.orchestra.console.trial047:check power output: Chassis Power is on
2026-02-12T09:39:46.665 INFO:teuthology.orchestra.console.trial047:Power on completed
2026-02-12T09:39:46.702 DEBUG:teuthology.orchestra.console.trial040:check power output: Chassis Power is on
2026-02-12T09:39:46.702 INFO:teuthology.orchestra.console.trial040:Power on completed
2026-02-12T09:39:46.766 INFO:teuthology.provision.fog.trial047:Waiting for deploy to finish
2026-02-12T09:39:46.804 INFO:teuthology.provision.fog.trial040:Waiting for deploy to finish
2026-02-12T09:41:33.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:41:33.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:41:37.053 WARNING:teuthology.provision.fog.trial047:[Errno None] Unable to connect to port 22 on 10.20.193.47
2026-02-12T09:41:37.053 WARNING:teuthology.provision.fog.trial040:[Errno None] Unable to connect to port 22 on 10.20.193.40
2026-02-12T09:41:43.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:41:43.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:41:46.141 WARNING:teuthology.provision.fog.trial047:[Errno None] Unable to connect to port 22 on 10.20.193.47
2026-02-12T09:41:46.141 WARNING:teuthology.provision.fog.trial040:[Errno None] Unable to connect to port 22 on 10.20.193.40
2026-02-12T09:41:52.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:41:52.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:41:55.229 WARNING:teuthology.provision.fog.trial047:[Errno None] Unable to connect to port 22 on 10.20.193.47
2026-02-12T09:41:55.229 WARNING:teuthology.provision.fog.trial040:[Errno None] Unable to connect to port 22 on 10.20.193.40
2026-02-12T09:42:01.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:42:01.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:42:04.317 WARNING:teuthology.provision.fog.trial047:[Errno None] Unable to connect to port 22 on 10.20.193.47
2026-02-12T09:42:04.317 WARNING:teuthology.provision.fog.trial040:[Errno None] Unable to connect to port 22 on 10.20.193.40
2026-02-12T09:42:10.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:42:10.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:42:46.347 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T09:42:46.347 DEBUG:teuthology.orchestra.run.trial047:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T09:42:46.347 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T09:42:46.348 DEBUG:teuthology.orchestra.run.trial040:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T09:42:46.498 INFO:teuthology.provision.fog.trial040:Node is ready
2026-02-12T09:42:46.498 DEBUG:teuthology.orchestra.run.trial040:> hostname
2026-02-12T09:42:46.557 INFO:teuthology.orchestra.run.trial040.stdout:trial040.front.sepia.ceph.com
2026-02-12T09:42:46.558 DEBUG:teuthology.orchestra.run.trial040:> grep trial040.front.sepia.ceph.com /etc/hosts
2026-02-12T09:42:46.617 INFO:teuthology.orchestra.run.trial040.stdout:10.20.193.40 trial040.front.sepia.ceph.com trial040
2026-02-12T09:42:46.618 DEBUG:teuthology.orchestra.run.trial040:> sudo hostname trial040
2026-02-12T09:42:46.619 INFO:teuthology.provision.fog.trial047:Node is ready
2026-02-12T09:42:46.620 DEBUG:teuthology.orchestra.run.trial047:> hostname
2026-02-12T09:42:46.675 INFO:teuthology.orchestra.run.trial047.stdout:trial047.front.sepia.ceph.com
2026-02-12T09:42:46.676 DEBUG:teuthology.orchestra.run.trial047:> grep trial047.front.sepia.ceph.com /etc/hosts
2026-02-12T09:42:46.690 DEBUG:teuthology.orchestra.run.trial040:> sudo sed -i -e 's/trial040.front.sepia.ceph.com/trial040/g' /etc/hosts
2026-02-12T09:42:46.731 INFO:teuthology.orchestra.run.trial047.stdout:10.20.193.47 trial047.front.sepia.ceph.com trial047
2026-02-12T09:42:46.732 DEBUG:teuthology.orchestra.run.trial047:> sudo hostname trial047
2026-02-12T09:42:46.758 DEBUG:teuthology.orchestra.run.trial040:> sudo sed -i -e 's/10.20.193.40/10.20.193.40/g' /etc/hosts
2026-02-12T09:42:46.802 DEBUG:teuthology.orchestra.run.trial047:> sudo sed -i -e 's/trial047.front.sepia.ceph.com/trial047/g' /etc/hosts
2026-02-12T09:42:46.826 DEBUG:teuthology.orchestra.run.trial040:> sudo sed -i -e 's/trial040.front.sepia.ceph.com/trial040/g' /etc/hostname
2026-02-12T09:42:46.868 DEBUG:teuthology.orchestra.run.trial047:> sudo sed -i -e 's/10.20.193.47/10.20.193.47/g' /etc/hosts
2026-02-12T09:42:46.894 DEBUG:teuthology.orchestra.run.trial040:> sudo hostname trial040
2026-02-12T09:42:46.935 DEBUG:teuthology.orchestra.run.trial047:> sudo sed -i -e 's/trial047.front.sepia.ceph.com/trial047/g' /etc/hostname
2026-02-12T09:42:46.961 DEBUG:teuthology.orchestra.run.trial040:> cat /etc/os-release
2026-02-12T09:42:47.001 DEBUG:teuthology.orchestra.run.trial047:> sudo hostname trial047
2026-02-12T09:42:47.021 INFO:teuthology.orchestra.run.trial040.stdout:NAME="CentOS Stream"
2026-02-12T09:42:47.021 INFO:teuthology.orchestra.run.trial040.stdout:VERSION="9"
2026-02-12T09:42:47.021 INFO:teuthology.orchestra.run.trial040.stdout:ID="centos"
2026-02-12T09:42:47.021 INFO:teuthology.orchestra.run.trial040.stdout:ID_LIKE="rhel fedora"
2026-02-12T09:42:47.022 INFO:teuthology.orchestra.run.trial040.stdout:VERSION_ID="9"
2026-02-12T09:42:47.022 INFO:teuthology.orchestra.run.trial040.stdout:PLATFORM_ID="platform:el9"
2026-02-12T09:42:47.022 INFO:teuthology.orchestra.run.trial040.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T09:42:47.022 INFO:teuthology.orchestra.run.trial040.stdout:ANSI_COLOR="0;31"
2026-02-12T09:42:47.022 INFO:teuthology.orchestra.run.trial040.stdout:LOGO="fedora-logo-icon"
2026-02-12T09:42:47.022 INFO:teuthology.orchestra.run.trial040.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T09:42:47.022 INFO:teuthology.orchestra.run.trial040.stdout:HOME_URL="https://centos.org/"
2026-02-12T09:42:47.022 INFO:teuthology.orchestra.run.trial040.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T09:42:47.022 INFO:teuthology.orchestra.run.trial040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T09:42:47.022 INFO:teuthology.orchestra.run.trial040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T09:42:47.023 INFO:teuthology.provision.fog.trial040:Deploy complete!
2026-02-12T09:42:47.025 DEBUG:teuthology.parallel:result is None
2026-02-12T09:42:47.065 DEBUG:teuthology.orchestra.run.trial047:> cat /etc/os-release
2026-02-12T09:42:47.121 INFO:teuthology.orchestra.run.trial047.stdout:NAME="CentOS Stream"
2026-02-12T09:42:47.121 INFO:teuthology.orchestra.run.trial047.stdout:VERSION="9"
2026-02-12T09:42:47.121 INFO:teuthology.orchestra.run.trial047.stdout:ID="centos"
2026-02-12T09:42:47.121 INFO:teuthology.orchestra.run.trial047.stdout:ID_LIKE="rhel fedora"
2026-02-12T09:42:47.121 INFO:teuthology.orchestra.run.trial047.stdout:VERSION_ID="9"
2026-02-12T09:42:47.121 INFO:teuthology.orchestra.run.trial047.stdout:PLATFORM_ID="platform:el9"
2026-02-12T09:42:47.121 INFO:teuthology.orchestra.run.trial047.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T09:42:47.122 INFO:teuthology.orchestra.run.trial047.stdout:ANSI_COLOR="0;31"
2026-02-12T09:42:47.122 INFO:teuthology.orchestra.run.trial047.stdout:LOGO="fedora-logo-icon"
2026-02-12T09:42:47.122 INFO:teuthology.orchestra.run.trial047.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T09:42:47.122 INFO:teuthology.orchestra.run.trial047.stdout:HOME_URL="https://centos.org/"
2026-02-12T09:42:47.122 INFO:teuthology.orchestra.run.trial047.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T09:42:47.122 INFO:teuthology.orchestra.run.trial047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T09:42:47.122 INFO:teuthology.orchestra.run.trial047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T09:42:47.123 INFO:teuthology.provision.fog.trial047:Deploy complete!
2026-02-12T09:42:47.123 DEBUG:teuthology.parallel:result is None
2026-02-12T09:42:47.522 INFO:teuthology.lock.ops:Checking trial040.front.sepia.ceph.com
2026-02-12T09:42:47.522 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T09:42:47.621 INFO:teuthology.lock.ops:Checking trial047.front.sepia.ceph.com
2026-02-12T09:42:47.621 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T09:42:47.683 INFO:teuthology.lock.ops:Updating [trial040.front.sepia.ceph.com]: set os type and version on server
2026-02-12T09:42:47.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial040.front.sepia.ceph.com'
2026-02-12T09:42:47.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:42:47.746 DEBUG:teuthology.orchestra.run.trial040:> true
2026-02-12T09:42:47.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial040.front.sepia.ceph.com'
2026-02-12T09:42:47.825 DEBUG:teuthology.orchestra.run.trial040:> uname -m
2026-02-12T09:42:47.884 INFO:teuthology.orchestra.run.trial040.stdout:x86_64
2026-02-12T09:42:47.884 DEBUG:teuthology.orchestra.run.trial040:> cat /etc/os-release
2026-02-12T09:42:47.943 INFO:teuthology.orchestra.run.trial040.stdout:NAME="CentOS Stream"
2026-02-12T09:42:47.943 INFO:teuthology.orchestra.run.trial040.stdout:VERSION="9"
2026-02-12T09:42:47.943 INFO:teuthology.orchestra.run.trial040.stdout:ID="centos"
2026-02-12T09:42:47.944 INFO:teuthology.orchestra.run.trial040.stdout:ID_LIKE="rhel fedora"
2026-02-12T09:42:47.944 INFO:teuthology.orchestra.run.trial040.stdout:VERSION_ID="9"
2026-02-12T09:42:47.944 INFO:teuthology.orchestra.run.trial040.stdout:PLATFORM_ID="platform:el9"
2026-02-12T09:42:47.944 INFO:teuthology.orchestra.run.trial040.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T09:42:47.944 INFO:teuthology.orchestra.run.trial040.stdout:ANSI_COLOR="0;31"
2026-02-12T09:42:47.944 INFO:teuthology.orchestra.run.trial040.stdout:LOGO="fedora-logo-icon"
2026-02-12T09:42:47.944 INFO:teuthology.orchestra.run.trial040.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T09:42:47.944 INFO:teuthology.orchestra.run.trial040.stdout:HOME_URL="https://centos.org/"
2026-02-12T09:42:47.944 INFO:teuthology.orchestra.run.trial040.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T09:42:47.944 INFO:teuthology.orchestra.run.trial040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T09:42:47.944 INFO:teuthology.orchestra.run.trial040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T09:42:47.945 INFO:teuthology.lock.ops:Updating trial040.front.sepia.ceph.com on lock server
2026-02-12T09:42:48.047 INFO:teuthology.lock.ops:Updating [trial047.front.sepia.ceph.com]: set os type and version on server
2026-02-12T09:42:48.047 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial047.front.sepia.ceph.com'
2026-02-12T09:42:48.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:42:48.110 DEBUG:teuthology.orchestra.run.trial047:> true
2026-02-12T09:42:48.184 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial047.front.sepia.ceph.com'
2026-02-12T09:42:48.184 DEBUG:teuthology.orchestra.run.trial047:> uname -m
2026-02-12T09:42:48.240 INFO:teuthology.orchestra.run.trial047.stdout:x86_64
2026-02-12T09:42:48.241 DEBUG:teuthology.orchestra.run.trial047:> cat /etc/os-release
2026-02-12T09:42:48.297 INFO:teuthology.orchestra.run.trial047.stdout:NAME="CentOS Stream"
2026-02-12T09:42:48.297 INFO:teuthology.orchestra.run.trial047.stdout:VERSION="9"
2026-02-12T09:42:48.297 INFO:teuthology.orchestra.run.trial047.stdout:ID="centos"
2026-02-12T09:42:48.297 INFO:teuthology.orchestra.run.trial047.stdout:ID_LIKE="rhel fedora"
2026-02-12T09:42:48.297 INFO:teuthology.orchestra.run.trial047.stdout:VERSION_ID="9"
2026-02-12T09:42:48.297 INFO:teuthology.orchestra.run.trial047.stdout:PLATFORM_ID="platform:el9"
2026-02-12T09:42:48.298 INFO:teuthology.orchestra.run.trial047.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T09:42:48.298 INFO:teuthology.orchestra.run.trial047.stdout:ANSI_COLOR="0;31"
2026-02-12T09:42:48.298 INFO:teuthology.orchestra.run.trial047.stdout:LOGO="fedora-logo-icon"
2026-02-12T09:42:48.298 INFO:teuthology.orchestra.run.trial047.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T09:42:48.298 INFO:teuthology.orchestra.run.trial047.stdout:HOME_URL="https://centos.org/"
2026-02-12T09:42:48.298 INFO:teuthology.orchestra.run.trial047.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T09:42:48.298 INFO:teuthology.orchestra.run.trial047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T09:42:48.298 INFO:teuthology.orchestra.run.trial047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T09:42:48.299 INFO:teuthology.lock.ops:Updating trial047.front.sepia.ceph.com on lock server
2026-02-12T09:42:48.401 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:42:48.489 INFO:teuthology.dispatcher.supervisor:Running job 41705
2026-02-12T09:42:48.489 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/bin/teuthology -v --owner scheduled_matan@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41705 --name matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{default} thrashosds-health workloads/snaps-few-objects-localized} -- /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41705/orig.config.yaml
2026-02-12T09:42:48.490 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41705
2026-02-12T09:42:48.490 INFO:teuthology.dispatcher.supervisor:Job PID: 3510131
2026-02-12T09:42:48.490 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T09:44:48.590 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:46:48.793 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:48:48.985 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:50:49.184 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:52:49.309 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:54:49.493 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:56:49.651 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:58:49.840 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:00:50.054 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:02:50.251 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:04:50.448 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:06:50.660 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:08:50.858 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:10:51.065 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:12:51.182 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:14:51.391 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:16:51.551 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:18:51.749 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:20:51.957 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:22:52.183 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:24:52.389 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:26:52.562 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:28:52.713 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:30:52.879 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:30:52.959 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-12T10:30:53.073 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T10:30:53.587 INFO:teuthology.orchestra.console.trial047:Power off
2026-02-12T10:30:53.587 DEBUG:teuthology.orchestra.console.trial047:pexpect command: ipmitool -H trial047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T10:30:53.597 INFO:teuthology.orchestra.console.trial040:Power off
2026-02-12T10:30:53.597 DEBUG:teuthology.orchestra.console.trial040:pexpect command: ipmitool -H trial040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T10:30:53.626 DEBUG:teuthology.orchestra.console.trial047:power off output: Chassis Power Control: Down/Off
2026-02-12T10:30:53.636 DEBUG:teuthology.orchestra.console.trial040:power off output: Chassis Power Control: Down/Off
2026-02-12T10:30:57.631 DEBUG:teuthology.orchestra.console.trial047:pexpect command: ipmitool -H trial047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:30:57.638 DEBUG:teuthology.orchestra.console.trial040:pexpect command: ipmitool -H trial040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:30:57.740 DEBUG:teuthology.orchestra.console.trial047:check power output: Chassis Power is on
2026-02-12T10:30:57.745 DEBUG:teuthology.orchestra.console.trial040:check power output: Chassis Power is on
2026-02-12T10:31:01.745 DEBUG:teuthology.orchestra.console.trial047:pexpect command: ipmitool -H trial047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:31:01.751 DEBUG:teuthology.orchestra.console.trial040:pexpect command: ipmitool -H trial040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:31:01.854 DEBUG:teuthology.orchestra.console.trial047:check power output: Chassis Power is off
2026-02-12T10:31:01.854 INFO:teuthology.orchestra.console.trial047:Power off completed
2026-02-12T10:31:01.859 DEBUG:teuthology.orchestra.console.trial040:check power output: Chassis Power is off
2026-02-12T10:31:01.859 INFO:teuthology.orchestra.console.trial040:Power off completed
2026-02-12T10:31:02.112 INFO:teuthology.lock.ops:unlocked: trial047.front.sepia.ceph.com
2026-02-12T10:31:02.226 INFO:teuthology.lock.ops:unlocked: trial040.front.sepia.ceph.com