2026-02-12T10:31:34.522 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062
2026-02-12T10:31:34.522 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:31:34.598 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:31:34.799 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7e01c0f83050>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7e01c078dc60>, signals=[15])
2026-02-12T10:31:34.799 INFO:teuthology.lock.ops:Start node 'trial041.front.sepia.ceph.com' reimaging
2026-02-12T10:31:34.799 INFO:teuthology.lock.ops:Updating [trial041.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T10:31:34.799 INFO:teuthology.lock.ops:Updating trial041.front.sepia.ceph.com on lock server
2026-02-12T10:31:34.857 INFO:teuthology.lock.ops:Start node 'trial056.front.sepia.ceph.com' reimaging
2026-02-12T10:31:34.857 INFO:teuthology.lock.ops:Updating [trial056.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T10:31:34.857 INFO:teuthology.lock.ops:Updating trial056.front.sepia.ceph.com on lock server
2026-02-12T10:31:35.064 DEBUG:teuthology.provision.fog.trial041:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T10:31:35.099 DEBUG:teuthology.provision.fog.trial056:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T10:31:35.115 INFO:teuthology.provision.fog.trial041:Scheduling deploy of centos 9.stream
2026-02-12T10:31:35.153 INFO:teuthology.provision.fog.trial056:Scheduling deploy of centos 9.stream
2026-02-12T10:31:36.082 INFO:teuthology.orchestra.console.trial041:Power off
2026-02-12T10:31:36.082 DEBUG:teuthology.orchestra.console.trial041:pexpect command: ipmitool -H trial041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T10:31:36.102 INFO:teuthology.orchestra.console.trial056:Power off
2026-02-12T10:31:36.103 DEBUG:teuthology.orchestra.console.trial056:pexpect command: ipmitool -H trial056.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T10:31:36.122 DEBUG:teuthology.orchestra.console.trial041:power off output: Chassis Power Control: Down/Off
2026-02-12T10:31:36.139 DEBUG:teuthology.orchestra.console.trial056:power off output: Chassis Power Control: Down/Off
2026-02-12T10:31:40.126 DEBUG:teuthology.orchestra.console.trial041:pexpect command: ipmitool -H trial041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:31:40.140 DEBUG:teuthology.orchestra.console.trial056:pexpect command: ipmitool -H trial056.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:31:40.236 DEBUG:teuthology.orchestra.console.trial041:check power output: Chassis Power is off
2026-02-12T10:31:40.236 INFO:teuthology.orchestra.console.trial041:Power off completed
2026-02-12T10:31:40.248 DEBUG:teuthology.orchestra.console.trial056:check power output: Chassis Power is off
2026-02-12T10:31:40.248 INFO:teuthology.orchestra.console.trial056:Power off completed
2026-02-12T10:31:40.337 INFO:teuthology.orchestra.console.trial041:Power on
2026-02-12T10:31:40.337 DEBUG:teuthology.orchestra.console.trial041:pexpect command: ipmitool -H trial041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T10:31:40.349 INFO:teuthology.orchestra.console.trial056:Power on
2026-02-12T10:31:40.350 DEBUG:teuthology.orchestra.console.trial056:pexpect command: ipmitool -H trial056.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T10:31:40.380 DEBUG:teuthology.orchestra.console.trial041:power on output: Chassis Power Control: Up/On
2026-02-12T10:31:40.391 DEBUG:teuthology.orchestra.console.trial056:power on output: Chassis Power Control: Up/On
2026-02-12T10:31:44.384 DEBUG:teuthology.orchestra.console.trial041:pexpect command: ipmitool -H trial041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:31:44.394 DEBUG:teuthology.orchestra.console.trial056:pexpect command: ipmitool -H trial056.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:31:44.496 DEBUG:teuthology.orchestra.console.trial041:check power output: Chassis Power is on
2026-02-12T10:31:44.496 INFO:teuthology.orchestra.console.trial041:Power on completed
2026-02-12T10:31:44.502 DEBUG:teuthology.orchestra.console.trial056:check power output: Chassis Power is on
2026-02-12T10:31:44.502 INFO:teuthology.orchestra.console.trial056:Power on completed
2026-02-12T10:31:44.598 INFO:teuthology.provision.fog.trial041:Waiting for deploy to finish
2026-02-12T10:31:44.603 INFO:teuthology.provision.fog.trial056:Waiting for deploy to finish
2026-02-12T10:33:31.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial056.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:33:31.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:33:34.813 WARNING:teuthology.provision.fog.trial056:[Errno None] Unable to connect to port 22 on 10.20.193.56
2026-02-12T10:33:34.813 WARNING:teuthology.provision.fog.trial041:[Errno None] Unable to connect to port 22 on 10.20.193.41
2026-02-12T10:33:40.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial056.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:33:40.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:33:43.901 WARNING:teuthology.provision.fog.trial041:[Errno None] Unable to connect to port 22 on 10.20.193.41
2026-02-12T10:33:43.901 WARNING:teuthology.provision.fog.trial056:[Errno None] Unable to connect to port 22 on 10.20.193.56
2026-02-12T10:33:49.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:33:49.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial056.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:33:52.989 WARNING:teuthology.provision.fog.trial041:[Errno None] Unable to connect to port 22 on 10.20.193.41
2026-02-12T10:33:52.989 WARNING:teuthology.provision.fog.trial056:[Errno None] Unable to connect to port 22 on 10.20.193.56
2026-02-12T10:33:58.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:33:58.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial056.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:34:02.077 WARNING:teuthology.provision.fog.trial041:[Errno None] Unable to connect to port 22 on 10.20.193.41
2026-02-12T10:34:08.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:34:35.175 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T10:34:35.175 DEBUG:teuthology.orchestra.run.trial056:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T10:34:35.413 INFO:teuthology.provision.fog.trial056:Node is ready
2026-02-12T10:34:35.413 DEBUG:teuthology.orchestra.run.trial056:> hostname
2026-02-12T10:34:35.467 INFO:teuthology.orchestra.run.trial056.stdout:trial056.front.sepia.ceph.com
2026-02-12T10:34:35.467 DEBUG:teuthology.orchestra.run.trial056:> grep trial056.front.sepia.ceph.com /etc/hosts
2026-02-12T10:34:35.520 INFO:teuthology.orchestra.run.trial056.stdout:10.20.193.56 trial056.front.sepia.ceph.com trial056
2026-02-12T10:34:35.521 DEBUG:teuthology.orchestra.run.trial056:> sudo hostname trial056
2026-02-12T10:34:35.602 DEBUG:teuthology.orchestra.run.trial056:> sudo sed -i -e 's/trial056.front.sepia.ceph.com/trial056/g' /etc/hosts
2026-02-12T10:34:35.628 DEBUG:teuthology.orchestra.run.trial056:> sudo sed -i -e 's/10.20.193.56/10.20.193.56/g' /etc/hosts
2026-02-12T10:34:35.690 DEBUG:teuthology.orchestra.run.trial056:> sudo sed -i -e 's/trial056.front.sepia.ceph.com/trial056/g' /etc/hostname
2026-02-12T10:34:35.751 DEBUG:teuthology.orchestra.run.trial056:> sudo hostname trial056
2026-02-12T10:34:35.811 DEBUG:teuthology.orchestra.run.trial056:> cat /etc/os-release
2026-02-12T10:34:35.894 INFO:teuthology.orchestra.run.trial056.stdout:NAME="CentOS Stream"
2026-02-12T10:34:35.894 INFO:teuthology.orchestra.run.trial056.stdout:VERSION="9"
2026-02-12T10:34:35.894 INFO:teuthology.orchestra.run.trial056.stdout:ID="centos"
2026-02-12T10:34:35.894 INFO:teuthology.orchestra.run.trial056.stdout:ID_LIKE="rhel fedora"
2026-02-12T10:34:35.894 INFO:teuthology.orchestra.run.trial056.stdout:VERSION_ID="9"
2026-02-12T10:34:35.894 INFO:teuthology.orchestra.run.trial056.stdout:PLATFORM_ID="platform:el9"
2026-02-12T10:34:35.894 INFO:teuthology.orchestra.run.trial056.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T10:34:35.894 INFO:teuthology.orchestra.run.trial056.stdout:ANSI_COLOR="0;31"
2026-02-12T10:34:35.895 INFO:teuthology.orchestra.run.trial056.stdout:LOGO="fedora-logo-icon"
2026-02-12T10:34:35.895 INFO:teuthology.orchestra.run.trial056.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T10:34:35.895 INFO:teuthology.orchestra.run.trial056.stdout:HOME_URL="https://centos.org/"
2026-02-12T10:34:35.895 INFO:teuthology.orchestra.run.trial056.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T10:34:35.895 INFO:teuthology.orchestra.run.trial056.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T10:34:35.895 INFO:teuthology.orchestra.run.trial056.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T10:34:35.896 INFO:teuthology.provision.fog.trial056:Deploy complete!
2026-02-12T10:34:35.897 DEBUG:teuthology.parallel:result is None
2026-02-12T10:34:43.899 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T10:34:43.899 DEBUG:teuthology.orchestra.run.trial041:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T10:34:44.147 INFO:teuthology.provision.fog.trial041:Node is ready
2026-02-12T10:34:44.147 DEBUG:teuthology.orchestra.run.trial041:> hostname
2026-02-12T10:34:44.204 INFO:teuthology.orchestra.run.trial041.stdout:trial041.front.sepia.ceph.com
2026-02-12T10:34:44.204 DEBUG:teuthology.orchestra.run.trial041:> grep trial041.front.sepia.ceph.com /etc/hosts
2026-02-12T10:34:44.261 INFO:teuthology.orchestra.run.trial041.stdout:10.20.193.41 trial041.front.sepia.ceph.com trial041
2026-02-12T10:34:44.262 DEBUG:teuthology.orchestra.run.trial041:> sudo hostname trial041
2026-02-12T10:34:44.333 DEBUG:teuthology.orchestra.run.trial041:> sudo sed -i -e 's/trial041.front.sepia.ceph.com/trial041/g' /etc/hosts
2026-02-12T10:34:44.397 DEBUG:teuthology.orchestra.run.trial041:> sudo sed -i -e 's/10.20.193.41/10.20.193.41/g' /etc/hosts
2026-02-12T10:34:44.463 DEBUG:teuthology.orchestra.run.trial041:> sudo sed -i -e 's/trial041.front.sepia.ceph.com/trial041/g' /etc/hostname
2026-02-12T10:34:44.529 DEBUG:teuthology.orchestra.run.trial041:> sudo hostname trial041
2026-02-12T10:34:44.593 DEBUG:teuthology.orchestra.run.trial041:> cat /etc/os-release
2026-02-12T10:34:44.650 INFO:teuthology.orchestra.run.trial041.stdout:NAME="CentOS Stream"
2026-02-12T10:34:44.650 INFO:teuthology.orchestra.run.trial041.stdout:VERSION="9"
2026-02-12T10:34:44.650 INFO:teuthology.orchestra.run.trial041.stdout:ID="centos"
2026-02-12T10:34:44.651 INFO:teuthology.orchestra.run.trial041.stdout:ID_LIKE="rhel fedora"
2026-02-12T10:34:44.651 INFO:teuthology.orchestra.run.trial041.stdout:VERSION_ID="9"
2026-02-12T10:34:44.651 INFO:teuthology.orchestra.run.trial041.stdout:PLATFORM_ID="platform:el9"
2026-02-12T10:34:44.651 INFO:teuthology.orchestra.run.trial041.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T10:34:44.651 INFO:teuthology.orchestra.run.trial041.stdout:ANSI_COLOR="0;31"
2026-02-12T10:34:44.651 INFO:teuthology.orchestra.run.trial041.stdout:LOGO="fedora-logo-icon"
2026-02-12T10:34:44.651 INFO:teuthology.orchestra.run.trial041.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T10:34:44.651 INFO:teuthology.orchestra.run.trial041.stdout:HOME_URL="https://centos.org/"
2026-02-12T10:34:44.651 INFO:teuthology.orchestra.run.trial041.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T10:34:44.651 INFO:teuthology.orchestra.run.trial041.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T10:34:44.651 INFO:teuthology.orchestra.run.trial041.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T10:34:44.652 INFO:teuthology.provision.fog.trial041:Deploy complete!
2026-02-12T10:34:44.653 DEBUG:teuthology.parallel:result is None
2026-02-12T10:34:45.048 INFO:teuthology.lock.ops:Checking trial041.front.sepia.ceph.com
2026-02-12T10:34:45.048 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T10:34:45.143 INFO:teuthology.lock.ops:Checking trial056.front.sepia.ceph.com
2026-02-12T10:34:45.144 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T10:34:45.204 INFO:teuthology.lock.ops:Updating [trial041.front.sepia.ceph.com]: set os type and version on server
2026-02-12T10:34:45.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial041.front.sepia.ceph.com'
2026-02-12T10:34:45.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:34:45.265 DEBUG:teuthology.orchestra.run.trial041:> true
2026-02-12T10:34:45.372 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial041.front.sepia.ceph.com'
2026-02-12T10:34:45.373 DEBUG:teuthology.orchestra.run.trial041:> uname -m
2026-02-12T10:34:45.466 INFO:teuthology.orchestra.run.trial041.stdout:x86_64
2026-02-12T10:34:45.466 DEBUG:teuthology.orchestra.run.trial041:> cat /etc/os-release
2026-02-12T10:34:45.511 INFO:teuthology.orchestra.run.trial041.stdout:NAME="CentOS Stream"
2026-02-12T10:34:45.512 INFO:teuthology.orchestra.run.trial041.stdout:VERSION="9"
2026-02-12T10:34:45.512 INFO:teuthology.orchestra.run.trial041.stdout:ID="centos"
2026-02-12T10:34:45.512 INFO:teuthology.orchestra.run.trial041.stdout:ID_LIKE="rhel fedora"
2026-02-12T10:34:45.512 INFO:teuthology.orchestra.run.trial041.stdout:VERSION_ID="9"
2026-02-12T10:34:45.512 INFO:teuthology.orchestra.run.trial041.stdout:PLATFORM_ID="platform:el9"
2026-02-12T10:34:45.512 INFO:teuthology.orchestra.run.trial041.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T10:34:45.512 INFO:teuthology.orchestra.run.trial041.stdout:ANSI_COLOR="0;31"
2026-02-12T10:34:45.512 INFO:teuthology.orchestra.run.trial041.stdout:LOGO="fedora-logo-icon"
2026-02-12T10:34:45.512 INFO:teuthology.orchestra.run.trial041.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T10:34:45.512 INFO:teuthology.orchestra.run.trial041.stdout:HOME_URL="https://centos.org/"
2026-02-12T10:34:45.513 INFO:teuthology.orchestra.run.trial041.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T10:34:45.513 INFO:teuthology.orchestra.run.trial041.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T10:34:45.513 INFO:teuthology.orchestra.run.trial041.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T10:34:45.513 INFO:teuthology.lock.ops:Updating trial041.front.sepia.ceph.com on lock server
2026-02-12T10:34:45.618 INFO:teuthology.lock.ops:Updating [trial056.front.sepia.ceph.com]: set os type and version on server
2026-02-12T10:34:45.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial056.front.sepia.ceph.com'
2026-02-12T10:34:45.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial056.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T10:34:45.690 DEBUG:teuthology.orchestra.run.trial056:> true
2026-02-12T10:34:45.772 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial056.front.sepia.ceph.com'
2026-02-12T10:34:45.772 DEBUG:teuthology.orchestra.run.trial056:> uname -m
2026-02-12T10:34:45.827 INFO:teuthology.orchestra.run.trial056.stdout:x86_64
2026-02-12T10:34:45.828 DEBUG:teuthology.orchestra.run.trial056:> cat /etc/os-release
2026-02-12T10:34:45.884 INFO:teuthology.orchestra.run.trial056.stdout:NAME="CentOS Stream"
2026-02-12T10:34:45.884 INFO:teuthology.orchestra.run.trial056.stdout:VERSION="9"
2026-02-12T10:34:45.884 INFO:teuthology.orchestra.run.trial056.stdout:ID="centos"
2026-02-12T10:34:45.884 INFO:teuthology.orchestra.run.trial056.stdout:ID_LIKE="rhel fedora"
2026-02-12T10:34:45.884 INFO:teuthology.orchestra.run.trial056.stdout:VERSION_ID="9"
2026-02-12T10:34:45.884 INFO:teuthology.orchestra.run.trial056.stdout:PLATFORM_ID="platform:el9"
2026-02-12T10:34:45.884 INFO:teuthology.orchestra.run.trial056.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T10:34:45.885 INFO:teuthology.orchestra.run.trial056.stdout:ANSI_COLOR="0;31"
2026-02-12T10:34:45.885 INFO:teuthology.orchestra.run.trial056.stdout:LOGO="fedora-logo-icon"
2026-02-12T10:34:45.885 INFO:teuthology.orchestra.run.trial056.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T10:34:45.885 INFO:teuthology.orchestra.run.trial056.stdout:HOME_URL="https://centos.org/"
2026-02-12T10:34:45.885 INFO:teuthology.orchestra.run.trial056.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T10:34:45.885 INFO:teuthology.orchestra.run.trial056.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T10:34:45.885 INFO:teuthology.orchestra.run.trial056.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T10:34:45.886 INFO:teuthology.lock.ops:Updating trial056.front.sepia.ceph.com on lock server
2026-02-12T10:34:45.988 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:34:46.083 INFO:teuthology.dispatcher.supervisor:Running job 41802
2026-02-12T10:34:46.084 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/bin/teuthology -v --owner scheduled_matan@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41802 --name matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{default} thrashosds-health workloads/snaps-few-objects} -- /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41802/orig.config.yaml
2026-02-12T10:34:46.084 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41802
2026-02-12T10:34:46.084 INFO:teuthology.dispatcher.supervisor:Job PID: 3655625
2026-02-12T10:34:46.084 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T10:36:46.087 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:38:46.194 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:40:46.357 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:42:46.563 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:44:46.749 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:46:46.909 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:48:47.019 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:50:47.202 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:52:47.386 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:54:47.602 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:56:47.808 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:58:48.029 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:00:48.228 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:02:48.338 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:04:48.534 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:06:48.720 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:08:48.877 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:10:49.058 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:12:49.174 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:14:49.350 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:16:49.538 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:18:49.677 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:20:49.790 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:20:49.875 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-12T11:20:49.990 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T11:20:50.502 INFO:teuthology.orchestra.console.trial041:Power off
2026-02-12T11:20:50.502 DEBUG:teuthology.orchestra.console.trial041:pexpect command: ipmitool -H trial041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T11:20:50.514 INFO:teuthology.orchestra.console.trial056:Power off
2026-02-12T11:20:50.514 DEBUG:teuthology.orchestra.console.trial056:pexpect command: ipmitool -H trial056.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T11:20:50.543 DEBUG:teuthology.orchestra.console.trial041:power off output: Chassis Power Control: Down/Off
2026-02-12T11:20:50.550 DEBUG:teuthology.orchestra.console.trial056:power off output: Chassis Power Control: Down/Off
2026-02-12T11:20:54.548 DEBUG:teuthology.orchestra.console.trial041:pexpect command: ipmitool -H trial041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:20:54.554 DEBUG:teuthology.orchestra.console.trial056:pexpect command: ipmitool -H trial056.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:20:54.657 DEBUG:teuthology.orchestra.console.trial041:check power output: Chassis Power is on
2026-02-12T11:20:54.663 DEBUG:teuthology.orchestra.console.trial056:check power output: Chassis Power is on
2026-02-12T11:20:58.662 DEBUG:teuthology.orchestra.console.trial041:pexpect command: ipmitool -H trial041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:20:58.670 DEBUG:teuthology.orchestra.console.trial056:pexpect command: ipmitool -H trial056.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:20:58.773 DEBUG:teuthology.orchestra.console.trial041:check power output: Chassis Power is off
2026-02-12T11:20:58.773 INFO:teuthology.orchestra.console.trial041:Power off completed
2026-02-12T11:20:58.779 DEBUG:teuthology.orchestra.console.trial056:check power output: Chassis Power is off
2026-02-12T11:20:58.779 INFO:teuthology.orchestra.console.trial056:Power off completed
2026-02-12T11:20:59.029 INFO:teuthology.lock.ops:unlocked: trial056.front.sepia.ceph.com
2026-02-12T11:20:59.033 INFO:teuthology.lock.ops:unlocked: trial041.front.sepia.ceph.com