2026-02-23T12:29:00.425 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-23T12:29:00.425 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:29:00.495 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:29:00.685 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x725bc5a97740>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x725bc533dda0>, signals=[15])
2026-02-23T12:29:00.686 INFO:teuthology.lock.ops:Start node 'trial034.front.sepia.ceph.com' reimaging
2026-02-23T12:29:00.686 INFO:teuthology.lock.ops:Updating [trial034.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T12:29:00.686 INFO:teuthology.lock.ops:Updating trial034.front.sepia.ceph.com on lock server
2026-02-23T12:29:00.743 INFO:teuthology.lock.ops:Start node 'trial159.front.sepia.ceph.com' reimaging
2026-02-23T12:29:00.743 INFO:teuthology.lock.ops:Updating [trial159.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T12:29:00.743 INFO:teuthology.lock.ops:Updating trial159.front.sepia.ceph.com on lock server
2026-02-23T12:29:00.930 DEBUG:teuthology.provision.fog.trial034:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T12:29:00.952 DEBUG:teuthology.provision.fog.trial159:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T12:29:00.962 INFO:teuthology.provision.fog.trial034:Scheduling deploy of centos 9.stream
2026-02-23T12:29:00.983 INFO:teuthology.provision.fog.trial159:Scheduling deploy of centos 9.stream
2026-02-23T12:29:03.094 INFO:teuthology.orchestra.console.trial159:Power off
2026-02-23T12:29:03.094 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T12:29:03.112 INFO:teuthology.orchestra.console.trial034:Power off
2026-02-23T12:29:03.113 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T12:29:03.133 DEBUG:teuthology.orchestra.console.trial159:power off output: Chassis Power Control: Down/Off
2026-02-23T12:29:03.150 DEBUG:teuthology.orchestra.console.trial034:power off output: Chassis Power Control: Down/Off
2026-02-23T12:29:07.137 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T12:29:07.151 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T12:29:07.246 DEBUG:teuthology.orchestra.console.trial159:check power output: Chassis Power is off
2026-02-23T12:29:07.247 INFO:teuthology.orchestra.console.trial159:Power off completed
2026-02-23T12:29:07.258 DEBUG:teuthology.orchestra.console.trial034:check power output: Chassis Power is off
2026-02-23T12:29:07.259 INFO:teuthology.orchestra.console.trial034:Power off completed
2026-02-23T12:29:07.348 INFO:teuthology.orchestra.console.trial159:Power on
2026-02-23T12:29:07.348 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T12:29:07.360 INFO:teuthology.orchestra.console.trial034:Power on
2026-02-23T12:29:07.360 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T12:29:07.389 DEBUG:teuthology.orchestra.console.trial159:power on output: Chassis Power Control: Up/On
2026-02-23T12:29:07.399 DEBUG:teuthology.orchestra.console.trial034:power on output: Chassis Power Control: Up/On
2026-02-23T12:29:11.394 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T12:29:11.402 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T12:29:11.505 DEBUG:teuthology.orchestra.console.trial159:check power output: Chassis Power is on
2026-02-23T12:29:11.505 INFO:teuthology.orchestra.console.trial159:Power on completed
2026-02-23T12:29:11.511 DEBUG:teuthology.orchestra.console.trial034:check power output: Chassis Power is on
2026-02-23T12:29:11.511 INFO:teuthology.orchestra.console.trial034:Power on completed
2026-02-23T12:29:11.606 INFO:teuthology.provision.fog.trial159:Waiting for deploy to finish
2026-02-23T12:29:11.612 INFO:teuthology.provision.fog.trial034:Waiting for deploy to finish
2026-02-23T12:31:53.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:31:56.224 WARNING:teuthology.provision.fog.trial034:[Errno None] Unable to connect to port 22 on 10.20.193.34
2026-02-23T12:32:02.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:32:05.312 WARNING:teuthology.provision.fog.trial034:[Errno None] Unable to connect to port 22 on 10.20.193.34
2026-02-23T12:32:09.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:32:11.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:32:12.160 WARNING:teuthology.provision.fog.trial159:[Errno None] Unable to connect to port 22 on 10.20.193.159
2026-02-23T12:32:14.399 WARNING:teuthology.provision.fog.trial034:[Errno None] Unable to connect to port 22 on 10.20.193.34
2026-02-23T12:32:18.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:32:20.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:32:21.247 WARNING:teuthology.provision.fog.trial159:[Errno None] Unable to connect to port 22 on 10.20.193.159
2026-02-23T12:32:23.487 WARNING:teuthology.provision.fog.trial034:[Errno None] Unable to connect to port 22 on 10.20.193.34
2026-02-23T12:32:27.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:32:29.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:32:30.336 WARNING:teuthology.provision.fog.trial159:[Errno None] Unable to connect to port 22 on 10.20.193.159
2026-02-23T12:32:36.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:32:39.424 WARNING:teuthology.provision.fog.trial159:[Errno None] Unable to connect to port 22 on 10.20.193.159
2026-02-23T12:32:45.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:32:48.513 WARNING:teuthology.provision.fog.trial159:[Errno None] Unable to connect to port 22 on 10.20.193.159
2026-02-23T12:32:54.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:33:05.517 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T12:33:05.517 DEBUG:teuthology.orchestra.run.trial034:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T12:33:05.683 INFO:teuthology.provision.fog.trial034:Node is ready
2026-02-23T12:33:05.683 DEBUG:teuthology.orchestra.run.trial034:> hostname
2026-02-23T12:33:05.741 INFO:teuthology.orchestra.run.trial034.stdout:trial034.front.sepia.ceph.com
2026-02-23T12:33:05.742 DEBUG:teuthology.orchestra.run.trial034:> grep trial034.front.sepia.ceph.com /etc/hosts
2026-02-23T12:33:05.798 INFO:teuthology.orchestra.run.trial034.stdout:10.20.193.34 trial034.front.sepia.ceph.com trial034
2026-02-23T12:33:05.798 DEBUG:teuthology.orchestra.run.trial034:> sudo hostname trial034
2026-02-23T12:33:05.869 DEBUG:teuthology.orchestra.run.trial034:> sudo sed -i -e 's/trial034.front.sepia.ceph.com/trial034/g' /etc/hosts
2026-02-23T12:33:05.933 DEBUG:teuthology.orchestra.run.trial034:> sudo sed -i -e 's/10.20.193.34/10.20.193.34/g' /etc/hosts
2026-02-23T12:33:05.997 DEBUG:teuthology.orchestra.run.trial034:> sudo sed -i -e 's/trial034.front.sepia.ceph.com/trial034/g' /etc/hostname
2026-02-23T12:33:06.061 DEBUG:teuthology.orchestra.run.trial034:> sudo hostname trial034
2026-02-23T12:33:06.124 DEBUG:teuthology.orchestra.run.trial034:> cat /etc/os-release
2026-02-23T12:33:06.181 INFO:teuthology.orchestra.run.trial034.stdout:NAME="CentOS Stream"
2026-02-23T12:33:06.181 INFO:teuthology.orchestra.run.trial034.stdout:VERSION="9"
2026-02-23T12:33:06.181 INFO:teuthology.orchestra.run.trial034.stdout:ID="centos"
2026-02-23T12:33:06.181 INFO:teuthology.orchestra.run.trial034.stdout:ID_LIKE="rhel fedora"
2026-02-23T12:33:06.181 INFO:teuthology.orchestra.run.trial034.stdout:VERSION_ID="9"
2026-02-23T12:33:06.182 INFO:teuthology.orchestra.run.trial034.stdout:PLATFORM_ID="platform:el9"
2026-02-23T12:33:06.182 INFO:teuthology.orchestra.run.trial034.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T12:33:06.182 INFO:teuthology.orchestra.run.trial034.stdout:ANSI_COLOR="0;31"
2026-02-23T12:33:06.182 INFO:teuthology.orchestra.run.trial034.stdout:LOGO="fedora-logo-icon"
2026-02-23T12:33:06.182 INFO:teuthology.orchestra.run.trial034.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T12:33:06.182 INFO:teuthology.orchestra.run.trial034.stdout:HOME_URL="https://centos.org/"
2026-02-23T12:33:06.182 INFO:teuthology.orchestra.run.trial034.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T12:33:06.182 INFO:teuthology.orchestra.run.trial034.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T12:33:06.182 INFO:teuthology.orchestra.run.trial034.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T12:33:06.183 INFO:teuthology.provision.fog.trial034:Deploy complete!
2026-02-23T12:33:06.184 DEBUG:teuthology.parallel:result is None
2026-02-23T12:33:30.572 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T12:33:30.572 DEBUG:teuthology.orchestra.run.trial159:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T12:33:30.729 INFO:teuthology.provision.fog.trial159:Node is ready
2026-02-23T12:33:30.729 DEBUG:teuthology.orchestra.run.trial159:> hostname
2026-02-23T12:33:30.784 INFO:teuthology.orchestra.run.trial159.stdout:trial159.front.sepia.ceph.com
2026-02-23T12:33:30.784 DEBUG:teuthology.orchestra.run.trial159:> grep trial159.front.sepia.ceph.com /etc/hosts
2026-02-23T12:33:30.841 INFO:teuthology.orchestra.run.trial159.stdout:10.20.193.159 trial159.front.sepia.ceph.com trial159
2026-02-23T12:33:30.842 DEBUG:teuthology.orchestra.run.trial159:> sudo hostname trial159
2026-02-23T12:33:30.911 DEBUG:teuthology.orchestra.run.trial159:> sudo sed -i -e 's/trial159.front.sepia.ceph.com/trial159/g' /etc/hosts
2026-02-23T12:33:30.976 DEBUG:teuthology.orchestra.run.trial159:> sudo sed -i -e 's/10.20.193.159/10.20.193.159/g' /etc/hosts
2026-02-23T12:33:31.040 DEBUG:teuthology.orchestra.run.trial159:> sudo sed -i -e 's/trial159.front.sepia.ceph.com/trial159/g' /etc/hostname
2026-02-23T12:33:31.105 DEBUG:teuthology.orchestra.run.trial159:> sudo hostname trial159
2026-02-23T12:33:31.167 DEBUG:teuthology.orchestra.run.trial159:> cat /etc/os-release
2026-02-23T12:33:31.223 INFO:teuthology.orchestra.run.trial159.stdout:NAME="CentOS Stream"
2026-02-23T12:33:31.223 INFO:teuthology.orchestra.run.trial159.stdout:VERSION="9"
2026-02-23T12:33:31.223 INFO:teuthology.orchestra.run.trial159.stdout:ID="centos"
2026-02-23T12:33:31.223 INFO:teuthology.orchestra.run.trial159.stdout:ID_LIKE="rhel fedora"
2026-02-23T12:33:31.223 INFO:teuthology.orchestra.run.trial159.stdout:VERSION_ID="9"
2026-02-23T12:33:31.223 INFO:teuthology.orchestra.run.trial159.stdout:PLATFORM_ID="platform:el9"
2026-02-23T12:33:31.223 INFO:teuthology.orchestra.run.trial159.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T12:33:31.223 INFO:teuthology.orchestra.run.trial159.stdout:ANSI_COLOR="0;31"
2026-02-23T12:33:31.223 INFO:teuthology.orchestra.run.trial159.stdout:LOGO="fedora-logo-icon"
2026-02-23T12:33:31.223 INFO:teuthology.orchestra.run.trial159.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T12:33:31.223 INFO:teuthology.orchestra.run.trial159.stdout:HOME_URL="https://centos.org/"
2026-02-23T12:33:31.223 INFO:teuthology.orchestra.run.trial159.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T12:33:31.223 INFO:teuthology.orchestra.run.trial159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T12:33:31.223 INFO:teuthology.orchestra.run.trial159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T12:33:31.223 INFO:teuthology.provision.fog.trial159:Deploy complete!
2026-02-23T12:33:31.224 DEBUG:teuthology.parallel:result is None
2026-02-23T12:33:31.606 INFO:teuthology.lock.ops:Checking trial034.front.sepia.ceph.com
2026-02-23T12:33:31.606 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T12:33:31.667 INFO:teuthology.lock.ops:Checking trial159.front.sepia.ceph.com
2026-02-23T12:33:31.667 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T12:33:31.725 INFO:teuthology.lock.ops:Updating [trial034.front.sepia.ceph.com]: set os type and version on server
2026-02-23T12:33:31.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial034.front.sepia.ceph.com'
2026-02-23T12:33:31.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:33:31.787 DEBUG:teuthology.orchestra.run.trial034:> true
2026-02-23T12:33:31.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial034.front.sepia.ceph.com'
2026-02-23T12:33:31.933 DEBUG:teuthology.orchestra.run.trial034:> uname -m
2026-02-23T12:33:31.988 INFO:teuthology.orchestra.run.trial034.stdout:x86_64
2026-02-23T12:33:31.988 DEBUG:teuthology.orchestra.run.trial034:> cat /etc/os-release
2026-02-23T12:33:32.043 INFO:teuthology.orchestra.run.trial034.stdout:NAME="CentOS Stream"
2026-02-23T12:33:32.044 INFO:teuthology.orchestra.run.trial034.stdout:VERSION="9"
2026-02-23T12:33:32.044 INFO:teuthology.orchestra.run.trial034.stdout:ID="centos"
2026-02-23T12:33:32.044 INFO:teuthology.orchestra.run.trial034.stdout:ID_LIKE="rhel fedora"
2026-02-23T12:33:32.044 INFO:teuthology.orchestra.run.trial034.stdout:VERSION_ID="9"
2026-02-23T12:33:32.044 INFO:teuthology.orchestra.run.trial034.stdout:PLATFORM_ID="platform:el9"
2026-02-23T12:33:32.044 INFO:teuthology.orchestra.run.trial034.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T12:33:32.044 INFO:teuthology.orchestra.run.trial034.stdout:ANSI_COLOR="0;31"
2026-02-23T12:33:32.044 INFO:teuthology.orchestra.run.trial034.stdout:LOGO="fedora-logo-icon"
2026-02-23T12:33:32.044 INFO:teuthology.orchestra.run.trial034.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T12:33:32.044 INFO:teuthology.orchestra.run.trial034.stdout:HOME_URL="https://centos.org/"
2026-02-23T12:33:32.044 INFO:teuthology.orchestra.run.trial034.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T12:33:32.044 INFO:teuthology.orchestra.run.trial034.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T12:33:32.044 INFO:teuthology.orchestra.run.trial034.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T12:33:32.044 INFO:teuthology.lock.ops:Updating trial034.front.sepia.ceph.com on lock server
2026-02-23T12:33:32.104 INFO:teuthology.lock.ops:Updating [trial159.front.sepia.ceph.com]: set os type and version on server
2026-02-23T12:33:32.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial159.front.sepia.ceph.com'
2026-02-23T12:33:32.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:33:32.166 DEBUG:teuthology.orchestra.run.trial159:> true
2026-02-23T12:33:32.248 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial159.front.sepia.ceph.com'
2026-02-23T12:33:32.248 DEBUG:teuthology.orchestra.run.trial159:> uname -m
2026-02-23T12:33:32.303 INFO:teuthology.orchestra.run.trial159.stdout:x86_64
2026-02-23T12:33:32.304 DEBUG:teuthology.orchestra.run.trial159:> cat /etc/os-release
2026-02-23T12:33:32.360 INFO:teuthology.orchestra.run.trial159.stdout:NAME="CentOS Stream"
2026-02-23T12:33:32.360 INFO:teuthology.orchestra.run.trial159.stdout:VERSION="9"
2026-02-23T12:33:32.360 INFO:teuthology.orchestra.run.trial159.stdout:ID="centos"
2026-02-23T12:33:32.360 INFO:teuthology.orchestra.run.trial159.stdout:ID_LIKE="rhel fedora"
2026-02-23T12:33:32.360 INFO:teuthology.orchestra.run.trial159.stdout:VERSION_ID="9"
2026-02-23T12:33:32.360 INFO:teuthology.orchestra.run.trial159.stdout:PLATFORM_ID="platform:el9"
2026-02-23T12:33:32.360 INFO:teuthology.orchestra.run.trial159.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T12:33:32.360 INFO:teuthology.orchestra.run.trial159.stdout:ANSI_COLOR="0;31"
2026-02-23T12:33:32.360 INFO:teuthology.orchestra.run.trial159.stdout:LOGO="fedora-logo-icon"
2026-02-23T12:33:32.360 INFO:teuthology.orchestra.run.trial159.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T12:33:32.360 INFO:teuthology.orchestra.run.trial159.stdout:HOME_URL="https://centos.org/"
2026-02-23T12:33:32.360 INFO:teuthology.orchestra.run.trial159.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T12:33:32.361 INFO:teuthology.orchestra.run.trial159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T12:33:32.361 INFO:teuthology.orchestra.run.trial159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T12:33:32.361 INFO:teuthology.lock.ops:Updating trial159.front.sepia.ceph.com on lock server
2026-02-23T12:33:32.422 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:33:32.653 INFO:teuthology.dispatcher.supervisor:Running job 66422
2026-02-23T12:33:32.653 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_shraddhaag@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66422 --name shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/cephadm objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects-localized} -- /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66422/orig.config.yaml
2026-02-23T12:33:32.654 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66422
2026-02-23T12:33:32.654 INFO:teuthology.dispatcher.supervisor:Job PID: 570686
2026-02-23T12:33:32.654 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-23T12:35:32.753 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:37:32.928 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:39:33.143 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:41:33.346 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:43:33.615 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:45:33.768 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:47:33.941 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:49:34.096 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:51:34.203 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:53:34.402 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:55:34.588 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:57:34.785 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:59:34.955 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:01:35.137 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:03:35.344 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:05:35.532 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:07:35.690 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:09:35.861 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:11:36.069 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:13:36.292 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:15:36.485 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:17:36.659 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:19:36.847 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:21:37.034 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:23:37.217 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:25:37.398 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:25:37.474 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-23T13:25:37.582 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-23T13:25:38.077 INFO:teuthology.orchestra.console.trial159:Power off
2026-02-23T13:25:38.077 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T13:25:38.098 INFO:teuthology.orchestra.console.trial034:Power off
2026-02-23T13:25:38.098 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T13:25:38.116 DEBUG:teuthology.orchestra.console.trial159:power off output: Chassis Power Control: Down/Off
2026-02-23T13:25:38.136 DEBUG:teuthology.orchestra.console.trial034:power off output: Chassis Power Control: Down/Off
2026-02-23T13:25:42.119 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T13:25:42.137 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T13:25:42.228 DEBUG:teuthology.orchestra.console.trial159:check power output: Chassis Power is on
2026-02-23T13:25:42.245 DEBUG:teuthology.orchestra.console.trial034:check power output: Chassis Power is on
2026-02-23T13:25:46.232 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T13:25:46.247 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T13:25:46.343 DEBUG:teuthology.orchestra.console.trial159:check power output: Chassis Power is off
2026-02-23T13:25:46.343 INFO:teuthology.orchestra.console.trial159:Power off completed
2026-02-23T13:25:46.357 DEBUG:teuthology.orchestra.console.trial034:check power output: Chassis Power is off
2026-02-23T13:25:46.357 INFO:teuthology.orchestra.console.trial034:Power off completed
2026-02-23T13:25:46.590 INFO:teuthology.lock.ops:unlocked: trial159.front.sepia.ceph.com
2026-02-23T13:25:46.603 INFO:teuthology.lock.ops:unlocked: trial034.front.sepia.ceph.com