2026-02-12T11:02:07.015 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-12T11:02:07.015 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:02:07.090 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:02:07.288 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f626d297380>, signals=[15]) 2026-02-12T11:02:07.288 INFO:teuthology.lock.ops:Start node 'trial031.front.sepia.ceph.com' reimaging 2026-02-12T11:02:07.288 INFO:teuthology.lock.ops:Updating [trial031.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T11:02:07.288 INFO:teuthology.lock.ops:Updating trial031.front.sepia.ceph.com on lock server 2026-02-12T11:02:07.346 INFO:teuthology.lock.ops:Start node 'trial069.front.sepia.ceph.com' reimaging 2026-02-12T11:02:07.346 INFO:teuthology.lock.ops:Updating [trial069.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T11:02:07.346 INFO:teuthology.lock.ops:Updating trial069.front.sepia.ceph.com on lock server 2026-02-12T11:02:07.555 DEBUG:teuthology.provision.fog.trial069:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T11:02:07.566 DEBUG:teuthology.provision.fog.trial031:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T11:02:07.607 INFO:teuthology.provision.fog.trial069:Scheduling deploy of centos 9.stream 2026-02-12T11:02:07.618 INFO:teuthology.provision.fog.trial031:Scheduling deploy of centos 9.stream 2026-02-12T11:02:08.584 INFO:teuthology.orchestra.console.trial031:Power off 2026-02-12T11:02:08.584 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T11:02:08.603 INFO:teuthology.orchestra.console.trial069:Power off 2026-02-12T11:02:08.603 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T11:02:08.623 DEBUG:teuthology.orchestra.console.trial031:power off output: Chassis Power Control: Down/Off 2026-02-12T11:02:08.642 DEBUG:teuthology.orchestra.console.trial069:power off output: Chassis Power Control: Down/Off 2026-02-12T11:02:12.627 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T11:02:12.643 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T11:02:12.737 DEBUG:teuthology.orchestra.console.trial031:check power output: Chassis Power is off 2026-02-12T11:02:12.737 INFO:teuthology.orchestra.console.trial031:Power off completed 2026-02-12T11:02:12.751 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is off 2026-02-12T11:02:12.751 INFO:teuthology.orchestra.console.trial069:Power off completed 2026-02-12T11:02:12.839 INFO:teuthology.orchestra.console.trial031:Power on 2026-02-12T11:02:12.839 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T11:02:12.852 INFO:teuthology.orchestra.console.trial069:Power on 2026-02-12T11:02:12.853 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T11:02:12.880 DEBUG:teuthology.orchestra.console.trial031:power on output: Chassis Power Control: Up/On 2026-02-12T11:02:12.895 DEBUG:teuthology.orchestra.console.trial069:power on output: Chassis Power Control: Up/On 2026-02-12T11:02:16.885 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T11:02:16.896 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T11:02:16.993 DEBUG:teuthology.orchestra.console.trial031:check power output: Chassis Power is off 2026-02-12T11:02:17.003 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is on 2026-02-12T11:02:17.004 INFO:teuthology.orchestra.console.trial069:Power on completed 2026-02-12T11:02:17.104 INFO:teuthology.provision.fog.trial069:Waiting for deploy to finish 2026-02-12T11:02:20.998 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T11:02:21.108 DEBUG:teuthology.orchestra.console.trial031:check power output: Chassis Power is on 2026-02-12T11:02:21.109 INFO:teuthology.orchestra.console.trial031:Power on completed 2026-02-12T11:02:21.209 INFO:teuthology.provision.fog.trial031:Waiting for deploy to finish 2026-02-12T11:04:04.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T11:04:07.581 WARNING:teuthology.provision.fog.trial069:[Errno None] Unable to connect to port 22 on 10.20.193.69 2026-02-12T11:04:08.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T11:04:11.741 WARNING:teuthology.provision.fog.trial031:[Errno None] Unable to connect to port 22 on 10.20.193.31 2026-02-12T11:04:13.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T11:04:16.669 WARNING:teuthology.provision.fog.trial069:[Errno None] Unable to connect to port 22 on 10.20.193.69 2026-02-12T11:04:17.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T11:04:20.830 WARNING:teuthology.provision.fog.trial031:[Errno None] Unable to connect to port 22 on 10.20.193.31 2026-02-12T11:04:22.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T11:04:25.757 WARNING:teuthology.provision.fog.trial069:[Errno None] Unable to connect to port 22 on 10.20.193.69 2026-02-12T11:04:26.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T11:04:29.917 WARNING:teuthology.provision.fog.trial031:[Errno None] Unable to connect to port 22 on 10.20.193.31 2026-02-12T11:04:31.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T11:04:34.845 WARNING:teuthology.provision.fog.trial069:[Errno None] Unable to connect to port 22 on 10.20.193.69 2026-02-12T11:04:35.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T11:04:39.005 WARNING:teuthology.provision.fog.trial031:[Errno None] Unable to connect to port 22 on 10.20.193.31 2026-02-12T11:04:40.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T11:04:45.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T11:05:16.835 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T11:05:16.835 DEBUG:teuthology.orchestra.run.trial069:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T11:05:17.070 INFO:teuthology.provision.fog.trial069:Node is ready 2026-02-12T11:05:17.070 DEBUG:teuthology.orchestra.run.trial069:> hostname 2026-02-12T11:05:17.124 INFO:teuthology.orchestra.run.trial069.stdout:trial069.front.sepia.ceph.com 2026-02-12T11:05:17.125 DEBUG:teuthology.orchestra.run.trial069:> grep trial069.front.sepia.ceph.com /etc/hosts 2026-02-12T11:05:17.177 INFO:teuthology.orchestra.run.trial069.stdout:10.20.193.69 trial069.front.sepia.ceph.com trial069 2026-02-12T11:05:17.178 DEBUG:teuthology.orchestra.run.trial069:> sudo hostname trial069 2026-02-12T11:05:17.244 DEBUG:teuthology.orchestra.run.trial069:> sudo sed -i -e 's/trial069.front.sepia.ceph.com/trial069/g' /etc/hosts 2026-02-12T11:05:17.307 DEBUG:teuthology.orchestra.run.trial069:> sudo sed -i -e 's/10.20.193.69/10.20.193.69/g' /etc/hosts 2026-02-12T11:05:17.370 DEBUG:teuthology.orchestra.run.trial069:> sudo sed -i -e 's/trial069.front.sepia.ceph.com/trial069/g' /etc/hostname 2026-02-12T11:05:17.433 DEBUG:teuthology.orchestra.run.trial069:> sudo hostname trial069 2026-02-12T11:05:17.495 DEBUG:teuthology.orchestra.run.trial069:> cat /etc/os-release 2026-02-12T11:05:17.549 INFO:teuthology.orchestra.run.trial069.stdout:NAME="CentOS Stream" 2026-02-12T11:05:17.549 INFO:teuthology.orchestra.run.trial069.stdout:VERSION="9" 2026-02-12T11:05:17.549 INFO:teuthology.orchestra.run.trial069.stdout:ID="centos" 2026-02-12T11:05:17.549 INFO:teuthology.orchestra.run.trial069.stdout:ID_LIKE="rhel fedora" 2026-02-12T11:05:17.549 INFO:teuthology.orchestra.run.trial069.stdout:VERSION_ID="9" 2026-02-12T11:05:17.549 INFO:teuthology.orchestra.run.trial069.stdout:PLATFORM_ID="platform:el9" 2026-02-12T11:05:17.549 INFO:teuthology.orchestra.run.trial069.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T11:05:17.549 INFO:teuthology.orchestra.run.trial069.stdout:ANSI_COLOR="0;31" 2026-02-12T11:05:17.550 INFO:teuthology.orchestra.run.trial069.stdout:LOGO="fedora-logo-icon" 2026-02-12T11:05:17.550 INFO:teuthology.orchestra.run.trial069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T11:05:17.550 INFO:teuthology.orchestra.run.trial069.stdout:HOME_URL="https://centos.org/" 2026-02-12T11:05:17.550 INFO:teuthology.orchestra.run.trial069.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T11:05:17.550 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T11:05:17.550 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T11:05:17.551 INFO:teuthology.provision.fog.trial069:Deploy complete! 2026-02-12T11:05:17.552 DEBUG:teuthology.parallel:result is None 2026-02-12T11:05:20.905 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T11:05:20.905 DEBUG:teuthology.orchestra.run.trial031:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T11:05:21.061 INFO:teuthology.provision.fog.trial031:Node is ready 2026-02-12T11:05:21.061 DEBUG:teuthology.orchestra.run.trial031:> hostname 2026-02-12T11:05:21.117 INFO:teuthology.orchestra.run.trial031.stdout:trial031.front.sepia.ceph.com 2026-02-12T11:05:21.118 DEBUG:teuthology.orchestra.run.trial031:> grep trial031.front.sepia.ceph.com /etc/hosts 2026-02-12T11:05:21.174 INFO:teuthology.orchestra.run.trial031.stdout:10.20.193.31 trial031.front.sepia.ceph.com trial031 2026-02-12T11:05:21.174 DEBUG:teuthology.orchestra.run.trial031:> sudo hostname trial031 2026-02-12T11:05:21.243 DEBUG:teuthology.orchestra.run.trial031:> sudo sed -i -e 's/trial031.front.sepia.ceph.com/trial031/g' /etc/hosts 2026-02-12T11:05:21.308 DEBUG:teuthology.orchestra.run.trial031:> sudo sed -i -e 's/10.20.193.31/10.20.193.31/g' /etc/hosts 2026-02-12T11:05:21.371 DEBUG:teuthology.orchestra.run.trial031:> sudo sed -i -e 's/trial031.front.sepia.ceph.com/trial031/g' /etc/hostname 2026-02-12T11:05:21.436 DEBUG:teuthology.orchestra.run.trial031:> sudo hostname trial031 2026-02-12T11:05:21.500 DEBUG:teuthology.orchestra.run.trial031:> cat /etc/os-release 2026-02-12T11:05:21.557 INFO:teuthology.orchestra.run.trial031.stdout:NAME="CentOS Stream" 2026-02-12T11:05:21.557 INFO:teuthology.orchestra.run.trial031.stdout:VERSION="9" 2026-02-12T11:05:21.557 INFO:teuthology.orchestra.run.trial031.stdout:ID="centos" 2026-02-12T11:05:21.557 INFO:teuthology.orchestra.run.trial031.stdout:ID_LIKE="rhel fedora" 2026-02-12T11:05:21.557 INFO:teuthology.orchestra.run.trial031.stdout:VERSION_ID="9" 2026-02-12T11:05:21.557 INFO:teuthology.orchestra.run.trial031.stdout:PLATFORM_ID="platform:el9" 2026-02-12T11:05:21.558 INFO:teuthology.orchestra.run.trial031.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T11:05:21.558 INFO:teuthology.orchestra.run.trial031.stdout:ANSI_COLOR="0;31" 2026-02-12T11:05:21.558 INFO:teuthology.orchestra.run.trial031.stdout:LOGO="fedora-logo-icon" 2026-02-12T11:05:21.558 INFO:teuthology.orchestra.run.trial031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T11:05:21.558 INFO:teuthology.orchestra.run.trial031.stdout:HOME_URL="https://centos.org/" 2026-02-12T11:05:21.558 INFO:teuthology.orchestra.run.trial031.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T11:05:21.558 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T11:05:21.558 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T11:05:21.559 INFO:teuthology.provision.fog.trial031:Deploy complete! 2026-02-12T11:05:21.559 DEBUG:teuthology.parallel:result is None 2026-02-12T11:05:21.967 INFO:teuthology.lock.ops:Checking trial031.front.sepia.ceph.com 2026-02-12T11:05:21.967 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T11:05:22.031 INFO:teuthology.lock.ops:Checking trial069.front.sepia.ceph.com 2026-02-12T11:05:22.032 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T11:05:22.091 INFO:teuthology.lock.ops:Updating [trial031.front.sepia.ceph.com]: set os type and version on server 2026-02-12T11:05:22.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T11:05:22.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T11:05:22.153 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T11:05:22.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T11:05:22.223 DEBUG:teuthology.orchestra.run.trial031:> uname -m 2026-02-12T11:05:22.279 INFO:teuthology.orchestra.run.trial031.stdout:x86_64 2026-02-12T11:05:22.280 DEBUG:teuthology.orchestra.run.trial031:> cat /etc/os-release 2026-02-12T11:05:22.336 INFO:teuthology.orchestra.run.trial031.stdout:NAME="CentOS Stream" 2026-02-12T11:05:22.336 INFO:teuthology.orchestra.run.trial031.stdout:VERSION="9" 2026-02-12T11:05:22.336 INFO:teuthology.orchestra.run.trial031.stdout:ID="centos" 2026-02-12T11:05:22.336 INFO:teuthology.orchestra.run.trial031.stdout:ID_LIKE="rhel fedora" 2026-02-12T11:05:22.336 INFO:teuthology.orchestra.run.trial031.stdout:VERSION_ID="9" 2026-02-12T11:05:22.336 INFO:teuthology.orchestra.run.trial031.stdout:PLATFORM_ID="platform:el9" 2026-02-12T11:05:22.337 INFO:teuthology.orchestra.run.trial031.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T11:05:22.337 INFO:teuthology.orchestra.run.trial031.stdout:ANSI_COLOR="0;31" 2026-02-12T11:05:22.337 INFO:teuthology.orchestra.run.trial031.stdout:LOGO="fedora-logo-icon" 2026-02-12T11:05:22.337 INFO:teuthology.orchestra.run.trial031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T11:05:22.337 INFO:teuthology.orchestra.run.trial031.stdout:HOME_URL="https://centos.org/" 2026-02-12T11:05:22.337 INFO:teuthology.orchestra.run.trial031.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T11:05:22.337 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T11:05:22.337 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T11:05:22.338 INFO:teuthology.lock.ops:Updating trial031.front.sepia.ceph.com on lock server 2026-02-12T11:05:22.441 INFO:teuthology.lock.ops:Updating [trial069.front.sepia.ceph.com]: set os type and version on server 2026-02-12T11:05:22.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial069.front.sepia.ceph.com' 2026-02-12T11:05:22.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T11:05:22.511 DEBUG:teuthology.orchestra.run.trial069:> true 2026-02-12T11:05:22.586 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial069.front.sepia.ceph.com' 2026-02-12T11:05:22.586 DEBUG:teuthology.orchestra.run.trial069:> uname -m 2026-02-12T11:05:22.642 INFO:teuthology.orchestra.run.trial069.stdout:x86_64 2026-02-12T11:05:22.643 DEBUG:teuthology.orchestra.run.trial069:> cat /etc/os-release 2026-02-12T11:05:22.699 INFO:teuthology.orchestra.run.trial069.stdout:NAME="CentOS Stream" 2026-02-12T11:05:22.699 INFO:teuthology.orchestra.run.trial069.stdout:VERSION="9" 2026-02-12T11:05:22.699 INFO:teuthology.orchestra.run.trial069.stdout:ID="centos" 2026-02-12T11:05:22.699 INFO:teuthology.orchestra.run.trial069.stdout:ID_LIKE="rhel fedora" 2026-02-12T11:05:22.699 INFO:teuthology.orchestra.run.trial069.stdout:VERSION_ID="9" 2026-02-12T11:05:22.699 INFO:teuthology.orchestra.run.trial069.stdout:PLATFORM_ID="platform:el9" 2026-02-12T11:05:22.699 INFO:teuthology.orchestra.run.trial069.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T11:05:22.699 INFO:teuthology.orchestra.run.trial069.stdout:ANSI_COLOR="0;31" 2026-02-12T11:05:22.700 INFO:teuthology.orchestra.run.trial069.stdout:LOGO="fedora-logo-icon" 2026-02-12T11:05:22.700 INFO:teuthology.orchestra.run.trial069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T11:05:22.700 INFO:teuthology.orchestra.run.trial069.stdout:HOME_URL="https://centos.org/" 2026-02-12T11:05:22.700 INFO:teuthology.orchestra.run.trial069.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T11:05:22.700 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T11:05:22.700 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T11:05:22.701 INFO:teuthology.lock.ops:Updating trial069.front.sepia.ceph.com on lock server 2026-02-12T11:05:22.805 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:05:22.916 INFO:teuthology.dispatcher.supervisor:Running job 46140 2026-02-12T11:05:22.916 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/bin/teuthology -v --owner scheduled_amathuri@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/amathuri-2026-02-12_10:22:28-crimson-rados:thrash-wip-amat-fix-74504-distro-debug-trial/46140 --name amathuri-2026-02-12_10:22:28-crimson-rados:thrash-wip-amat-fix-74504-distro-debug-trial --description crimson-rados:thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/crimson_bluestore thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects-balanced} -- /home/teuthworker/mnt/teuthology/amathuri-2026-02-12_10:22:28-crimson-rados:thrash-wip-amat-fix-74504-distro-debug-trial/46140/orig.config.yaml 2026-02-12T11:05:22.916 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/amathuri-2026-02-12_10:22:28-crimson-rados:thrash-wip-amat-fix-74504-distro-debug-trial/46140 2026-02-12T11:05:22.916 INFO:teuthology.dispatcher.supervisor:Job PID: 3729110 2026-02-12T11:05:22.916 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-12T11:07:22.963 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:09:23.123 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:11:23.279 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:13:23.421 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:15:23.563 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:17:23.737 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:19:23.937 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:21:24.136 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:23:24.365 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:25:24.565 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:27:24.771 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:29:24.981 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:31:25.170 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:33:25.398 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:35:25.615 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:37:25.842 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:39:26.037 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:41:26.209 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:41:26.298 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-12T11:41:26.414 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-12T11:41:26.907 INFO:teuthology.orchestra.console.trial031:Power off 2026-02-12T11:41:26.907 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T11:41:26.926 INFO:teuthology.orchestra.console.trial069:Power off 2026-02-12T11:41:26.926 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T11:41:26.946 DEBUG:teuthology.orchestra.console.trial031:power off output: Chassis Power Control: Down/Off 2026-02-12T11:41:26.964 DEBUG:teuthology.orchestra.console.trial069:power off output: Chassis Power Control: Down/Off 2026-02-12T11:41:30.951 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T11:41:30.965 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T11:41:31.059 DEBUG:teuthology.orchestra.console.trial031:check power output: Chassis Power is on 2026-02-12T11:41:31.073 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is on 2026-02-12T11:41:35.065 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T11:41:35.074 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T11:41:35.175 DEBUG:teuthology.orchestra.console.trial031:check power output: Chassis Power is off 2026-02-12T11:41:35.175 INFO:teuthology.orchestra.console.trial031:Power off completed 2026-02-12T11:41:35.184 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is off 2026-02-12T11:41:35.184 INFO:teuthology.orchestra.console.trial069:Power off completed 2026-02-12T11:41:35.418 INFO:teuthology.lock.ops:unlocked: trial031.front.sepia.ceph.com 2026-02-12T11:41:35.430 INFO:teuthology.lock.ops:unlocked: trial069.front.sepia.ceph.com