2026-02-12T11:04:25.278 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71
2026-02-12T11:04:25.278 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:04:25.357 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:04:25.547 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x705d19e4bcb0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x705d19684ea0>, signals=[15])
2026-02-12T11:04:25.547 INFO:teuthology.lock.ops:Start node 'trial092.front.sepia.ceph.com' reimaging
2026-02-12T11:04:25.547 INFO:teuthology.lock.ops:Updating [trial092.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T11:04:25.547 INFO:teuthology.lock.ops:Updating trial092.front.sepia.ceph.com on lock server
2026-02-12T11:04:25.604 INFO:teuthology.lock.ops:Start node 'trial106.front.sepia.ceph.com' reimaging
2026-02-12T11:04:25.605 INFO:teuthology.lock.ops:Updating [trial106.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T11:04:25.605 INFO:teuthology.lock.ops:Updating trial106.front.sepia.ceph.com on lock server
2026-02-12T11:04:25.806 DEBUG:teuthology.provision.fog.trial092:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T11:04:25.814 DEBUG:teuthology.provision.fog.trial106:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T11:04:25.835 INFO:teuthology.provision.fog.trial106:Scheduling deploy of centos 9.stream
2026-02-12T11:04:25.857 INFO:teuthology.provision.fog.trial092:Scheduling deploy of centos 9.stream
2026-02-12T11:04:26.973 INFO:teuthology.orchestra.console.trial092:Power off
2026-02-12T11:04:26.973 DEBUG:teuthology.orchestra.console.trial092:pexpect command: ipmitool -H trial092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T11:04:26.992 INFO:teuthology.orchestra.console.trial106:Power off
2026-02-12T11:04:26.992 DEBUG:teuthology.orchestra.console.trial106:pexpect command: ipmitool -H trial106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T11:04:27.011 DEBUG:teuthology.orchestra.console.trial092:power off output: Chassis Power Control: Down/Off
2026-02-12T11:04:27.029 DEBUG:teuthology.orchestra.console.trial106:power off output: Chassis Power Control: Down/Off
2026-02-12T11:04:31.016 DEBUG:teuthology.orchestra.console.trial092:pexpect command: ipmitool -H trial092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:04:31.029 DEBUG:teuthology.orchestra.console.trial106:pexpect command: ipmitool -H trial106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:04:31.123 DEBUG:teuthology.orchestra.console.trial092:check power output: Chassis Power is off
2026-02-12T11:04:31.124 INFO:teuthology.orchestra.console.trial092:Power off completed
2026-02-12T11:04:31.137 DEBUG:teuthology.orchestra.console.trial106:check power output: Chassis Power is off
2026-02-12T11:04:31.137 INFO:teuthology.orchestra.console.trial106:Power off completed
2026-02-12T11:04:31.224 INFO:teuthology.orchestra.console.trial092:Power on
2026-02-12T11:04:31.225 DEBUG:teuthology.orchestra.console.trial092:pexpect command: ipmitool -H trial092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T11:04:31.238 INFO:teuthology.orchestra.console.trial106:Power on
2026-02-12T11:04:31.238 DEBUG:teuthology.orchestra.console.trial106:pexpect command: ipmitool -H trial106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T11:04:31.264 DEBUG:teuthology.orchestra.console.trial092:power on output: Chassis Power Control: Up/On
2026-02-12T11:04:31.289 DEBUG:teuthology.orchestra.console.trial106:power on output: Chassis Power Control: Up/On
2026-02-12T11:04:35.268 DEBUG:teuthology.orchestra.console.trial092:pexpect command: ipmitool -H trial092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:04:35.290 DEBUG:teuthology.orchestra.console.trial106:pexpect command: ipmitool -H trial106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:04:35.378 DEBUG:teuthology.orchestra.console.trial092:check power output: Chassis Power is on
2026-02-12T11:04:35.378 INFO:teuthology.orchestra.console.trial092:Power on completed
2026-02-12T11:04:35.398 DEBUG:teuthology.orchestra.console.trial106:check power output: Chassis Power is on
2026-02-12T11:04:35.398 INFO:teuthology.orchestra.console.trial106:Power on completed
2026-02-12T11:04:35.480 INFO:teuthology.provision.fog.trial092:Waiting for deploy to finish
2026-02-12T11:04:35.499 INFO:teuthology.provision.fog.trial106:Waiting for deploy to finish
2026-02-12T11:06:22.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:06:22.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:06:25.885 WARNING:teuthology.provision.fog.trial106:[Errno None] Unable to connect to port 22 on 10.20.193.106
2026-02-12T11:06:25.949 WARNING:teuthology.provision.fog.trial092:[Errno None] Unable to connect to port 22 on 10.20.193.92
2026-02-12T11:06:31.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:06:31.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:06:34.973 WARNING:teuthology.provision.fog.trial106:[Errno None] Unable to connect to port 22 on 10.20.193.106
2026-02-12T11:06:35.037 WARNING:teuthology.provision.fog.trial092:[Errno None] Unable to connect to port 22 on 10.20.193.92
2026-02-12T11:06:40.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:06:41.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:06:44.061 WARNING:teuthology.provision.fog.trial106:[Errno None] Unable to connect to port 22 on 10.20.193.106
2026-02-12T11:06:44.125 WARNING:teuthology.provision.fog.trial092:[Errno None] Unable to connect to port 22 on 10.20.193.92
2026-02-12T11:06:50.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:06:50.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:06:53.149 WARNING:teuthology.provision.fog.trial106:[Errno None] Unable to connect to port 22 on 10.20.193.106
2026-02-12T11:06:53.213 WARNING:teuthology.provision.fog.trial092:[Errno None] Unable to connect to port 22 on 10.20.193.92
2026-02-12T11:06:59.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:06:59.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:07:35.117 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T11:07:35.117 DEBUG:teuthology.orchestra.run.trial106:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T11:07:35.119 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T11:07:35.119 DEBUG:teuthology.orchestra.run.trial092:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T11:07:35.329 INFO:teuthology.provision.fog.trial092:Node is ready
2026-02-12T11:07:35.329 DEBUG:teuthology.orchestra.run.trial092:> hostname
2026-02-12T11:07:35.372 INFO:teuthology.provision.fog.trial106:Node is ready
2026-02-12T11:07:35.373 DEBUG:teuthology.orchestra.run.trial106:> hostname
2026-02-12T11:07:35.384 INFO:teuthology.orchestra.run.trial092.stdout:trial092.front.sepia.ceph.com
2026-02-12T11:07:35.384 DEBUG:teuthology.orchestra.run.trial092:> grep trial092.front.sepia.ceph.com /etc/hosts
2026-02-12T11:07:35.429 INFO:teuthology.orchestra.run.trial106.stdout:trial106.front.sepia.ceph.com
2026-02-12T11:07:35.429 DEBUG:teuthology.orchestra.run.trial106:> grep trial106.front.sepia.ceph.com /etc/hosts
2026-02-12T11:07:35.440 INFO:teuthology.orchestra.run.trial092.stdout:10.20.193.92 trial092.front.sepia.ceph.com trial092
2026-02-12T11:07:35.441 DEBUG:teuthology.orchestra.run.trial092:> sudo hostname trial092
2026-02-12T11:07:35.485 INFO:teuthology.orchestra.run.trial106.stdout:10.20.193.106 trial106.front.sepia.ceph.com trial106
2026-02-12T11:07:35.486 DEBUG:teuthology.orchestra.run.trial106:> sudo hostname trial106
2026-02-12T11:07:35.510 DEBUG:teuthology.orchestra.run.trial092:> sudo sed -i -e 's/trial092.front.sepia.ceph.com/trial092/g' /etc/hosts
2026-02-12T11:07:35.555 DEBUG:teuthology.orchestra.run.trial106:> sudo sed -i -e 's/trial106.front.sepia.ceph.com/trial106/g' /etc/hosts
2026-02-12T11:07:35.596 DEBUG:teuthology.orchestra.run.trial092:> sudo sed -i -e 's/10.20.193.92/10.20.193.92/g' /etc/hosts
2026-02-12T11:07:35.620 DEBUG:teuthology.orchestra.run.trial106:> sudo sed -i -e 's/10.20.193.106/10.20.193.106/g' /etc/hosts
2026-02-12T11:07:35.685 DEBUG:teuthology.orchestra.run.trial106:> sudo sed -i -e 's/trial106.front.sepia.ceph.com/trial106/g' /etc/hostname
2026-02-12T11:07:35.726 DEBUG:teuthology.orchestra.run.trial092:> sudo sed -i -e 's/trial092.front.sepia.ceph.com/trial092/g' /etc/hostname
2026-02-12T11:07:35.751 DEBUG:teuthology.orchestra.run.trial106:> sudo hostname trial106
2026-02-12T11:07:35.752 DEBUG:teuthology.orchestra.run.trial092:> sudo hostname trial092
2026-02-12T11:07:35.816 DEBUG:teuthology.orchestra.run.trial106:> cat /etc/os-release
2026-02-12T11:07:35.817 DEBUG:teuthology.orchestra.run.trial092:> cat /etc/os-release
2026-02-12T11:07:35.873 INFO:teuthology.orchestra.run.trial106.stdout:NAME="CentOS Stream"
2026-02-12T11:07:35.873 INFO:teuthology.orchestra.run.trial106.stdout:VERSION="9"
2026-02-12T11:07:35.873 INFO:teuthology.orchestra.run.trial106.stdout:ID="centos"
2026-02-12T11:07:35.873 INFO:teuthology.orchestra.run.trial106.stdout:ID_LIKE="rhel fedora"
2026-02-12T11:07:35.874 INFO:teuthology.orchestra.run.trial106.stdout:VERSION_ID="9"
2026-02-12T11:07:35.874 INFO:teuthology.orchestra.run.trial106.stdout:PLATFORM_ID="platform:el9"
2026-02-12T11:07:35.874 INFO:teuthology.orchestra.run.trial106.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T11:07:35.874 INFO:teuthology.orchestra.run.trial106.stdout:ANSI_COLOR="0;31"
2026-02-12T11:07:35.874 INFO:teuthology.orchestra.run.trial106.stdout:LOGO="fedora-logo-icon"
2026-02-12T11:07:35.874 INFO:teuthology.orchestra.run.trial106.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T11:07:35.874 INFO:teuthology.orchestra.run.trial106.stdout:HOME_URL="https://centos.org/"
2026-02-12T11:07:35.874 INFO:teuthology.orchestra.run.trial106.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T11:07:35.874 INFO:teuthology.orchestra.run.trial106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T11:07:35.874 INFO:teuthology.orchestra.run.trial106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T11:07:35.875 INFO:teuthology.provision.fog.trial106:Deploy complete!
2026-02-12T11:07:35.877 DEBUG:teuthology.parallel:result is None
2026-02-12T11:07:35.878 INFO:teuthology.orchestra.run.trial092.stdout:NAME="CentOS Stream"
2026-02-12T11:07:35.878 INFO:teuthology.orchestra.run.trial092.stdout:VERSION="9"
2026-02-12T11:07:35.878 INFO:teuthology.orchestra.run.trial092.stdout:ID="centos"
2026-02-12T11:07:35.878 INFO:teuthology.orchestra.run.trial092.stdout:ID_LIKE="rhel fedora"
2026-02-12T11:07:35.878 INFO:teuthology.orchestra.run.trial092.stdout:VERSION_ID="9"
2026-02-12T11:07:35.878 INFO:teuthology.orchestra.run.trial092.stdout:PLATFORM_ID="platform:el9"
2026-02-12T11:07:35.879 INFO:teuthology.orchestra.run.trial092.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T11:07:35.879 INFO:teuthology.orchestra.run.trial092.stdout:ANSI_COLOR="0;31"
2026-02-12T11:07:35.879 INFO:teuthology.orchestra.run.trial092.stdout:LOGO="fedora-logo-icon"
2026-02-12T11:07:35.879 INFO:teuthology.orchestra.run.trial092.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T11:07:35.879 INFO:teuthology.orchestra.run.trial092.stdout:HOME_URL="https://centos.org/"
2026-02-12T11:07:35.879 INFO:teuthology.orchestra.run.trial092.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T11:07:35.879 INFO:teuthology.orchestra.run.trial092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T11:07:35.879 INFO:teuthology.orchestra.run.trial092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T11:07:35.880 INFO:teuthology.provision.fog.trial092:Deploy complete!
2026-02-12T11:07:35.880 DEBUG:teuthology.parallel:result is None
2026-02-12T11:07:36.293 INFO:teuthology.lock.ops:Checking trial092.front.sepia.ceph.com
2026-02-12T11:07:36.293 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T11:07:36.395 INFO:teuthology.lock.ops:Checking trial106.front.sepia.ceph.com
2026-02-12T11:07:36.395 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T11:07:36.457 INFO:teuthology.lock.ops:Updating [trial092.front.sepia.ceph.com]: set os type and version on server
2026-02-12T11:07:36.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com'
2026-02-12T11:07:36.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:07:36.519 DEBUG:teuthology.orchestra.run.trial092:> true
2026-02-12T11:07:36.594 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com'
2026-02-12T11:07:36.594 DEBUG:teuthology.orchestra.run.trial092:> uname -m
2026-02-12T11:07:36.651 INFO:teuthology.orchestra.run.trial092.stdout:x86_64
2026-02-12T11:07:36.651 DEBUG:teuthology.orchestra.run.trial092:> cat /etc/os-release
2026-02-12T11:07:36.707 INFO:teuthology.orchestra.run.trial092.stdout:NAME="CentOS Stream"
2026-02-12T11:07:36.708 INFO:teuthology.orchestra.run.trial092.stdout:VERSION="9"
2026-02-12T11:07:36.708 INFO:teuthology.orchestra.run.trial092.stdout:ID="centos"
2026-02-12T11:07:36.708 INFO:teuthology.orchestra.run.trial092.stdout:ID_LIKE="rhel fedora"
2026-02-12T11:07:36.708 INFO:teuthology.orchestra.run.trial092.stdout:VERSION_ID="9"
2026-02-12T11:07:36.708 INFO:teuthology.orchestra.run.trial092.stdout:PLATFORM_ID="platform:el9"
2026-02-12T11:07:36.708 INFO:teuthology.orchestra.run.trial092.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T11:07:36.708 INFO:teuthology.orchestra.run.trial092.stdout:ANSI_COLOR="0;31"
2026-02-12T11:07:36.708 INFO:teuthology.orchestra.run.trial092.stdout:LOGO="fedora-logo-icon"
2026-02-12T11:07:36.708 INFO:teuthology.orchestra.run.trial092.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T11:07:36.709 INFO:teuthology.orchestra.run.trial092.stdout:HOME_URL="https://centos.org/"
2026-02-12T11:07:36.709 INFO:teuthology.orchestra.run.trial092.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T11:07:36.709 INFO:teuthology.orchestra.run.trial092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T11:07:36.709 INFO:teuthology.orchestra.run.trial092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T11:07:36.709 INFO:teuthology.lock.ops:Updating trial092.front.sepia.ceph.com on lock server
2026-02-12T11:07:36.811 INFO:teuthology.lock.ops:Updating [trial106.front.sepia.ceph.com]: set os type and version on server
2026-02-12T11:07:36.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial106.front.sepia.ceph.com'
2026-02-12T11:07:36.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:07:36.880 DEBUG:teuthology.orchestra.run.trial106:> true
2026-02-12T11:07:36.963 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial106.front.sepia.ceph.com'
2026-02-12T11:07:36.963 DEBUG:teuthology.orchestra.run.trial106:> uname -m
2026-02-12T11:07:37.019 INFO:teuthology.orchestra.run.trial106.stdout:x86_64
2026-02-12T11:07:37.020 DEBUG:teuthology.orchestra.run.trial106:> cat /etc/os-release
2026-02-12T11:07:37.076 INFO:teuthology.orchestra.run.trial106.stdout:NAME="CentOS Stream"
2026-02-12T11:07:37.076 INFO:teuthology.orchestra.run.trial106.stdout:VERSION="9"
2026-02-12T11:07:37.076 INFO:teuthology.orchestra.run.trial106.stdout:ID="centos"
2026-02-12T11:07:37.077 INFO:teuthology.orchestra.run.trial106.stdout:ID_LIKE="rhel fedora"
2026-02-12T11:07:37.077 INFO:teuthology.orchestra.run.trial106.stdout:VERSION_ID="9"
2026-02-12T11:07:37.077 INFO:teuthology.orchestra.run.trial106.stdout:PLATFORM_ID="platform:el9"
2026-02-12T11:07:37.077 INFO:teuthology.orchestra.run.trial106.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T11:07:37.077 INFO:teuthology.orchestra.run.trial106.stdout:ANSI_COLOR="0;31"
2026-02-12T11:07:37.077 INFO:teuthology.orchestra.run.trial106.stdout:LOGO="fedora-logo-icon"
2026-02-12T11:07:37.077 INFO:teuthology.orchestra.run.trial106.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T11:07:37.077 INFO:teuthology.orchestra.run.trial106.stdout:HOME_URL="https://centos.org/"
2026-02-12T11:07:37.078 INFO:teuthology.orchestra.run.trial106.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T11:07:37.078 INFO:teuthology.orchestra.run.trial106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T11:07:37.078 INFO:teuthology.orchestra.run.trial106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T11:07:37.079 INFO:teuthology.lock.ops:Updating trial106.front.sepia.ceph.com on lock server
2026-02-12T11:07:37.190 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:07:37.288 INFO:teuthology.dispatcher.supervisor:Running job 46155
2026-02-12T11:07:37.288 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/bin/teuthology -v --owner scheduled_amathuri@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/amathuri-2026-02-12_10:22:28-crimson-rados:thrash-wip-amat-fix-74504-distro-debug-trial/46155 --name amathuri-2026-02-12_10:22:28-crimson-rados:thrash-wip-amat-fix-74504-distro-debug-trial --description crimson-rados:thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{pggrow} thrashosds-health workloads/radosbench} -- /home/teuthworker/mnt/teuthology/amathuri-2026-02-12_10:22:28-crimson-rados:thrash-wip-amat-fix-74504-distro-debug-trial/46155/orig.config.yaml
2026-02-12T11:07:37.289 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/amathuri-2026-02-12_10:22:28-crimson-rados:thrash-wip-amat-fix-74504-distro-debug-trial/46155
2026-02-12T11:07:37.289 INFO:teuthology.dispatcher.supervisor:Job PID: 3739967
2026-02-12T11:07:37.289 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T11:09:37.389 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:11:37.581 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:13:37.775 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:15:37.948 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:17:38.145 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:19:38.318 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:21:38.464 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:23:38.612 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:25:38.757 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:27:38.963 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:29:39.090 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:31:39.188 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:33:39.340 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:35:39.501 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:37:39.621 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:39:39.921 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:41:40.141 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:43:40.300 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:45:40.505 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:47:40.729 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:49:40.884 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:51:40.983 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:53:41.186 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:55:41.341 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:57:41.543 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:59:41.636 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:01:41.840 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:03:42.039 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:05:42.226 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:07:42.413 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:09:42.563 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:11:42.705 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:13:42.888 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:15:43.092 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:17:43.305 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:17:43.396 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-12T12:17:43.509 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T12:17:43.987 INFO:teuthology.orchestra.console.trial092:Power off
2026-02-12T12:17:43.987 DEBUG:teuthology.orchestra.console.trial092:pexpect command: ipmitool -H trial092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T12:17:44.006 INFO:teuthology.orchestra.console.trial106:Power off
2026-02-12T12:17:44.006 DEBUG:teuthology.orchestra.console.trial106:pexpect command: ipmitool -H trial106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T12:17:44.029 DEBUG:teuthology.orchestra.console.trial092:power off output: Chassis Power Control: Down/Off
2026-02-12T12:17:44.044 DEBUG:teuthology.orchestra.console.trial106:power off output: Chassis Power Control: Down/Off
2026-02-12T12:17:48.034 DEBUG:teuthology.orchestra.console.trial092:pexpect command: ipmitool -H trial092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T12:17:48.044 DEBUG:teuthology.orchestra.console.trial106:pexpect command: ipmitool -H trial106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T12:17:48.143 DEBUG:teuthology.orchestra.console.trial092:check power output: Chassis Power is on
2026-02-12T12:17:48.152 DEBUG:teuthology.orchestra.console.trial106:check power output: Chassis Power is on
2026-02-12T12:17:52.148 DEBUG:teuthology.orchestra.console.trial092:pexpect command: ipmitool -H trial092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T12:17:52.157 DEBUG:teuthology.orchestra.console.trial106:pexpect command: ipmitool -H trial106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T12:17:52.259 DEBUG:teuthology.orchestra.console.trial092:check power output: Chassis Power is off
2026-02-12T12:17:52.259 INFO:teuthology.orchestra.console.trial092:Power off completed
2026-02-12T12:17:52.266 DEBUG:teuthology.orchestra.console.trial106:check power output: Chassis Power is off
2026-02-12T12:17:52.266 INFO:teuthology.orchestra.console.trial106:Power off completed
2026-02-12T12:17:52.504 INFO:teuthology.lock.ops:unlocked: trial092.front.sepia.ceph.com
2026-02-12T12:17:52.525 INFO:teuthology.lock.ops:unlocked: trial106.front.sepia.ceph.com