2026-02-12T11:01:36.257 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71
2026-02-12T11:01:36.257 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:01:36.330 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:01:36.529 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x77308eb382c0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x77308ea8ccc0>, signals=[15])
2026-02-12T11:01:36.530 INFO:teuthology.lock.ops:Start node 'trial110.front.sepia.ceph.com' reimaging
2026-02-12T11:01:36.530 INFO:teuthology.lock.ops:Updating [trial110.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T11:01:36.530 INFO:teuthology.lock.ops:Updating trial110.front.sepia.ceph.com on lock server
2026-02-12T11:01:36.589 INFO:teuthology.lock.ops:Start node 'trial112.front.sepia.ceph.com' reimaging
2026-02-12T11:01:36.589 INFO:teuthology.lock.ops:Updating [trial112.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T11:01:36.589 INFO:teuthology.lock.ops:Updating trial112.front.sepia.ceph.com on lock server
2026-02-12T11:01:36.819 DEBUG:teuthology.provision.fog.trial112:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T11:01:36.828 DEBUG:teuthology.provision.fog.trial110:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T11:01:36.858 INFO:teuthology.provision.fog.trial112:Scheduling deploy of centos 9.stream
2026-02-12T11:01:36.885 INFO:teuthology.provision.fog.trial110:Scheduling deploy of centos 9.stream
2026-02-12T11:01:37.993 INFO:teuthology.orchestra.console.trial112:Power off
2026-02-12T11:01:37.993 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T11:01:38.006 INFO:teuthology.orchestra.console.trial110:Power off
2026-02-12T11:01:38.007 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T11:01:38.037 DEBUG:teuthology.orchestra.console.trial112:power off output: Chassis Power Control: Down/Off
2026-02-12T11:01:38.048 DEBUG:teuthology.orchestra.console.trial110:power off output: Chassis Power Control: Down/Off
2026-02-12T11:01:42.042 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:01:42.049 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:01:42.151 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is off
2026-02-12T11:01:42.151 INFO:teuthology.orchestra.console.trial112:Power off completed
2026-02-12T11:01:42.158 DEBUG:teuthology.orchestra.console.trial110:check power output: Chassis Power is off
2026-02-12T11:01:42.158 INFO:teuthology.orchestra.console.trial110:Power off completed
2026-02-12T11:01:42.252 INFO:teuthology.orchestra.console.trial112:Power on
2026-02-12T11:01:42.252 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T11:01:42.261 INFO:teuthology.orchestra.console.trial110:Power on
2026-02-12T11:01:42.262 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T11:01:42.301 DEBUG:teuthology.orchestra.console.trial112:power on output: Chassis Power Control: Up/On
2026-02-12T11:01:42.303 DEBUG:teuthology.orchestra.console.trial110:power on output: Chassis Power Control: Up/On
2026-02-12T11:01:46.305 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:01:46.313 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:01:46.415 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is on
2026-02-12T11:01:46.416 INFO:teuthology.orchestra.console.trial112:Power on completed
2026-02-12T11:01:46.423 DEBUG:teuthology.orchestra.console.trial110:check power output: Chassis Power is off
2026-02-12T11:01:46.517 INFO:teuthology.provision.fog.trial112:Waiting for deploy to finish
2026-02-12T11:01:50.428 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:01:50.537 DEBUG:teuthology.orchestra.console.trial110:check power output: Chassis Power is on
2026-02-12T11:01:50.538 INFO:teuthology.orchestra.console.trial110:Power on completed
2026-02-12T11:01:50.639 INFO:teuthology.provision.fog.trial110:Waiting for deploy to finish
2026-02-12T11:03:33.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:03:36.925 WARNING:teuthology.provision.fog.trial112:[Errno None] Unable to connect to port 22 on 10.20.193.112
2026-02-12T11:03:38.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:03:41.085 WARNING:teuthology.provision.fog.trial110:[Errno None] Unable to connect to port 22 on 10.20.193.110
2026-02-12T11:03:42.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:03:46.013 WARNING:teuthology.provision.fog.trial112:[Errno None] Unable to connect to port 22 on 10.20.193.112
2026-02-12T11:03:47.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:03:50.173 WARNING:teuthology.provision.fog.trial110:[Errno None] Unable to connect to port 22 on 10.20.193.110
2026-02-12T11:03:52.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:03:55.101 WARNING:teuthology.provision.fog.trial112:[Errno None] Unable to connect to port 22 on 10.20.193.112
2026-02-12T11:03:56.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:03:59.261 WARNING:teuthology.provision.fog.trial110:[Errno None] Unable to connect to port 22 on 10.20.193.110
2026-02-12T11:04:01.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:04:04.189 WARNING:teuthology.provision.fog.trial112:[Errno None] Unable to connect to port 22 on 10.20.193.112
2026-02-12T11:04:05.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:04:08.349 WARNING:teuthology.provision.fog.trial110:[Errno None] Unable to connect to port 22 on 10.20.193.110
2026-02-12T11:04:10.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:04:14.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:04:46.113 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T11:04:46.114 DEBUG:teuthology.orchestra.run.trial112:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T11:04:46.547 INFO:teuthology.provision.fog.trial112:Node is ready
2026-02-12T11:04:46.548 DEBUG:teuthology.orchestra.run.trial112:> hostname
2026-02-12T11:04:46.601 INFO:teuthology.orchestra.run.trial112.stdout:trial112.front.sepia.ceph.com
2026-02-12T11:04:46.601 DEBUG:teuthology.orchestra.run.trial112:> grep trial112.front.sepia.ceph.com /etc/hosts
2026-02-12T11:04:46.655 INFO:teuthology.orchestra.run.trial112.stdout:10.20.193.112 trial112.front.sepia.ceph.com trial112
2026-02-12T11:04:46.656 DEBUG:teuthology.orchestra.run.trial112:> sudo hostname trial112
2026-02-12T11:04:46.723 DEBUG:teuthology.orchestra.run.trial112:> sudo sed -i -e 's/trial112.front.sepia.ceph.com/trial112/g' /etc/hosts
2026-02-12T11:04:46.785 DEBUG:teuthology.orchestra.run.trial112:> sudo sed -i -e 's/10.20.193.112/10.20.193.112/g' /etc/hosts
2026-02-12T11:04:46.846 DEBUG:teuthology.orchestra.run.trial112:> sudo sed -i -e 's/trial112.front.sepia.ceph.com/trial112/g' /etc/hostname
2026-02-12T11:04:46.908 DEBUG:teuthology.orchestra.run.trial112:> sudo hostname trial112
2026-02-12T11:04:46.971 DEBUG:teuthology.orchestra.run.trial112:> cat /etc/os-release
2026-02-12T11:04:47.024 INFO:teuthology.orchestra.run.trial112.stdout:NAME="CentOS Stream"
2026-02-12T11:04:47.024 INFO:teuthology.orchestra.run.trial112.stdout:VERSION="9"
2026-02-12T11:04:47.024 INFO:teuthology.orchestra.run.trial112.stdout:ID="centos"
2026-02-12T11:04:47.024 INFO:teuthology.orchestra.run.trial112.stdout:ID_LIKE="rhel fedora"
2026-02-12T11:04:47.024 INFO:teuthology.orchestra.run.trial112.stdout:VERSION_ID="9"
2026-02-12T11:04:47.024 INFO:teuthology.orchestra.run.trial112.stdout:PLATFORM_ID="platform:el9"
2026-02-12T11:04:47.024 INFO:teuthology.orchestra.run.trial112.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T11:04:47.025 INFO:teuthology.orchestra.run.trial112.stdout:ANSI_COLOR="0;31"
2026-02-12T11:04:47.025 INFO:teuthology.orchestra.run.trial112.stdout:LOGO="fedora-logo-icon"
2026-02-12T11:04:47.025 INFO:teuthology.orchestra.run.trial112.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T11:04:47.025 INFO:teuthology.orchestra.run.trial112.stdout:HOME_URL="https://centos.org/"
2026-02-12T11:04:47.025 INFO:teuthology.orchestra.run.trial112.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T11:04:47.025 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T11:04:47.025 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T11:04:47.026 INFO:teuthology.provision.fog.trial112:Deploy complete!
2026-02-12T11:04:47.027 DEBUG:teuthology.parallel:result is None
2026-02-12T11:04:50.211 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T11:04:50.211 DEBUG:teuthology.orchestra.run.trial110:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T11:04:50.409 INFO:teuthology.provision.fog.trial110:Node is ready
2026-02-12T11:04:50.410 DEBUG:teuthology.orchestra.run.trial110:> hostname
2026-02-12T11:04:50.466 INFO:teuthology.orchestra.run.trial110.stdout:trial110.front.sepia.ceph.com
2026-02-12T11:04:50.466 DEBUG:teuthology.orchestra.run.trial110:> grep trial110.front.sepia.ceph.com /etc/hosts
2026-02-12T11:04:50.523 INFO:teuthology.orchestra.run.trial110.stdout:10.20.193.110 trial110.front.sepia.ceph.com trial110
2026-02-12T11:04:50.523 DEBUG:teuthology.orchestra.run.trial110:> sudo hostname trial110
2026-02-12T11:04:50.593 DEBUG:teuthology.orchestra.run.trial110:> sudo sed -i -e 's/trial110.front.sepia.ceph.com/trial110/g' /etc/hosts
2026-02-12T11:04:50.658 DEBUG:teuthology.orchestra.run.trial110:> sudo sed -i -e 's/10.20.193.110/10.20.193.110/g' /etc/hosts
2026-02-12T11:04:50.722 DEBUG:teuthology.orchestra.run.trial110:> sudo sed -i -e 's/trial110.front.sepia.ceph.com/trial110/g' /etc/hostname
2026-02-12T11:04:50.787 DEBUG:teuthology.orchestra.run.trial110:> sudo hostname trial110
2026-02-12T11:04:50.851 DEBUG:teuthology.orchestra.run.trial110:> cat /etc/os-release
2026-02-12T11:04:50.907 INFO:teuthology.orchestra.run.trial110.stdout:NAME="CentOS Stream"
2026-02-12T11:04:50.908 INFO:teuthology.orchestra.run.trial110.stdout:VERSION="9"
2026-02-12T11:04:50.908 INFO:teuthology.orchestra.run.trial110.stdout:ID="centos"
2026-02-12T11:04:50.908 INFO:teuthology.orchestra.run.trial110.stdout:ID_LIKE="rhel fedora"
2026-02-12T11:04:50.908 INFO:teuthology.orchestra.run.trial110.stdout:VERSION_ID="9"
2026-02-12T11:04:50.908 INFO:teuthology.orchestra.run.trial110.stdout:PLATFORM_ID="platform:el9"
2026-02-12T11:04:50.908 INFO:teuthology.orchestra.run.trial110.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T11:04:50.908 INFO:teuthology.orchestra.run.trial110.stdout:ANSI_COLOR="0;31"
2026-02-12T11:04:50.908 INFO:teuthology.orchestra.run.trial110.stdout:LOGO="fedora-logo-icon"
2026-02-12T11:04:50.908 INFO:teuthology.orchestra.run.trial110.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T11:04:50.908 INFO:teuthology.orchestra.run.trial110.stdout:HOME_URL="https://centos.org/"
2026-02-12T11:04:50.909 INFO:teuthology.orchestra.run.trial110.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T11:04:50.909 INFO:teuthology.orchestra.run.trial110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T11:04:50.909 INFO:teuthology.orchestra.run.trial110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T11:04:50.909 INFO:teuthology.provision.fog.trial110:Deploy complete!
2026-02-12T11:04:50.910 DEBUG:teuthology.parallel:result is None
2026-02-12T11:04:51.306 INFO:teuthology.lock.ops:Checking trial110.front.sepia.ceph.com
2026-02-12T11:04:51.306 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T11:04:51.403 INFO:teuthology.lock.ops:Checking trial112.front.sepia.ceph.com
2026-02-12T11:04:51.403 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T11:04:51.464 INFO:teuthology.lock.ops:Updating [trial110.front.sepia.ceph.com]: set os type and version on server
2026-02-12T11:04:51.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial110.front.sepia.ceph.com'
2026-02-12T11:04:51.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:04:51.526 DEBUG:teuthology.orchestra.run.trial110:> true
2026-02-12T11:04:51.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial110.front.sepia.ceph.com'
2026-02-12T11:04:51.598 DEBUG:teuthology.orchestra.run.trial110:> uname -m
2026-02-12T11:04:51.654 INFO:teuthology.orchestra.run.trial110.stdout:x86_64
2026-02-12T11:04:51.654 DEBUG:teuthology.orchestra.run.trial110:> cat /etc/os-release
2026-02-12T11:04:51.710 INFO:teuthology.orchestra.run.trial110.stdout:NAME="CentOS Stream"
2026-02-12T11:04:51.710 INFO:teuthology.orchestra.run.trial110.stdout:VERSION="9"
2026-02-12T11:04:51.710 INFO:teuthology.orchestra.run.trial110.stdout:ID="centos"
2026-02-12T11:04:51.710 INFO:teuthology.orchestra.run.trial110.stdout:ID_LIKE="rhel fedora"
2026-02-12T11:04:51.710 INFO:teuthology.orchestra.run.trial110.stdout:VERSION_ID="9"
2026-02-12T11:04:51.710 INFO:teuthology.orchestra.run.trial110.stdout:PLATFORM_ID="platform:el9"
2026-02-12T11:04:51.710 INFO:teuthology.orchestra.run.trial110.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T11:04:51.710 INFO:teuthology.orchestra.run.trial110.stdout:ANSI_COLOR="0;31"
2026-02-12T11:04:51.710 INFO:teuthology.orchestra.run.trial110.stdout:LOGO="fedora-logo-icon"
2026-02-12T11:04:51.710 INFO:teuthology.orchestra.run.trial110.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T11:04:51.710 INFO:teuthology.orchestra.run.trial110.stdout:HOME_URL="https://centos.org/"
2026-02-12T11:04:51.710 INFO:teuthology.orchestra.run.trial110.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T11:04:51.710 INFO:teuthology.orchestra.run.trial110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T11:04:51.710 INFO:teuthology.orchestra.run.trial110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T11:04:51.710 INFO:teuthology.lock.ops:Updating trial110.front.sepia.ceph.com on lock server
2026-02-12T11:04:51.797 INFO:teuthology.lock.ops:Updating [trial112.front.sepia.ceph.com]: set os type and version on server
2026-02-12T11:04:51.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com'
2026-02-12T11:04:51.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:04:51.863 DEBUG:teuthology.orchestra.run.trial112:> true
2026-02-12T11:04:51.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com'
2026-02-12T11:04:51.949 DEBUG:teuthology.orchestra.run.trial112:> uname -m
2026-02-12T11:04:52.005 INFO:teuthology.orchestra.run.trial112.stdout:x86_64
2026-02-12T11:04:52.005 DEBUG:teuthology.orchestra.run.trial112:> cat /etc/os-release
2026-02-12T11:04:52.062 INFO:teuthology.orchestra.run.trial112.stdout:NAME="CentOS Stream"
2026-02-12T11:04:52.062 INFO:teuthology.orchestra.run.trial112.stdout:VERSION="9"
2026-02-12T11:04:52.062 INFO:teuthology.orchestra.run.trial112.stdout:ID="centos"
2026-02-12T11:04:52.062 INFO:teuthology.orchestra.run.trial112.stdout:ID_LIKE="rhel fedora"
2026-02-12T11:04:52.062 INFO:teuthology.orchestra.run.trial112.stdout:VERSION_ID="9"
2026-02-12T11:04:52.062 INFO:teuthology.orchestra.run.trial112.stdout:PLATFORM_ID="platform:el9"
2026-02-12T11:04:52.062 INFO:teuthology.orchestra.run.trial112.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T11:04:52.062 INFO:teuthology.orchestra.run.trial112.stdout:ANSI_COLOR="0;31"
2026-02-12T11:04:52.063 INFO:teuthology.orchestra.run.trial112.stdout:LOGO="fedora-logo-icon"
2026-02-12T11:04:52.063 INFO:teuthology.orchestra.run.trial112.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T11:04:52.063 INFO:teuthology.orchestra.run.trial112.stdout:HOME_URL="https://centos.org/"
2026-02-12T11:04:52.063 INFO:teuthology.orchestra.run.trial112.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T11:04:52.063 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T11:04:52.063 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T11:04:52.064 INFO:teuthology.lock.ops:Updating trial112.front.sepia.ceph.com on lock server
2026-02-12T11:04:52.167 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:04:52.263 INFO:teuthology.dispatcher.supervisor:Running job 46139
2026-02-12T11:04:52.263 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/bin/teuthology -v --owner scheduled_amathuri@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/amathuri-2026-02-12_10:22:28-crimson-rados:thrash-wip-amat-fix-74504-distro-debug-trial/46139 --name amathuri-2026-02-12_10:22:28-crimson-rados:thrash-wip-amat-fix-74504-distro-debug-trial --description crimson-rados:thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{pggrow} thrashosds-health workloads/small-objects-localized} -- /home/teuthworker/mnt/teuthology/amathuri-2026-02-12_10:22:28-crimson-rados:thrash-wip-amat-fix-74504-distro-debug-trial/46139/orig.config.yaml
2026-02-12T11:04:52.263 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/amathuri-2026-02-12_10:22:28-crimson-rados:thrash-wip-amat-fix-74504-distro-debug-trial/46139
2026-02-12T11:04:52.263 INFO:teuthology.dispatcher.supervisor:Job PID: 3728457
2026-02-12T11:04:52.263 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T11:06:52.364 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:08:52.562 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:10:52.761 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:12:52.904 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:14:53.082 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:16:53.285 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:18:53.418 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:20:53.629 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:22:53.833 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:24:54.053 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:26:54.275 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:28:54.477 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:30:54.660 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:30:54.743 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-12T11:30:54.859 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T11:30:55.377 INFO:teuthology.orchestra.console.trial110:Power off
2026-02-12T11:30:55.377 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T11:30:55.395 INFO:teuthology.orchestra.console.trial112:Power off
2026-02-12T11:30:55.395 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T11:30:55.416 DEBUG:teuthology.orchestra.console.trial110:power off output: Chassis Power Control: Down/Off
2026-02-12T11:30:55.433 DEBUG:teuthology.orchestra.console.trial112:power off output: Chassis Power Control: Down/Off
2026-02-12T11:30:59.420 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:30:59.433 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:30:59.528 DEBUG:teuthology.orchestra.console.trial110:check power output: Chassis Power is on
2026-02-12T11:30:59.541 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is on
2026-02-12T11:31:03.534 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:31:03.543 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:31:03.644 DEBUG:teuthology.orchestra.console.trial110:check power output: Chassis Power is off
2026-02-12T11:31:03.644 INFO:teuthology.orchestra.console.trial110:Power off completed
2026-02-12T11:31:03.653 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is off
2026-02-12T11:31:03.653 INFO:teuthology.orchestra.console.trial112:Power off completed
2026-02-12T11:31:03.894 INFO:teuthology.lock.ops:unlocked: trial110.front.sepia.ceph.com
2026-02-12T11:31:03.907 INFO:teuthology.lock.ops:unlocked: trial112.front.sepia.ceph.com