2026-02-23T12:29:08.764 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-23T12:29:08.764 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:29:08.836 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:29:09.026 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f18009b4c50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f180015a840>, signals=[15])
2026-02-23T12:29:09.026 INFO:teuthology.lock.ops:Start node 'trial137.front.sepia.ceph.com' reimaging
2026-02-23T12:29:09.026 INFO:teuthology.lock.ops:Updating [trial137.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T12:29:09.026 INFO:teuthology.lock.ops:Updating trial137.front.sepia.ceph.com on lock server
2026-02-23T12:29:09.081 INFO:teuthology.lock.ops:Start node 'trial155.front.sepia.ceph.com' reimaging
2026-02-23T12:29:09.081 INFO:teuthology.lock.ops:Updating [trial155.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T12:29:09.081 INFO:teuthology.lock.ops:Updating trial155.front.sepia.ceph.com on lock server
2026-02-23T12:29:09.279 DEBUG:teuthology.provision.fog.trial155:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T12:29:09.281 DEBUG:teuthology.provision.fog.trial137:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T12:29:09.324 INFO:teuthology.provision.fog.trial137:Scheduling deploy of centos 9.stream
2026-02-23T12:29:09.332 INFO:teuthology.provision.fog.trial155:Scheduling deploy of centos 9.stream
2026-02-23T12:29:12.597 INFO:teuthology.orchestra.console.trial155:Power off
2026-02-23T12:29:12.597 DEBUG:teuthology.orchestra.console.trial155:pexpect command: ipmitool -H trial155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T12:29:12.678 DEBUG:teuthology.orchestra.console.trial155:power off output: Chassis Power Control: Down/Off
2026-02-23T12:29:12.691 INFO:teuthology.orchestra.console.trial137:Power off
2026-02-23T12:29:12.691 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T12:29:12.733 DEBUG:teuthology.orchestra.console.trial137:power off output: Chassis Power Control: Down/Off
2026-02-23T12:29:16.683 DEBUG:teuthology.orchestra.console.trial155:pexpect command: ipmitool -H trial155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T12:29:16.734 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T12:29:16.791 DEBUG:teuthology.orchestra.console.trial155:check power output: Chassis Power is off
2026-02-23T12:29:16.791 INFO:teuthology.orchestra.console.trial155:Power off completed
2026-02-23T12:29:16.840 DEBUG:teuthology.orchestra.console.trial137:check power output: Chassis Power is off
2026-02-23T12:29:16.840 INFO:teuthology.orchestra.console.trial137:Power off completed
2026-02-23T12:29:16.892 INFO:teuthology.orchestra.console.trial155:Power on
2026-02-23T12:29:16.892 DEBUG:teuthology.orchestra.console.trial155:pexpect command: ipmitool -H trial155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T12:29:16.928 DEBUG:teuthology.orchestra.console.trial155:power on output: Chassis Power Control: Up/On
2026-02-23T12:29:16.941 INFO:teuthology.orchestra.console.trial137:Power on
2026-02-23T12:29:16.941 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T12:29:16.977 DEBUG:teuthology.orchestra.console.trial137:power on output: Chassis Power Control: Up/On
2026-02-23T12:29:20.933 DEBUG:teuthology.orchestra.console.trial155:pexpect command: ipmitool -H trial155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T12:29:20.978 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T12:29:21.042 DEBUG:teuthology.orchestra.console.trial155:check power output: Chassis Power is on
2026-02-23T12:29:21.042 INFO:teuthology.orchestra.console.trial155:Power on completed
2026-02-23T12:29:21.086 DEBUG:teuthology.orchestra.console.trial137:check power output: Chassis Power is on
2026-02-23T12:29:21.086 INFO:teuthology.orchestra.console.trial137:Power on completed
2026-02-23T12:29:21.144 INFO:teuthology.provision.fog.trial155:Waiting for deploy to finish
2026-02-23T12:29:21.187 INFO:teuthology.provision.fog.trial137:Waiting for deploy to finish
2026-02-23T12:31:47.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:31:50.337 WARNING:teuthology.provision.fog.trial137:[Errno None] Unable to connect to port 22 on 10.20.193.137
2026-02-23T12:31:56.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:31:59.425 WARNING:teuthology.provision.fog.trial137:[Errno None] Unable to connect to port 22 on 10.20.193.137
2026-02-23T12:32:05.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:32:08.512 WARNING:teuthology.provision.fog.trial137:[Errno None] Unable to connect to port 22 on 10.20.193.137
2026-02-23T12:32:14.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:32:17.600 WARNING:teuthology.provision.fog.trial137:[Errno None] Unable to connect to port 22 on 10.20.193.137
2026-02-23T12:32:23.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:32:26.688 WARNING:teuthology.provision.fog.trial137:[Errno None] Unable to connect to port 22 on 10.20.193.137
2026-02-23T12:32:32.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:32:33.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:32:36.544 WARNING:teuthology.provision.fog.trial155:[Errno None] Unable to connect to port 22 on 10.20.193.155
2026-02-23T12:32:42.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:32:45.632 WARNING:teuthology.provision.fog.trial155:[Errno None] Unable to connect to port 22 on 10.20.193.155
2026-02-23T12:32:51.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:32:54.719 WARNING:teuthology.provision.fog.trial155:[Errno None] Unable to connect to port 22 on 10.20.193.155
2026-02-23T12:33:00.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:33:03.807 WARNING:teuthology.provision.fog.trial155:[Errno None] Unable to connect to port 22 on 10.20.193.155
2026-02-23T12:33:08.561 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T12:33:08.561 DEBUG:teuthology.orchestra.run.trial137:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T12:33:08.792 INFO:teuthology.provision.fog.trial137:Node is ready
2026-02-23T12:33:08.792 DEBUG:teuthology.orchestra.run.trial137:> hostname
2026-02-23T12:33:08.846 INFO:teuthology.orchestra.run.trial137.stdout:trial137.front.sepia.ceph.com
2026-02-23T12:33:08.846 DEBUG:teuthology.orchestra.run.trial137:> grep trial137.front.sepia.ceph.com /etc/hosts
2026-02-23T12:33:08.901 INFO:teuthology.orchestra.run.trial137.stdout:10.20.193.137 trial137.front.sepia.ceph.com trial137
2026-02-23T12:33:08.901 DEBUG:teuthology.orchestra.run.trial137:> sudo hostname trial137
2026-02-23T12:33:08.969 DEBUG:teuthology.orchestra.run.trial137:> sudo sed -i -e 's/trial137.front.sepia.ceph.com/trial137/g' /etc/hosts
2026-02-23T12:33:09.031 DEBUG:teuthology.orchestra.run.trial137:> sudo sed -i -e 's/10.20.193.137/10.20.193.137/g' /etc/hosts
2026-02-23T12:33:09.093 DEBUG:teuthology.orchestra.run.trial137:> sudo sed -i -e 's/trial137.front.sepia.ceph.com/trial137/g' /etc/hostname
2026-02-23T12:33:09.156 DEBUG:teuthology.orchestra.run.trial137:> sudo hostname trial137
2026-02-23T12:33:09.216 DEBUG:teuthology.orchestra.run.trial137:> cat /etc/os-release
2026-02-23T12:33:09.270 INFO:teuthology.orchestra.run.trial137.stdout:NAME="CentOS Stream"
2026-02-23T12:33:09.270 INFO:teuthology.orchestra.run.trial137.stdout:VERSION="9"
2026-02-23T12:33:09.270 INFO:teuthology.orchestra.run.trial137.stdout:ID="centos"
2026-02-23T12:33:09.270 INFO:teuthology.orchestra.run.trial137.stdout:ID_LIKE="rhel fedora"
2026-02-23T12:33:09.271 INFO:teuthology.orchestra.run.trial137.stdout:VERSION_ID="9"
2026-02-23T12:33:09.271 INFO:teuthology.orchestra.run.trial137.stdout:PLATFORM_ID="platform:el9"
2026-02-23T12:33:09.271 INFO:teuthology.orchestra.run.trial137.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T12:33:09.271 INFO:teuthology.orchestra.run.trial137.stdout:ANSI_COLOR="0;31"
2026-02-23T12:33:09.271 INFO:teuthology.orchestra.run.trial137.stdout:LOGO="fedora-logo-icon"
2026-02-23T12:33:09.271 INFO:teuthology.orchestra.run.trial137.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T12:33:09.271 INFO:teuthology.orchestra.run.trial137.stdout:HOME_URL="https://centos.org/"
2026-02-23T12:33:09.271 INFO:teuthology.orchestra.run.trial137.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T12:33:09.271 INFO:teuthology.orchestra.run.trial137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T12:33:09.271 INFO:teuthology.orchestra.run.trial137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T12:33:09.272 INFO:teuthology.provision.fog.trial137:Deploy complete!
2026-02-23T12:33:09.273 DEBUG:teuthology.parallel:result is None
2026-02-23T12:33:09.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:33:12.895 WARNING:teuthology.provision.fog.trial155:[Errno None] Unable to connect to port 22 on 10.20.193.155
2026-02-23T12:33:18.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:33:54.643 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T12:33:54.643 DEBUG:teuthology.orchestra.run.trial155:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T12:33:54.794 INFO:teuthology.provision.fog.trial155:Node is ready
2026-02-23T12:33:54.795 DEBUG:teuthology.orchestra.run.trial155:> hostname
2026-02-23T12:33:54.849 INFO:teuthology.orchestra.run.trial155.stdout:trial155.front.sepia.ceph.com
2026-02-23T12:33:54.850 DEBUG:teuthology.orchestra.run.trial155:> grep trial155.front.sepia.ceph.com /etc/hosts
2026-02-23T12:33:54.905 INFO:teuthology.orchestra.run.trial155.stdout:10.20.193.155 trial155.front.sepia.ceph.com trial155
2026-02-23T12:33:54.905 DEBUG:teuthology.orchestra.run.trial155:> sudo hostname trial155
2026-02-23T12:33:54.975 DEBUG:teuthology.orchestra.run.trial155:> sudo sed -i -e 's/trial155.front.sepia.ceph.com/trial155/g' /etc/hosts
2026-02-23T12:33:55.038 DEBUG:teuthology.orchestra.run.trial155:> sudo sed -i -e 's/10.20.193.155/10.20.193.155/g' /etc/hosts
2026-02-23T12:33:55.103 DEBUG:teuthology.orchestra.run.trial155:> sudo sed -i -e 's/trial155.front.sepia.ceph.com/trial155/g' /etc/hostname
2026-02-23T12:33:55.167 DEBUG:teuthology.orchestra.run.trial155:> sudo hostname trial155
2026-02-23T12:33:55.230 DEBUG:teuthology.orchestra.run.trial155:> cat /etc/os-release
2026-02-23T12:33:55.285 INFO:teuthology.orchestra.run.trial155.stdout:NAME="CentOS Stream"
2026-02-23T12:33:55.285 INFO:teuthology.orchestra.run.trial155.stdout:VERSION="9"
2026-02-23T12:33:55.285 INFO:teuthology.orchestra.run.trial155.stdout:ID="centos"
2026-02-23T12:33:55.286 INFO:teuthology.orchestra.run.trial155.stdout:ID_LIKE="rhel fedora"
2026-02-23T12:33:55.286 INFO:teuthology.orchestra.run.trial155.stdout:VERSION_ID="9"
2026-02-23T12:33:55.286 INFO:teuthology.orchestra.run.trial155.stdout:PLATFORM_ID="platform:el9"
2026-02-23T12:33:55.286 INFO:teuthology.orchestra.run.trial155.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T12:33:55.286 INFO:teuthology.orchestra.run.trial155.stdout:ANSI_COLOR="0;31"
2026-02-23T12:33:55.286 INFO:teuthology.orchestra.run.trial155.stdout:LOGO="fedora-logo-icon"
2026-02-23T12:33:55.286 INFO:teuthology.orchestra.run.trial155.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T12:33:55.286 INFO:teuthology.orchestra.run.trial155.stdout:HOME_URL="https://centos.org/"
2026-02-23T12:33:55.286 INFO:teuthology.orchestra.run.trial155.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T12:33:55.286 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T12:33:55.286 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T12:33:55.286 INFO:teuthology.provision.fog.trial155:Deploy complete!
2026-02-23T12:33:55.286 DEBUG:teuthology.parallel:result is None
2026-02-23T12:33:55.641 INFO:teuthology.lock.ops:Checking trial137.front.sepia.ceph.com
2026-02-23T12:33:55.641 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T12:33:55.733 INFO:teuthology.lock.ops:Checking trial155.front.sepia.ceph.com
2026-02-23T12:33:55.733 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T12:33:55.796 INFO:teuthology.lock.ops:Updating [trial137.front.sepia.ceph.com]: set os type and version on server
2026-02-23T12:33:55.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial137.front.sepia.ceph.com'
2026-02-23T12:33:55.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:33:55.857 DEBUG:teuthology.orchestra.run.trial137:> true
2026-02-23T12:33:55.931 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial137.front.sepia.ceph.com'
2026-02-23T12:33:55.931 DEBUG:teuthology.orchestra.run.trial137:> uname -m
2026-02-23T12:33:55.986 INFO:teuthology.orchestra.run.trial137.stdout:x86_64
2026-02-23T12:33:55.986 DEBUG:teuthology.orchestra.run.trial137:> cat /etc/os-release
2026-02-23T12:33:56.043 INFO:teuthology.orchestra.run.trial137.stdout:NAME="CentOS Stream"
2026-02-23T12:33:56.043 INFO:teuthology.orchestra.run.trial137.stdout:VERSION="9"
2026-02-23T12:33:56.043 INFO:teuthology.orchestra.run.trial137.stdout:ID="centos"
2026-02-23T12:33:56.043 INFO:teuthology.orchestra.run.trial137.stdout:ID_LIKE="rhel fedora"
2026-02-23T12:33:56.043 INFO:teuthology.orchestra.run.trial137.stdout:VERSION_ID="9"
2026-02-23T12:33:56.043 INFO:teuthology.orchestra.run.trial137.stdout:PLATFORM_ID="platform:el9"
2026-02-23T12:33:56.043 INFO:teuthology.orchestra.run.trial137.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T12:33:56.043 INFO:teuthology.orchestra.run.trial137.stdout:ANSI_COLOR="0;31"
2026-02-23T12:33:56.044 INFO:teuthology.orchestra.run.trial137.stdout:LOGO="fedora-logo-icon"
2026-02-23T12:33:56.044 INFO:teuthology.orchestra.run.trial137.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T12:33:56.044 INFO:teuthology.orchestra.run.trial137.stdout:HOME_URL="https://centos.org/"
2026-02-23T12:33:56.044 INFO:teuthology.orchestra.run.trial137.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T12:33:56.044 INFO:teuthology.orchestra.run.trial137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T12:33:56.044 INFO:teuthology.orchestra.run.trial137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T12:33:56.044 INFO:teuthology.lock.ops:Updating trial137.front.sepia.ceph.com on lock server
2026-02-23T12:33:56.108 INFO:teuthology.lock.ops:Updating [trial155.front.sepia.ceph.com]: set os type and version on server
2026-02-23T12:33:56.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial155.front.sepia.ceph.com'
2026-02-23T12:33:56.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:33:56.176 DEBUG:teuthology.orchestra.run.trial155:> true
2026-02-23T12:33:56.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial155.front.sepia.ceph.com'
2026-02-23T12:33:56.257 DEBUG:teuthology.orchestra.run.trial155:> uname -m
2026-02-23T12:33:56.312 INFO:teuthology.orchestra.run.trial155.stdout:x86_64
2026-02-23T12:33:56.312 DEBUG:teuthology.orchestra.run.trial155:> cat /etc/os-release
2026-02-23T12:33:56.368 INFO:teuthology.orchestra.run.trial155.stdout:NAME="CentOS Stream"
2026-02-23T12:33:56.368 INFO:teuthology.orchestra.run.trial155.stdout:VERSION="9"
2026-02-23T12:33:56.368 INFO:teuthology.orchestra.run.trial155.stdout:ID="centos"
2026-02-23T12:33:56.368 INFO:teuthology.orchestra.run.trial155.stdout:ID_LIKE="rhel fedora"
2026-02-23T12:33:56.368 INFO:teuthology.orchestra.run.trial155.stdout:VERSION_ID="9"
2026-02-23T12:33:56.368 INFO:teuthology.orchestra.run.trial155.stdout:PLATFORM_ID="platform:el9"
2026-02-23T12:33:56.368 INFO:teuthology.orchestra.run.trial155.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T12:33:56.368 INFO:teuthology.orchestra.run.trial155.stdout:ANSI_COLOR="0;31"
2026-02-23T12:33:56.368 INFO:teuthology.orchestra.run.trial155.stdout:LOGO="fedora-logo-icon"
2026-02-23T12:33:56.368 INFO:teuthology.orchestra.run.trial155.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T12:33:56.368 INFO:teuthology.orchestra.run.trial155.stdout:HOME_URL="https://centos.org/"
2026-02-23T12:33:56.368 INFO:teuthology.orchestra.run.trial155.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T12:33:56.368 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T12:33:56.368 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T12:33:56.368 INFO:teuthology.lock.ops:Updating trial155.front.sepia.ceph.com on lock server
2026-02-23T12:33:56.433 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:33:56.520 INFO:teuthology.dispatcher.supervisor:Running job 66439
2026-02-23T12:33:56.520 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_shraddhaag@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66439 --name shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/cephadm objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{default} thrashosds-health workloads/small-objects-balanced} -- /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66439/orig.config.yaml
2026-02-23T12:33:56.520 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66439
2026-02-23T12:33:56.520 INFO:teuthology.dispatcher.supervisor:Job PID: 580317
2026-02-23T12:33:56.520 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-23T12:35:56.619 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:37:56.792 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:39:57.012 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:41:57.211 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:43:57.375 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:45:57.583 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:47:57.814 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:49:57.960 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:51:58.174 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:53:58.352 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:55:58.520 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:57:58.730 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:59:58.921 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:01:59.104 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:03:59.301 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:05:59.490 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:07:59.695 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:09:59.897 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:12:00.085 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:14:00.289 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:16:00.471 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:18:00.685 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:20:00.893 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:22:01.047 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:24:01.177 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:26:01.343 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:28:01.529 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:30:01.724 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:32:03.264 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:34:03.476 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:36:03.628 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:38:03.831 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:40:04.043 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:42:04.254 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:44:04.444 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:46:04.640 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:48:04.844 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:50:05.039 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:52:05.246 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:54:05.435 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:56:05.621 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:58:05.747 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:00:05.974 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:02:06.221 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:04:06.428 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:06:06.626 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:08:06.731 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:10:06.928 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:12:07.154 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:14:07.355 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:16:07.559 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:18:07.792 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:20:07.998 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:22:08.205 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:24:08.418 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:26:08.635 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:28:08.852 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:30:09.069 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:32:09.278 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:34:09.489 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:36:09.720 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:38:10.010 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:40:10.191 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:42:10.382 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:44:10.570 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:46:10.772 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:48:10.979 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:50:11.188 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:52:11.392 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:54:11.603 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:56:11.820 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T14:58:11.968 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:00:12.092 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:02:12.306 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:04:12.514 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:06:12.622 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:08:12.757 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:10:12.966 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:12:13.190 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:14:13.319 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:16:13.510 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:18:13.718 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:20:13.906 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:22:14.106 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:24:14.274 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:26:14.474 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:28:14.694 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:30:14.832 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:32:15.552 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:34:15.754 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:36:15.969 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:38:16.151 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:40:16.348 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:42:16.499 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:44:16.699 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:46:16.901 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:48:17.083 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:50:17.279 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:52:17.441 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:54:17.582 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:56:17.787 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T15:58:17.947 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:00:18.162 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:02:18.368 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:04:18.574 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:06:18.754 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:08:18.950 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:10:19.128 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:12:19.303 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:14:19.509 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:16:19.682 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:18:19.779 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:20:19.893 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:22:20.371 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:24:20.565 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T16:24:20.652 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2026-02-23T16:24:20.761 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-23T16:24:21.280 INFO:teuthology.orchestra.console.trial137:Power off
2026-02-23T16:24:21.280 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T16:24:21.288 INFO:teuthology.orchestra.console.trial155:Power off
2026-02-23T16:24:21.288 DEBUG:teuthology.orchestra.console.trial155:pexpect command: ipmitool -H trial155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T16:24:21.318 DEBUG:teuthology.orchestra.console.trial137:power off output: Chassis Power Control: Down/Off
2026-02-23T16:24:21.326 DEBUG:teuthology.orchestra.console.trial155:power off output: Chassis Power Control: Down/Off
2026-02-23T16:24:25.323 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T16:24:25.329 DEBUG:teuthology.orchestra.console.trial155:pexpect command: ipmitool -H trial155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T16:24:25.431 DEBUG:teuthology.orchestra.console.trial137:check power output: Chassis Power is on
2026-02-23T16:24:25.436 DEBUG:teuthology.orchestra.console.trial155:check power output: Chassis Power is on
2026-02-23T16:24:29.436 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T16:24:29.443 DEBUG:teuthology.orchestra.console.trial155:pexpect command: ipmitool -H trial155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T16:24:29.546 DEBUG:teuthology.orchestra.console.trial137:check power output: Chassis Power is off
2026-02-23T16:24:29.546 INFO:teuthology.orchestra.console.trial137:Power off completed
2026-02-23T16:24:29.553 DEBUG:teuthology.orchestra.console.trial155:check power output: Chassis Power is off
2026-02-23T16:24:29.553 INFO:teuthology.orchestra.console.trial155:Power off completed
2026-02-23T16:24:29.776 INFO:teuthology.lock.ops:unlocked: trial137.front.sepia.ceph.com
2026-02-23T16:24:29.789 INFO:teuthology.lock.ops:unlocked: trial155.front.sepia.ceph.com