2026-02-23T10:06:37.008 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-23T10:06:37.008 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:06:37.082 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:06:37.293 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x730b4b62a3c0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x730b4ad8ee80>, signals=[15])
2026-02-23T10:06:37.293 INFO:teuthology.lock.ops:Start node 'trial073.front.sepia.ceph.com' reimaging
2026-02-23T10:06:37.293 INFO:teuthology.lock.ops:Updating [trial073.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T10:06:37.293 INFO:teuthology.lock.ops:Updating trial073.front.sepia.ceph.com on lock server
2026-02-23T10:06:37.353 INFO:teuthology.lock.ops:Start node 'trial175.front.sepia.ceph.com' reimaging
2026-02-23T10:06:37.353 INFO:teuthology.lock.ops:Updating [trial175.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T10:06:37.353 INFO:teuthology.lock.ops:Updating trial175.front.sepia.ceph.com on lock server
2026-02-23T10:06:37.593 DEBUG:teuthology.provision.fog.trial073:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T10:06:37.601 DEBUG:teuthology.provision.fog.trial175:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T10:06:37.639 INFO:teuthology.provision.fog.trial175:Scheduling deploy of centos 9.stream
2026-02-23T10:06:37.646 INFO:teuthology.provision.fog.trial073:Scheduling deploy of centos 9.stream
2026-02-23T10:06:39.042 INFO:teuthology.orchestra.console.trial073:Power off
2026-02-23T10:06:39.042 DEBUG:teuthology.orchestra.console.trial073:pexpect command: ipmitool -H trial073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T10:06:39.062 INFO:teuthology.orchestra.console.trial175:Power off
2026-02-23T10:06:39.062 DEBUG:teuthology.orchestra.console.trial175:pexpect command: ipmitool -H trial175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T10:06:39.079 DEBUG:teuthology.orchestra.console.trial073:power off output: Chassis Power Control: Down/Off
2026-02-23T10:06:39.099 DEBUG:teuthology.orchestra.console.trial175:power off output: Chassis Power Control: Down/Off
2026-02-23T10:06:43.084 DEBUG:teuthology.orchestra.console.trial073:pexpect command: ipmitool -H trial073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T10:06:43.099 DEBUG:teuthology.orchestra.console.trial175:pexpect command: ipmitool -H trial175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T10:06:43.192 DEBUG:teuthology.orchestra.console.trial073:check power output: Chassis Power is off
2026-02-23T10:06:43.192 INFO:teuthology.orchestra.console.trial073:Power off completed
2026-02-23T10:06:43.206 DEBUG:teuthology.orchestra.console.trial175:check power output: Chassis Power is off
2026-02-23T10:06:43.207 INFO:teuthology.orchestra.console.trial175:Power off completed
2026-02-23T10:06:43.293 INFO:teuthology.orchestra.console.trial073:Power on
2026-02-23T10:06:43.293 DEBUG:teuthology.orchestra.console.trial073:pexpect command: ipmitool -H trial073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T10:06:43.308 INFO:teuthology.orchestra.console.trial175:Power on
2026-02-23T10:06:43.308 DEBUG:teuthology.orchestra.console.trial175:pexpect command: ipmitool -H trial175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T10:06:43.332 DEBUG:teuthology.orchestra.console.trial073:power on output: Chassis Power Control: Up/On
2026-02-23T10:06:43.345 DEBUG:teuthology.orchestra.console.trial175:power on output: Chassis Power Control: Up/On
2026-02-23T10:06:47.336 DEBUG:teuthology.orchestra.console.trial073:pexpect command: ipmitool -H trial073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T10:06:47.346 DEBUG:teuthology.orchestra.console.trial175:pexpect command: ipmitool -H trial175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T10:06:47.446 DEBUG:teuthology.orchestra.console.trial073:check power output: Chassis Power is off
2026-02-23T10:06:47.453 DEBUG:teuthology.orchestra.console.trial175:check power output: Chassis Power is on
2026-02-23T10:06:47.453 INFO:teuthology.orchestra.console.trial175:Power on completed
2026-02-23T10:06:47.554 INFO:teuthology.provision.fog.trial175:Waiting for deploy to finish
2026-02-23T10:06:51.451 DEBUG:teuthology.orchestra.console.trial073:pexpect command: ipmitool -H trial073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T10:06:51.558 DEBUG:teuthology.orchestra.console.trial073:check power output: Chassis Power is on
2026-02-23T10:06:51.558 INFO:teuthology.orchestra.console.trial073:Power on completed
2026-02-23T10:06:51.659 INFO:teuthology.provision.fog.trial073:Waiting for deploy to finish
2026-02-23T10:08:39.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T10:08:50.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T10:08:53.441 WARNING:teuthology.provision.fog.trial175:[Errno None] Unable to connect to port 22 on 10.20.193.175
2026-02-23T10:08:53.632 WARNING:teuthology.provision.fog.trial073:[Errno None] Unable to connect to port 22 on 10.20.193.73
2026-02-23T10:08:59.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T10:08:59.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T10:09:02.528 WARNING:teuthology.provision.fog.trial175:[Errno None] Unable to connect to port 22 on 10.20.193.175
2026-02-23T10:09:02.719 WARNING:teuthology.provision.fog.trial073:[Errno None] Unable to connect to port 22 on 10.20.193.73
2026-02-23T10:09:08.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T10:09:08.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T10:09:11.616 WARNING:teuthology.provision.fog.trial175:[Errno None] Unable to connect to port 22 on 10.20.193.175
2026-02-23T10:09:11.808 WARNING:teuthology.provision.fog.trial073:[Errno None] Unable to connect to port 22 on 10.20.193.73
2026-02-23T10:09:17.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T10:09:17.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T10:09:20.704 WARNING:teuthology.provision.fog.trial175:[Errno None] Unable to connect to port 22 on 10.20.193.175
2026-02-23T10:09:20.896 WARNING:teuthology.provision.fog.trial073:[Errno None] Unable to connect to port 22 on 10.20.193.73
2026-02-23T10:09:26.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T10:09:26.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T10:10:02.898 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T10:10:02.899 DEBUG:teuthology.orchestra.run.trial073:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T10:10:02.926 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T10:10:02.926 DEBUG:teuthology.orchestra.run.trial175:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T10:10:03.104 INFO:teuthology.provision.fog.trial175:Node is ready
2026-02-23T10:10:03.105 DEBUG:teuthology.orchestra.run.trial175:> hostname
2026-02-23T10:10:03.107 INFO:teuthology.provision.fog.trial073:Node is ready
2026-02-23T10:10:03.107 DEBUG:teuthology.orchestra.run.trial073:> hostname
2026-02-23T10:10:03.157 INFO:teuthology.orchestra.run.trial175.stdout:trial175.front.sepia.ceph.com
2026-02-23T10:10:03.157 DEBUG:teuthology.orchestra.run.trial175:> grep trial175.front.sepia.ceph.com /etc/hosts
2026-02-23T10:10:03.163 INFO:teuthology.orchestra.run.trial073.stdout:trial073.front.sepia.ceph.com
2026-02-23T10:10:03.164 DEBUG:teuthology.orchestra.run.trial073:> grep trial073.front.sepia.ceph.com /etc/hosts
2026-02-23T10:10:03.210 INFO:teuthology.orchestra.run.trial175.stdout:10.20.193.175 trial175.front.sepia.ceph.com trial175
2026-02-23T10:10:03.210 DEBUG:teuthology.orchestra.run.trial175:> sudo hostname trial175
2026-02-23T10:10:03.221 INFO:teuthology.orchestra.run.trial073.stdout:10.20.193.73 trial073.front.sepia.ceph.com trial073
2026-02-23T10:10:03.221 DEBUG:teuthology.orchestra.run.trial073:> sudo hostname trial073
2026-02-23T10:10:03.282 DEBUG:teuthology.orchestra.run.trial175:> sudo sed -i -e 's/trial175.front.sepia.ceph.com/trial175/g' /etc/hosts
2026-02-23T10:10:03.293 DEBUG:teuthology.orchestra.run.trial073:> sudo sed -i -e 's/trial073.front.sepia.ceph.com/trial073/g' /etc/hosts
2026-02-23T10:10:03.344 DEBUG:teuthology.orchestra.run.trial175:> sudo sed -i -e 's/10.20.193.175/10.20.193.175/g' /etc/hosts
2026-02-23T10:10:03.358 DEBUG:teuthology.orchestra.run.trial073:> sudo sed -i -e 's/10.20.193.73/10.20.193.73/g' /etc/hosts
2026-02-23T10:10:03.405 DEBUG:teuthology.orchestra.run.trial175:> sudo sed -i -e 's/trial175.front.sepia.ceph.com/trial175/g' /etc/hostname
2026-02-23T10:10:03.423 DEBUG:teuthology.orchestra.run.trial073:> sudo sed -i -e 's/trial073.front.sepia.ceph.com/trial073/g' /etc/hostname
2026-02-23T10:10:03.467 DEBUG:teuthology.orchestra.run.trial175:> sudo hostname trial175
2026-02-23T10:10:03.488 DEBUG:teuthology.orchestra.run.trial073:> sudo hostname trial073
2026-02-23T10:10:03.527 DEBUG:teuthology.orchestra.run.trial175:> cat /etc/os-release
2026-02-23T10:10:03.564 DEBUG:teuthology.orchestra.run.trial073:> cat /etc/os-release
2026-02-23T10:10:03.583 INFO:teuthology.orchestra.run.trial175.stdout:NAME="CentOS Stream"
2026-02-23T10:10:03.584 INFO:teuthology.orchestra.run.trial175.stdout:VERSION="9"
2026-02-23T10:10:03.584 INFO:teuthology.orchestra.run.trial175.stdout:ID="centos"
2026-02-23T10:10:03.584 INFO:teuthology.orchestra.run.trial175.stdout:ID_LIKE="rhel fedora"
2026-02-23T10:10:03.584 INFO:teuthology.orchestra.run.trial175.stdout:VERSION_ID="9"
2026-02-23T10:10:03.584 INFO:teuthology.orchestra.run.trial175.stdout:PLATFORM_ID="platform:el9"
2026-02-23T10:10:03.584 INFO:teuthology.orchestra.run.trial175.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T10:10:03.584 INFO:teuthology.orchestra.run.trial175.stdout:ANSI_COLOR="0;31"
2026-02-23T10:10:03.584 INFO:teuthology.orchestra.run.trial175.stdout:LOGO="fedora-logo-icon"
2026-02-23T10:10:03.584 INFO:teuthology.orchestra.run.trial175.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T10:10:03.584 INFO:teuthology.orchestra.run.trial175.stdout:HOME_URL="https://centos.org/"
2026-02-23T10:10:03.584 INFO:teuthology.orchestra.run.trial175.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T10:10:03.585 INFO:teuthology.orchestra.run.trial175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T10:10:03.585 INFO:teuthology.orchestra.run.trial175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T10:10:03.586 INFO:teuthology.provision.fog.trial175:Deploy complete!
2026-02-23T10:10:03.587 DEBUG:teuthology.parallel:result is None
2026-02-23T10:10:03.619 INFO:teuthology.orchestra.run.trial073.stdout:NAME="CentOS Stream"
2026-02-23T10:10:03.620 INFO:teuthology.orchestra.run.trial073.stdout:VERSION="9"
2026-02-23T10:10:03.620 INFO:teuthology.orchestra.run.trial073.stdout:ID="centos"
2026-02-23T10:10:03.620 INFO:teuthology.orchestra.run.trial073.stdout:ID_LIKE="rhel fedora"
2026-02-23T10:10:03.620 INFO:teuthology.orchestra.run.trial073.stdout:VERSION_ID="9"
2026-02-23T10:10:03.620 INFO:teuthology.orchestra.run.trial073.stdout:PLATFORM_ID="platform:el9"
2026-02-23T10:10:03.620 INFO:teuthology.orchestra.run.trial073.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T10:10:03.620 INFO:teuthology.orchestra.run.trial073.stdout:ANSI_COLOR="0;31"
2026-02-23T10:10:03.620 INFO:teuthology.orchestra.run.trial073.stdout:LOGO="fedora-logo-icon"
2026-02-23T10:10:03.620 INFO:teuthology.orchestra.run.trial073.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T10:10:03.621 INFO:teuthology.orchestra.run.trial073.stdout:HOME_URL="https://centos.org/"
2026-02-23T10:10:03.621 INFO:teuthology.orchestra.run.trial073.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T10:10:03.621 INFO:teuthology.orchestra.run.trial073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T10:10:03.621 INFO:teuthology.orchestra.run.trial073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T10:10:03.621 INFO:teuthology.provision.fog.trial073:Deploy complete!
2026-02-23T10:10:03.622 DEBUG:teuthology.parallel:result is None
2026-02-23T10:10:04.009 INFO:teuthology.lock.ops:Checking trial073.front.sepia.ceph.com
2026-02-23T10:10:04.009 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T10:10:04.110 INFO:teuthology.lock.ops:Checking trial175.front.sepia.ceph.com
2026-02-23T10:10:04.110 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T10:10:04.172 INFO:teuthology.lock.ops:Updating [trial073.front.sepia.ceph.com]: set os type and version on server
2026-02-23T10:10:04.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial073.front.sepia.ceph.com'
2026-02-23T10:10:04.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T10:10:04.239 DEBUG:teuthology.orchestra.run.trial073:> true
2026-02-23T10:10:04.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial073.front.sepia.ceph.com'
2026-02-23T10:10:04.317 DEBUG:teuthology.orchestra.run.trial073:> uname -m
2026-02-23T10:10:04.372 INFO:teuthology.orchestra.run.trial073.stdout:x86_64
2026-02-23T10:10:04.372 DEBUG:teuthology.orchestra.run.trial073:> cat /etc/os-release
2026-02-23T10:10:04.427 INFO:teuthology.orchestra.run.trial073.stdout:NAME="CentOS Stream"
2026-02-23T10:10:04.427 INFO:teuthology.orchestra.run.trial073.stdout:VERSION="9"
2026-02-23T10:10:04.427 INFO:teuthology.orchestra.run.trial073.stdout:ID="centos"
2026-02-23T10:10:04.428 INFO:teuthology.orchestra.run.trial073.stdout:ID_LIKE="rhel fedora"
2026-02-23T10:10:04.428 INFO:teuthology.orchestra.run.trial073.stdout:VERSION_ID="9"
2026-02-23T10:10:04.428 INFO:teuthology.orchestra.run.trial073.stdout:PLATFORM_ID="platform:el9"
2026-02-23T10:10:04.428 INFO:teuthology.orchestra.run.trial073.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T10:10:04.428 INFO:teuthology.orchestra.run.trial073.stdout:ANSI_COLOR="0;31"
2026-02-23T10:10:04.428 INFO:teuthology.orchestra.run.trial073.stdout:LOGO="fedora-logo-icon"
2026-02-23T10:10:04.428 INFO:teuthology.orchestra.run.trial073.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T10:10:04.428 INFO:teuthology.orchestra.run.trial073.stdout:HOME_URL="https://centos.org/"
2026-02-23T10:10:04.428 INFO:teuthology.orchestra.run.trial073.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T10:10:04.428 INFO:teuthology.orchestra.run.trial073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T10:10:04.428 INFO:teuthology.orchestra.run.trial073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T10:10:04.428 INFO:teuthology.lock.ops:Updating trial073.front.sepia.ceph.com on lock server
2026-02-23T10:10:04.495 INFO:teuthology.lock.ops:Updating [trial175.front.sepia.ceph.com]: set os type and version on server
2026-02-23T10:10:04.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial175.front.sepia.ceph.com'
2026-02-23T10:10:04.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T10:10:04.556 DEBUG:teuthology.orchestra.run.trial175:> true
2026-02-23T10:10:04.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial175.front.sepia.ceph.com'
2026-02-23T10:10:04.627 DEBUG:teuthology.orchestra.run.trial175:> uname -m
2026-02-23T10:10:04.679 INFO:teuthology.orchestra.run.trial175.stdout:x86_64
2026-02-23T10:10:04.680 DEBUG:teuthology.orchestra.run.trial175:> cat /etc/os-release
2026-02-23T10:10:04.733 INFO:teuthology.orchestra.run.trial175.stdout:NAME="CentOS Stream"
2026-02-23T10:10:04.733 INFO:teuthology.orchestra.run.trial175.stdout:VERSION="9"
2026-02-23T10:10:04.734 INFO:teuthology.orchestra.run.trial175.stdout:ID="centos"
2026-02-23T10:10:04.734 INFO:teuthology.orchestra.run.trial175.stdout:ID_LIKE="rhel fedora"
2026-02-23T10:10:04.734 INFO:teuthology.orchestra.run.trial175.stdout:VERSION_ID="9"
2026-02-23T10:10:04.734 INFO:teuthology.orchestra.run.trial175.stdout:PLATFORM_ID="platform:el9"
2026-02-23T10:10:04.734 INFO:teuthology.orchestra.run.trial175.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T10:10:04.734 INFO:teuthology.orchestra.run.trial175.stdout:ANSI_COLOR="0;31"
2026-02-23T10:10:04.734 INFO:teuthology.orchestra.run.trial175.stdout:LOGO="fedora-logo-icon"
2026-02-23T10:10:04.734 INFO:teuthology.orchestra.run.trial175.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T10:10:04.734 INFO:teuthology.orchestra.run.trial175.stdout:HOME_URL="https://centos.org/"
2026-02-23T10:10:04.734 INFO:teuthology.orchestra.run.trial175.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T10:10:04.735 INFO:teuthology.orchestra.run.trial175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T10:10:04.735 INFO:teuthology.orchestra.run.trial175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T10:10:04.736 INFO:teuthology.lock.ops:Updating trial175.front.sepia.ceph.com on lock server
2026-02-23T10:10:04.830 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:10:04.936 INFO:teuthology.dispatcher.supervisor:Running job 66046
2026-02-23T10:10:04.936 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_shraddhaag@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66046 --name shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects-localized} -- /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66046/orig.config.yaml
2026-02-23T10:10:04.936 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_09:58:48-crimson-rados-main-distro-debug-trial/66046
2026-02-23T10:10:04.937 INFO:teuthology.dispatcher.supervisor:Job PID: 4021773
2026-02-23T10:10:04.937 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-23T10:12:04.971 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:14:05.138 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:16:05.320 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:18:05.441 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:20:05.647 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:22:05.855 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:24:06.055 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:26:06.250 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:28:06.446 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:30:06.636 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:32:06.837 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:34:07.020 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:36:07.217 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:38:07.409 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:40:07.583 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:42:07.760 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T10:42:07.836 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-23T10:42:07.950 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-23T10:42:08.450 INFO:teuthology.orchestra.console.trial175:Power off
2026-02-23T10:42:08.450 DEBUG:teuthology.orchestra.console.trial175:pexpect command: ipmitool -H trial175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T10:42:08.470 INFO:teuthology.orchestra.console.trial073:Power off
2026-02-23T10:42:08.470 DEBUG:teuthology.orchestra.console.trial073:pexpect command: ipmitool -H trial073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T10:42:08.488 DEBUG:teuthology.orchestra.console.trial175:power off output: Chassis Power Control: Down/Off
2026-02-23T10:42:08.508 DEBUG:teuthology.orchestra.console.trial073:power off output: Chassis Power Control: Down/Off
2026-02-23T10:42:12.492 DEBUG:teuthology.orchestra.console.trial175:pexpect command: ipmitool -H trial175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T10:42:12.509 DEBUG:teuthology.orchestra.console.trial073:pexpect command: ipmitool -H trial073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T10:42:12.601 DEBUG:teuthology.orchestra.console.trial175:check power output: Chassis Power is on
2026-02-23T10:42:12.618 DEBUG:teuthology.orchestra.console.trial073:check power output: Chassis Power is on
2026-02-23T10:42:16.607 DEBUG:teuthology.orchestra.console.trial175:pexpect command: ipmitool -H trial175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T10:42:16.619 DEBUG:teuthology.orchestra.console.trial073:pexpect command: ipmitool -H trial073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T10:42:16.717 DEBUG:teuthology.orchestra.console.trial175:check power output: Chassis Power is off
2026-02-23T10:42:16.717 INFO:teuthology.orchestra.console.trial175:Power off completed
2026-02-23T10:42:16.727 DEBUG:teuthology.orchestra.console.trial073:check power output: Chassis Power is off
2026-02-23T10:42:16.727 INFO:teuthology.orchestra.console.trial073:Power off completed
2026-02-23T10:42:16.917 INFO:teuthology.lock.ops:unlocked: trial175.front.sepia.ceph.com
2026-02-23T10:42:16.929 INFO:teuthology.lock.ops:unlocked: trial073.front.sepia.ceph.com