2026-02-24T07:12:48.203 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-24T07:12:48.203 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:12:48.277 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:12:48.478 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7e47a3910ef0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7e47a389e520>, signals=[15])
2026-02-24T07:12:48.479 INFO:teuthology.lock.ops:Start node 'trial053.front.sepia.ceph.com' reimaging
2026-02-24T07:12:48.479 INFO:teuthology.lock.ops:Updating [trial053.front.sepia.ceph.com]: reset os type and version on server
2026-02-24T07:12:48.479 INFO:teuthology.lock.ops:Updating trial053.front.sepia.ceph.com on lock server
2026-02-24T07:12:48.535 INFO:teuthology.lock.ops:Start node 'trial067.front.sepia.ceph.com' reimaging
2026-02-24T07:12:48.535 INFO:teuthology.lock.ops:Updating [trial067.front.sepia.ceph.com]: reset os type and version on server
2026-02-24T07:12:48.535 INFO:teuthology.lock.ops:Updating trial067.front.sepia.ceph.com on lock server
2026-02-24T07:12:48.741 DEBUG:teuthology.provision.fog.trial053:Requesting image trial_centos_9.stream (ID 3)
2026-02-24T07:12:48.752 DEBUG:teuthology.provision.fog.trial067:Requesting image trial_centos_9.stream (ID 3)
2026-02-24T07:12:48.775 INFO:teuthology.provision.fog.trial067:Scheduling deploy of centos 9.stream
2026-02-24T07:12:48.788 INFO:teuthology.provision.fog.trial053:Scheduling deploy of centos 9.stream
2026-02-24T07:12:50.366 INFO:teuthology.orchestra.console.trial053:Power off
2026-02-24T07:12:50.366 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T07:12:50.385 INFO:teuthology.orchestra.console.trial067:Power off
2026-02-24T07:12:50.385 DEBUG:teuthology.orchestra.console.trial067:pexpect command: ipmitool -H trial067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T07:12:50.405 DEBUG:teuthology.orchestra.console.trial053:power off output: Chassis Power Control: Down/Off
2026-02-24T07:12:50.423 DEBUG:teuthology.orchestra.console.trial067:power off output: Chassis Power Control: Down/Off
2026-02-24T07:12:54.410 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T07:12:54.424 DEBUG:teuthology.orchestra.console.trial067:pexpect command: ipmitool -H trial067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T07:12:54.519 DEBUG:teuthology.orchestra.console.trial053:check power output: Chassis Power is off
2026-02-24T07:12:54.520 INFO:teuthology.orchestra.console.trial053:Power off completed
2026-02-24T07:12:54.532 DEBUG:teuthology.orchestra.console.trial067:check power output: Chassis Power is off
2026-02-24T07:12:54.532 INFO:teuthology.orchestra.console.trial067:Power off completed
2026-02-24T07:12:54.621 INFO:teuthology.orchestra.console.trial053:Power on
2026-02-24T07:12:54.622 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-24T07:12:54.633 INFO:teuthology.orchestra.console.trial067:Power on
2026-02-24T07:12:54.633 DEBUG:teuthology.orchestra.console.trial067:pexpect command: ipmitool -H trial067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-24T07:12:54.662 DEBUG:teuthology.orchestra.console.trial053:power on output: Chassis Power Control: Up/On
2026-02-24T07:12:54.680 DEBUG:teuthology.orchestra.console.trial067:power on output: Chassis Power Control: Up/On
2026-02-24T07:12:58.667 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T07:12:58.681 DEBUG:teuthology.orchestra.console.trial067:pexpect command: ipmitool -H trial067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T07:12:58.775 DEBUG:teuthology.orchestra.console.trial053:check power output: Chassis Power is on
2026-02-24T07:12:58.775 INFO:teuthology.orchestra.console.trial053:Power on completed
2026-02-24T07:12:58.789 DEBUG:teuthology.orchestra.console.trial067:check power output: Chassis Power is off
2026-02-24T07:12:58.876 INFO:teuthology.provision.fog.trial053:Waiting for deploy to finish
2026-02-24T07:13:02.793 DEBUG:teuthology.orchestra.console.trial067:pexpect command: ipmitool -H trial067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T07:13:02.901 DEBUG:teuthology.orchestra.console.trial067:check power output: Chassis Power is on
2026-02-24T07:13:02.901 INFO:teuthology.orchestra.console.trial067:Power on completed
2026-02-24T07:13:03.002 INFO:teuthology.provision.fog.trial067:Waiting for deploy to finish
2026-02-24T07:14:50.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T07:15:01.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T07:15:04.640 WARNING:teuthology.provision.fog.trial053:[Errno None] Unable to connect to port 22 on 10.20.193.53
2026-02-24T07:15:04.768 WARNING:teuthology.provision.fog.trial067:[Errno None] Unable to connect to port 22 on 10.20.193.67
2026-02-24T07:15:10.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T07:15:10.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T07:15:13.728 WARNING:teuthology.provision.fog.trial053:[Errno None] Unable to connect to port 22 on 10.20.193.53
2026-02-24T07:15:13.855 WARNING:teuthology.provision.fog.trial067:[Errno None] Unable to connect to port 22 on 10.20.193.67
2026-02-24T07:15:19.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T07:15:19.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T07:15:22.816 WARNING:teuthology.provision.fog.trial053:[Errno None] Unable to connect to port 22 on 10.20.193.53
2026-02-24T07:15:22.943 WARNING:teuthology.provision.fog.trial067:[Errno None] Unable to connect to port 22 on 10.20.193.67
2026-02-24T07:15:28.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T07:15:28.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T07:15:31.904 WARNING:teuthology.provision.fog.trial053:[Errno None] Unable to connect to port 22 on 10.20.193.53
2026-02-24T07:15:32.032 WARNING:teuthology.provision.fog.trial067:[Errno None] Unable to connect to port 22 on 10.20.193.67
2026-02-24T07:15:37.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T07:15:38.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T07:16:13.986 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-24T07:16:13.987 DEBUG:teuthology.orchestra.run.trial067:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-24T07:16:13.991 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-24T07:16:13.991 DEBUG:teuthology.orchestra.run.trial053:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-24T07:16:14.144 INFO:teuthology.provision.fog.trial053:Node is ready
2026-02-24T07:16:14.144 DEBUG:teuthology.orchestra.run.trial053:> hostname
2026-02-24T07:16:14.151 INFO:teuthology.provision.fog.trial067:Node is ready
2026-02-24T07:16:14.151 DEBUG:teuthology.orchestra.run.trial067:> hostname
2026-02-24T07:16:14.203 INFO:teuthology.orchestra.run.trial053.stdout:trial053.front.sepia.ceph.com
2026-02-24T07:16:14.203 DEBUG:teuthology.orchestra.run.trial053:> grep trial053.front.sepia.ceph.com /etc/hosts
2026-02-24T07:16:14.206 INFO:teuthology.orchestra.run.trial067.stdout:trial067.front.sepia.ceph.com
2026-02-24T07:16:14.206 DEBUG:teuthology.orchestra.run.trial067:> grep trial067.front.sepia.ceph.com /etc/hosts
2026-02-24T07:16:14.260 INFO:teuthology.orchestra.run.trial067.stdout:10.20.193.67 trial067.front.sepia.ceph.com trial067
2026-02-24T07:16:14.261 DEBUG:teuthology.orchestra.run.trial067:> sudo hostname trial067
2026-02-24T07:16:14.263 INFO:teuthology.orchestra.run.trial053.stdout:10.20.193.53 trial053.front.sepia.ceph.com trial053
2026-02-24T07:16:14.263 DEBUG:teuthology.orchestra.run.trial053:> sudo hostname trial053
2026-02-24T07:16:14.329 DEBUG:teuthology.orchestra.run.trial067:> sudo sed -i -e 's/trial067.front.sepia.ceph.com/trial067/g' /etc/hosts
2026-02-24T07:16:14.336 DEBUG:teuthology.orchestra.run.trial053:> sudo sed -i -e 's/trial053.front.sepia.ceph.com/trial053/g' /etc/hosts
2026-02-24T07:16:14.392 DEBUG:teuthology.orchestra.run.trial067:> sudo sed -i -e 's/10.20.193.67/10.20.193.67/g' /etc/hosts
2026-02-24T07:16:14.401 DEBUG:teuthology.orchestra.run.trial053:> sudo sed -i -e 's/10.20.193.53/10.20.193.53/g' /etc/hosts
2026-02-24T07:16:14.457 DEBUG:teuthology.orchestra.run.trial067:> sudo sed -i -e 's/trial067.front.sepia.ceph.com/trial067/g' /etc/hostname
2026-02-24T07:16:14.465 DEBUG:teuthology.orchestra.run.trial053:> sudo sed -i -e 's/trial053.front.sepia.ceph.com/trial053/g' /etc/hostname
2026-02-24T07:16:14.522 DEBUG:teuthology.orchestra.run.trial067:> sudo hostname trial067
2026-02-24T07:16:14.529 DEBUG:teuthology.orchestra.run.trial053:> sudo hostname trial053
2026-02-24T07:16:14.586 DEBUG:teuthology.orchestra.run.trial067:> cat /etc/os-release
2026-02-24T07:16:14.592 DEBUG:teuthology.orchestra.run.trial053:> cat /etc/os-release
2026-02-24T07:16:14.642 INFO:teuthology.orchestra.run.trial067.stdout:NAME="CentOS Stream"
2026-02-24T07:16:14.642 INFO:teuthology.orchestra.run.trial067.stdout:VERSION="9"
2026-02-24T07:16:14.642 INFO:teuthology.orchestra.run.trial067.stdout:ID="centos"
2026-02-24T07:16:14.642 INFO:teuthology.orchestra.run.trial067.stdout:ID_LIKE="rhel fedora"
2026-02-24T07:16:14.642 INFO:teuthology.orchestra.run.trial067.stdout:VERSION_ID="9"
2026-02-24T07:16:14.642 INFO:teuthology.orchestra.run.trial067.stdout:PLATFORM_ID="platform:el9"
2026-02-24T07:16:14.642 INFO:teuthology.orchestra.run.trial067.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T07:16:14.642 INFO:teuthology.orchestra.run.trial067.stdout:ANSI_COLOR="0;31"
2026-02-24T07:16:14.643 INFO:teuthology.orchestra.run.trial067.stdout:LOGO="fedora-logo-icon"
2026-02-24T07:16:14.643 INFO:teuthology.orchestra.run.trial067.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T07:16:14.643 INFO:teuthology.orchestra.run.trial067.stdout:HOME_URL="https://centos.org/"
2026-02-24T07:16:14.643 INFO:teuthology.orchestra.run.trial067.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T07:16:14.643 INFO:teuthology.orchestra.run.trial067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T07:16:14.643 INFO:teuthology.orchestra.run.trial067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T07:16:14.644 INFO:teuthology.provision.fog.trial067:Deploy complete!
2026-02-24T07:16:14.645 DEBUG:teuthology.parallel:result is None
2026-02-24T07:16:14.648 INFO:teuthology.orchestra.run.trial053.stdout:NAME="CentOS Stream"
2026-02-24T07:16:14.648 INFO:teuthology.orchestra.run.trial053.stdout:VERSION="9"
2026-02-24T07:16:14.649 INFO:teuthology.orchestra.run.trial053.stdout:ID="centos"
2026-02-24T07:16:14.649 INFO:teuthology.orchestra.run.trial053.stdout:ID_LIKE="rhel fedora"
2026-02-24T07:16:14.649 INFO:teuthology.orchestra.run.trial053.stdout:VERSION_ID="9"
2026-02-24T07:16:14.649 INFO:teuthology.orchestra.run.trial053.stdout:PLATFORM_ID="platform:el9"
2026-02-24T07:16:14.649 INFO:teuthology.orchestra.run.trial053.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T07:16:14.649 INFO:teuthology.orchestra.run.trial053.stdout:ANSI_COLOR="0;31"
2026-02-24T07:16:14.649 INFO:teuthology.orchestra.run.trial053.stdout:LOGO="fedora-logo-icon"
2026-02-24T07:16:14.649 INFO:teuthology.orchestra.run.trial053.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T07:16:14.649 INFO:teuthology.orchestra.run.trial053.stdout:HOME_URL="https://centos.org/"
2026-02-24T07:16:14.649 INFO:teuthology.orchestra.run.trial053.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T07:16:14.650 INFO:teuthology.orchestra.run.trial053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T07:16:14.650 INFO:teuthology.orchestra.run.trial053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T07:16:14.650 INFO:teuthology.provision.fog.trial053:Deploy complete!
2026-02-24T07:16:14.651 DEBUG:teuthology.parallel:result is None
2026-02-24T07:16:15.043 INFO:teuthology.lock.ops:Checking trial053.front.sepia.ceph.com
2026-02-24T07:16:15.043 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-24T07:16:15.148 INFO:teuthology.lock.ops:Checking trial067.front.sepia.ceph.com
2026-02-24T07:16:15.148 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-24T07:16:15.212 INFO:teuthology.lock.ops:Updating [trial053.front.sepia.ceph.com]: set os type and version on server
2026-02-24T07:16:15.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial053.front.sepia.ceph.com'
2026-02-24T07:16:15.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T07:16:15.276 DEBUG:teuthology.orchestra.run.trial053:> true
2026-02-24T07:16:15.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial053.front.sepia.ceph.com'
2026-02-24T07:16:15.346 DEBUG:teuthology.orchestra.run.trial053:> uname -m
2026-02-24T07:16:15.401 INFO:teuthology.orchestra.run.trial053.stdout:x86_64
2026-02-24T07:16:15.401 DEBUG:teuthology.orchestra.run.trial053:> cat /etc/os-release
2026-02-24T07:16:15.457 INFO:teuthology.orchestra.run.trial053.stdout:NAME="CentOS Stream"
2026-02-24T07:16:15.457 INFO:teuthology.orchestra.run.trial053.stdout:VERSION="9"
2026-02-24T07:16:15.457 INFO:teuthology.orchestra.run.trial053.stdout:ID="centos"
2026-02-24T07:16:15.457 INFO:teuthology.orchestra.run.trial053.stdout:ID_LIKE="rhel fedora"
2026-02-24T07:16:15.458 INFO:teuthology.orchestra.run.trial053.stdout:VERSION_ID="9"
2026-02-24T07:16:15.458 INFO:teuthology.orchestra.run.trial053.stdout:PLATFORM_ID="platform:el9"
2026-02-24T07:16:15.458 INFO:teuthology.orchestra.run.trial053.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T07:16:15.458 INFO:teuthology.orchestra.run.trial053.stdout:ANSI_COLOR="0;31"
2026-02-24T07:16:15.458 INFO:teuthology.orchestra.run.trial053.stdout:LOGO="fedora-logo-icon"
2026-02-24T07:16:15.458 INFO:teuthology.orchestra.run.trial053.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T07:16:15.458 INFO:teuthology.orchestra.run.trial053.stdout:HOME_URL="https://centos.org/"
2026-02-24T07:16:15.458 INFO:teuthology.orchestra.run.trial053.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T07:16:15.458 INFO:teuthology.orchestra.run.trial053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T07:16:15.458 INFO:teuthology.orchestra.run.trial053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T07:16:15.459 INFO:teuthology.lock.ops:Updating trial053.front.sepia.ceph.com on lock server
2026-02-24T07:16:15.563 INFO:teuthology.lock.ops:Updating [trial067.front.sepia.ceph.com]: set os type and version on server
2026-02-24T07:16:15.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial067.front.sepia.ceph.com'
2026-02-24T07:16:15.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T07:16:15.634 DEBUG:teuthology.orchestra.run.trial067:> true
2026-02-24T07:16:15.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial067.front.sepia.ceph.com'
2026-02-24T07:16:15.710 DEBUG:teuthology.orchestra.run.trial067:> uname -m
2026-02-24T07:16:15.766 INFO:teuthology.orchestra.run.trial067.stdout:x86_64
2026-02-24T07:16:15.766 DEBUG:teuthology.orchestra.run.trial067:> cat /etc/os-release
2026-02-24T07:16:15.822 INFO:teuthology.orchestra.run.trial067.stdout:NAME="CentOS Stream"
2026-02-24T07:16:15.823 INFO:teuthology.orchestra.run.trial067.stdout:VERSION="9"
2026-02-24T07:16:15.823 INFO:teuthology.orchestra.run.trial067.stdout:ID="centos"
2026-02-24T07:16:15.823 INFO:teuthology.orchestra.run.trial067.stdout:ID_LIKE="rhel fedora"
2026-02-24T07:16:15.823 INFO:teuthology.orchestra.run.trial067.stdout:VERSION_ID="9"
2026-02-24T07:16:15.823 INFO:teuthology.orchestra.run.trial067.stdout:PLATFORM_ID="platform:el9"
2026-02-24T07:16:15.823 INFO:teuthology.orchestra.run.trial067.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T07:16:15.823 INFO:teuthology.orchestra.run.trial067.stdout:ANSI_COLOR="0;31"
2026-02-24T07:16:15.824 INFO:teuthology.orchestra.run.trial067.stdout:LOGO="fedora-logo-icon"
2026-02-24T07:16:15.824 INFO:teuthology.orchestra.run.trial067.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T07:16:15.824 INFO:teuthology.orchestra.run.trial067.stdout:HOME_URL="https://centos.org/"
2026-02-24T07:16:15.824 INFO:teuthology.orchestra.run.trial067.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T07:16:15.824 INFO:teuthology.orchestra.run.trial067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T07:16:15.824 INFO:teuthology.orchestra.run.trial067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T07:16:15.825 INFO:teuthology.lock.ops:Updating trial067.front.sepia.ceph.com on lock server
2026-02-24T07:16:15.929 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:16:16.028 INFO:teuthology.dispatcher.supervisor:Running job 67586
2026-02-24T07:16:16.028 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_shraddhaag@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67586 --name shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/cephadm objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{default} thrashosds-health workloads/write_fadvise_dontneed} -- /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67586/orig.config.yaml
2026-02-24T07:16:16.028 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67586
2026-02-24T07:16:16.028 INFO:teuthology.dispatcher.supervisor:Job PID: 2757009
2026-02-24T07:16:16.028 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-24T07:18:16.081 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:20:16.280 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:22:16.471 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:24:16.662 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:26:16.793 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:28:16.980 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:30:17.154 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:32:17.334 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:34:17.558 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:36:17.749 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:38:17.952 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:40:18.127 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:42:18.307 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:44:18.507 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:46:18.713 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:48:18.897 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:50:19.077 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:52:19.259 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:54:19.464 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:56:19.665 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:58:19.844 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:00:20.022 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:02:20.196 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:04:20.399 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:04:20.489 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-24T08:04:20.606 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-24T08:04:21.126 INFO:teuthology.orchestra.console.trial053:Power off
2026-02-24T08:04:21.126 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T08:04:21.147 INFO:teuthology.orchestra.console.trial067:Power off
2026-02-24T08:04:21.147 DEBUG:teuthology.orchestra.console.trial067:pexpect command: ipmitool -H trial067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T08:04:21.167 DEBUG:teuthology.orchestra.console.trial053:power off output: Chassis Power Control: Down/Off
2026-02-24T08:04:21.185 DEBUG:teuthology.orchestra.console.trial067:power off output: Chassis Power Control: Down/Off
2026-02-24T08:04:25.171 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T08:04:25.186 DEBUG:teuthology.orchestra.console.trial067:pexpect command: ipmitool -H trial067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T08:04:25.280 DEBUG:teuthology.orchestra.console.trial053:check power output: Chassis Power is on
2026-02-24T08:04:25.293 DEBUG:teuthology.orchestra.console.trial067:check power output: Chassis Power is on
2026-02-24T08:04:29.286 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T08:04:29.294 DEBUG:teuthology.orchestra.console.trial067:pexpect command: ipmitool -H trial067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T08:04:29.396 DEBUG:teuthology.orchestra.console.trial053:check power output: Chassis Power is off
2026-02-24T08:04:29.397 INFO:teuthology.orchestra.console.trial053:Power off completed
2026-02-24T08:04:29.405 DEBUG:teuthology.orchestra.console.trial067:check power output: Chassis Power is off
2026-02-24T08:04:29.405 INFO:teuthology.orchestra.console.trial067:Power off completed
2026-02-24T08:04:29.641 INFO:teuthology.lock.ops:unlocked: trial053.front.sepia.ceph.com
2026-02-24T08:04:29.652 INFO:teuthology.lock.ops:unlocked: trial067.front.sepia.ceph.com