2026-02-12T11:59:11.466 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062
2026-02-12T11:59:11.466 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:59:11.565 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:59:11.751 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7b6318eef7d0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7b631872ce00>, signals=[15])
2026-02-12T11:59:11.751 INFO:teuthology.lock.ops:Start node 'trial098.front.sepia.ceph.com' reimaging
2026-02-12T11:59:11.751 INFO:teuthology.lock.ops:Updating [trial098.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T11:59:11.751 INFO:teuthology.lock.ops:Updating trial098.front.sepia.ceph.com on lock server
2026-02-12T11:59:11.808 INFO:teuthology.lock.ops:Start node 'trial111.front.sepia.ceph.com' reimaging
2026-02-12T11:59:11.808 INFO:teuthology.lock.ops:Updating [trial111.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T11:59:11.808 INFO:teuthology.lock.ops:Updating trial111.front.sepia.ceph.com on lock server
2026-02-12T11:59:12.005 DEBUG:teuthology.provision.fog.trial111:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T11:59:12.019 DEBUG:teuthology.provision.fog.trial098:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T11:59:12.032 INFO:teuthology.provision.fog.trial111:Scheduling deploy of centos 9.stream
2026-02-12T11:59:12.069 INFO:teuthology.provision.fog.trial098:Scheduling deploy of centos 9.stream
2026-02-12T11:59:13.139 INFO:teuthology.orchestra.console.trial098:Power off
2026-02-12T11:59:13.139 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T11:59:13.175 DEBUG:teuthology.orchestra.console.trial098:power off output: Chassis Power Control: Down/Off
2026-02-12T11:59:13.241 INFO:teuthology.orchestra.console.trial111:Power off
2026-02-12T11:59:13.242 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T11:59:13.279 DEBUG:teuthology.orchestra.console.trial111:power off output: Chassis Power Control: Down/Off
2026-02-12T11:59:17.180 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:59:17.280 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:59:17.288 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is off
2026-02-12T11:59:17.288 INFO:teuthology.orchestra.console.trial098:Power off completed
2026-02-12T11:59:17.388 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is off
2026-02-12T11:59:17.388 INFO:teuthology.orchestra.console.trial111:Power off completed
2026-02-12T11:59:17.390 INFO:teuthology.orchestra.console.trial098:Power on
2026-02-12T11:59:17.390 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T11:59:17.428 DEBUG:teuthology.orchestra.console.trial098:power on output: Chassis Power Control: Up/On
2026-02-12T11:59:17.489 INFO:teuthology.orchestra.console.trial111:Power on
2026-02-12T11:59:17.489 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T11:59:17.529 DEBUG:teuthology.orchestra.console.trial111:power on output: Chassis Power Control: Up/On
2026-02-12T11:59:21.433 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:59:21.531 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:59:21.544 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is off
2026-02-12T11:59:21.639 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is on
2026-02-12T11:59:21.640 INFO:teuthology.orchestra.console.trial111:Power on completed
2026-02-12T11:59:21.740 INFO:teuthology.provision.fog.trial111:Waiting for deploy to finish
2026-02-12T11:59:25.548 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:59:25.658 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is on
2026-02-12T11:59:25.658 INFO:teuthology.orchestra.console.trial098:Power on completed
2026-02-12T11:59:25.758 INFO:teuthology.provision.fog.trial098:Waiting for deploy to finish
2026-02-12T12:01:45.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:01:48.509 WARNING:teuthology.provision.fog.trial098:[Errno None] Unable to connect to port 22 on 10.20.193.98
2026-02-12T12:01:54.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:01:57.597 WARNING:teuthology.provision.fog.trial098:[Errno None] Unable to connect to port 22 on 10.20.193.98
2026-02-12T12:02:03.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:02:06.685 WARNING:teuthology.provision.fog.trial098:[Errno None] Unable to connect to port 22 on 10.20.193.98
2026-02-12T12:02:12.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:02:15.773 WARNING:teuthology.provision.fog.trial098:[Errno None] Unable to connect to port 22 on 10.20.193.98
2026-02-12T12:02:21.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:02:57.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:02:57.949 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T12:02:57.949 DEBUG:teuthology.orchestra.run.trial098:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T12:02:58.094 INFO:teuthology.provision.fog.trial098:Node is ready
2026-02-12T12:02:58.094 DEBUG:teuthology.orchestra.run.trial098:> hostname
2026-02-12T12:02:58.150 INFO:teuthology.orchestra.run.trial098.stdout:trial098.front.sepia.ceph.com
2026-02-12T12:02:58.151 DEBUG:teuthology.orchestra.run.trial098:> grep trial098.front.sepia.ceph.com /etc/hosts
2026-02-12T12:02:58.207 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98 trial098.front.sepia.ceph.com trial098
2026-02-12T12:02:58.208 DEBUG:teuthology.orchestra.run.trial098:> sudo hostname trial098
2026-02-12T12:02:58.278 DEBUG:teuthology.orchestra.run.trial098:> sudo sed -i -e 's/trial098.front.sepia.ceph.com/trial098/g' /etc/hosts
2026-02-12T12:02:58.343 DEBUG:teuthology.orchestra.run.trial098:> sudo sed -i -e 's/10.20.193.98/10.20.193.98/g' /etc/hosts
2026-02-12T12:02:58.407 DEBUG:teuthology.orchestra.run.trial098:> sudo sed -i -e 's/trial098.front.sepia.ceph.com/trial098/g' /etc/hostname
2026-02-12T12:02:58.470 DEBUG:teuthology.orchestra.run.trial098:> sudo hostname trial098
2026-02-12T12:02:58.535 DEBUG:teuthology.orchestra.run.trial098:> cat /etc/os-release
2026-02-12T12:02:58.591 INFO:teuthology.orchestra.run.trial098.stdout:NAME="CentOS Stream"
2026-02-12T12:02:58.591 INFO:teuthology.orchestra.run.trial098.stdout:VERSION="9"
2026-02-12T12:02:58.591 INFO:teuthology.orchestra.run.trial098.stdout:ID="centos"
2026-02-12T12:02:58.591 INFO:teuthology.orchestra.run.trial098.stdout:ID_LIKE="rhel fedora"
2026-02-12T12:02:58.591 INFO:teuthology.orchestra.run.trial098.stdout:VERSION_ID="9"
2026-02-12T12:02:58.591 INFO:teuthology.orchestra.run.trial098.stdout:PLATFORM_ID="platform:el9"
2026-02-12T12:02:58.591 INFO:teuthology.orchestra.run.trial098.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T12:02:58.591 INFO:teuthology.orchestra.run.trial098.stdout:ANSI_COLOR="0;31"
2026-02-12T12:02:58.592 INFO:teuthology.orchestra.run.trial098.stdout:LOGO="fedora-logo-icon"
2026-02-12T12:02:58.592 INFO:teuthology.orchestra.run.trial098.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T12:02:58.592 INFO:teuthology.orchestra.run.trial098.stdout:HOME_URL="https://centos.org/"
2026-02-12T12:02:58.592 INFO:teuthology.orchestra.run.trial098.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T12:02:58.592 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T12:02:58.592 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T12:02:58.593 INFO:teuthology.provision.fog.trial098:Deploy complete!
2026-02-12T12:02:58.593 DEBUG:teuthology.parallel:result is None
2026-02-12T12:03:00.829 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111
2026-02-12T12:03:06.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:03:09.917 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111
2026-02-12T12:03:15.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:03:19.005 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111
2026-02-12T12:03:25.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:04:00.930 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T12:04:00.930 DEBUG:teuthology.orchestra.run.trial111:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T12:04:06.192 INFO:teuthology.provision.fog.trial111:Node is ready
2026-02-12T12:04:06.192 DEBUG:teuthology.orchestra.run.trial111:> hostname
2026-02-12T12:04:06.210 INFO:teuthology.orchestra.run.trial111.stdout:trial111.front.sepia.ceph.com
2026-02-12T12:04:06.210 DEBUG:teuthology.orchestra.run.trial111:> grep trial111.front.sepia.ceph.com /etc/hosts
2026-02-12T12:04:06.266 INFO:teuthology.orchestra.run.trial111.stdout:10.20.193.111 trial111.front.sepia.ceph.com trial111
2026-02-12T12:04:06.266 DEBUG:teuthology.orchestra.run.trial111:> sudo hostname trial111
2026-02-12T12:04:06.335 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i -e 's/trial111.front.sepia.ceph.com/trial111/g' /etc/hosts
2026-02-12T12:04:06.400 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i -e 's/10.20.193.111/10.20.193.111/g' /etc/hosts
2026-02-12T12:04:06.464 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i -e 's/trial111.front.sepia.ceph.com/trial111/g' /etc/hostname
2026-02-12T12:04:06.528 DEBUG:teuthology.orchestra.run.trial111:> sudo hostname trial111
2026-02-12T12:04:06.592 DEBUG:teuthology.orchestra.run.trial111:> cat /etc/os-release
2026-02-12T12:04:06.648 INFO:teuthology.orchestra.run.trial111.stdout:NAME="CentOS Stream"
2026-02-12T12:04:06.648 INFO:teuthology.orchestra.run.trial111.stdout:VERSION="9"
2026-02-12T12:04:06.648 INFO:teuthology.orchestra.run.trial111.stdout:ID="centos"
2026-02-12T12:04:06.648 INFO:teuthology.orchestra.run.trial111.stdout:ID_LIKE="rhel fedora"
2026-02-12T12:04:06.648 INFO:teuthology.orchestra.run.trial111.stdout:VERSION_ID="9"
2026-02-12T12:04:06.648 INFO:teuthology.orchestra.run.trial111.stdout:PLATFORM_ID="platform:el9"
2026-02-12T12:04:06.648 INFO:teuthology.orchestra.run.trial111.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T12:04:06.649 INFO:teuthology.orchestra.run.trial111.stdout:ANSI_COLOR="0;31"
2026-02-12T12:04:06.649 INFO:teuthology.orchestra.run.trial111.stdout:LOGO="fedora-logo-icon"
2026-02-12T12:04:06.649 INFO:teuthology.orchestra.run.trial111.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T12:04:06.649 INFO:teuthology.orchestra.run.trial111.stdout:HOME_URL="https://centos.org/"
2026-02-12T12:04:06.649 INFO:teuthology.orchestra.run.trial111.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T12:04:06.649 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T12:04:06.649 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T12:04:06.650 INFO:teuthology.provision.fog.trial111:Deploy complete!
2026-02-12T12:04:06.651 DEBUG:teuthology.parallel:result is None
2026-02-12T12:04:07.043 INFO:teuthology.lock.ops:Checking trial098.front.sepia.ceph.com
2026-02-12T12:04:07.043 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T12:04:07.132 INFO:teuthology.lock.ops:Checking trial111.front.sepia.ceph.com
2026-02-12T12:04:07.132 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T12:04:07.193 INFO:teuthology.lock.ops:Updating [trial098.front.sepia.ceph.com]: set os type and version on server
2026-02-12T12:04:07.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial098.front.sepia.ceph.com'
2026-02-12T12:04:07.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:04:07.253 DEBUG:teuthology.orchestra.run.trial098:> true
2026-02-12T12:04:07.334 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial098.front.sepia.ceph.com'
2026-02-12T12:04:07.335 DEBUG:teuthology.orchestra.run.trial098:> uname -m
2026-02-12T12:04:07.390 INFO:teuthology.orchestra.run.trial098.stdout:x86_64
2026-02-12T12:04:07.390 DEBUG:teuthology.orchestra.run.trial098:> cat /etc/os-release
2026-02-12T12:04:07.445 INFO:teuthology.orchestra.run.trial098.stdout:NAME="CentOS Stream"
2026-02-12T12:04:07.445 INFO:teuthology.orchestra.run.trial098.stdout:VERSION="9"
2026-02-12T12:04:07.446 INFO:teuthology.orchestra.run.trial098.stdout:ID="centos"
2026-02-12T12:04:07.446 INFO:teuthology.orchestra.run.trial098.stdout:ID_LIKE="rhel fedora"
2026-02-12T12:04:07.446 INFO:teuthology.orchestra.run.trial098.stdout:VERSION_ID="9"
2026-02-12T12:04:07.446 INFO:teuthology.orchestra.run.trial098.stdout:PLATFORM_ID="platform:el9"
2026-02-12T12:04:07.446 INFO:teuthology.orchestra.run.trial098.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T12:04:07.446 INFO:teuthology.orchestra.run.trial098.stdout:ANSI_COLOR="0;31"
2026-02-12T12:04:07.446 INFO:teuthology.orchestra.run.trial098.stdout:LOGO="fedora-logo-icon"
2026-02-12T12:04:07.446 INFO:teuthology.orchestra.run.trial098.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T12:04:07.446 INFO:teuthology.orchestra.run.trial098.stdout:HOME_URL="https://centos.org/"
2026-02-12T12:04:07.446 INFO:teuthology.orchestra.run.trial098.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T12:04:07.446 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T12:04:07.447 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T12:04:07.447 INFO:teuthology.lock.ops:Updating trial098.front.sepia.ceph.com on lock server
2026-02-12T12:04:07.549 INFO:teuthology.lock.ops:Updating [trial111.front.sepia.ceph.com]: set os type and version on server
2026-02-12T12:04:07.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com'
2026-02-12T12:04:07.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:04:07.619 DEBUG:teuthology.orchestra.run.trial111:> true
2026-02-12T12:04:07.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com'
2026-02-12T12:04:07.695 DEBUG:teuthology.orchestra.run.trial111:> uname -m
2026-02-12T12:04:07.750 INFO:teuthology.orchestra.run.trial111.stdout:x86_64
2026-02-12T12:04:07.750 DEBUG:teuthology.orchestra.run.trial111:> cat /etc/os-release
2026-02-12T12:04:07.806 INFO:teuthology.orchestra.run.trial111.stdout:NAME="CentOS Stream"
2026-02-12T12:04:07.806 INFO:teuthology.orchestra.run.trial111.stdout:VERSION="9"
2026-02-12T12:04:07.806 INFO:teuthology.orchestra.run.trial111.stdout:ID="centos"
2026-02-12T12:04:07.806 INFO:teuthology.orchestra.run.trial111.stdout:ID_LIKE="rhel fedora"
2026-02-12T12:04:07.806 INFO:teuthology.orchestra.run.trial111.stdout:VERSION_ID="9"
2026-02-12T12:04:07.806 INFO:teuthology.orchestra.run.trial111.stdout:PLATFORM_ID="platform:el9"
2026-02-12T12:04:07.806 INFO:teuthology.orchestra.run.trial111.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T12:04:07.807 INFO:teuthology.orchestra.run.trial111.stdout:ANSI_COLOR="0;31"
2026-02-12T12:04:07.807 INFO:teuthology.orchestra.run.trial111.stdout:LOGO="fedora-logo-icon"
2026-02-12T12:04:07.807 INFO:teuthology.orchestra.run.trial111.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T12:04:07.807 INFO:teuthology.orchestra.run.trial111.stdout:HOME_URL="https://centos.org/"
2026-02-12T12:04:07.807 INFO:teuthology.orchestra.run.trial111.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T12:04:07.807 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T12:04:07.807 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T12:04:07.808 INFO:teuthology.lock.ops:Updating trial111.front.sepia.ceph.com on lock server
2026-02-12T12:04:07.910 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:04:08.004 INFO:teuthology.dispatcher.supervisor:Running job 42498
2026-02-12T12:04:08.005 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/bin/teuthology -v --owner scheduled_moagrawa@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/moagrawa-2026-02-10_06:35:43-crimson-rados-main-distro-debug-trial/42498 --name moagrawa-2026-02-10_06:35:43-crimson-rados-main-distro-debug-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} -- /home/teuthworker/mnt/teuthology/moagrawa-2026-02-10_06:35:43-crimson-rados-main-distro-debug-trial/42498/orig.config.yaml
2026-02-12T12:04:08.005 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/moagrawa-2026-02-10_06:35:43-crimson-rados-main-distro-debug-trial/42498
2026-02-12T12:04:08.005 INFO:teuthology.dispatcher.supervisor:Job PID: 3783235
2026-02-12T12:04:08.005 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T12:06:08.105 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:08:08.285 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:10:08.464 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:12:08.660 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:14:08.847 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:16:09.054 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:18:09.242 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:20:09.406 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:22:09.592 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:24:09.777 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:26:09.975 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:28:10.148 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:30:10.247 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:32:10.373 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:34:10.578 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:36:10.781 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:38:10.969 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:40:11.190 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:42:11.415 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:44:11.533 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:46:11.742 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:48:11.933 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:50:12.110 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:52:12.307 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:54:12.443 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:56:12.571 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:58:12.746 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:00:12.874 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:02:13.066 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:04:13.174 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:06:13.376 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:08:13.581 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:10:13.782 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:12:13.959 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:14:14.112 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:16:14.227 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:18:14.386 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:18:14.484 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-12T13:18:14.600 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T13:18:15.087 INFO:teuthology.orchestra.console.trial111:Power off
2026-02-12T13:18:15.087 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T13:18:15.105 INFO:teuthology.orchestra.console.trial098:Power off
2026-02-12T13:18:15.105 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T13:18:15.126 DEBUG:teuthology.orchestra.console.trial111:power off output: Chassis Power Control: Down/Off
2026-02-12T13:18:15.143 DEBUG:teuthology.orchestra.console.trial098:power off output: Chassis Power Control: Down/Off
2026-02-12T13:18:19.130 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T13:18:19.143 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T13:18:19.238 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is on
2026-02-12T13:18:19.251 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is on
2026-02-12T13:18:23.243 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T13:18:23.252 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T13:18:23.353 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is off
2026-02-12T13:18:23.354 INFO:teuthology.orchestra.console.trial111:Power off completed
2026-02-12T13:18:23.361 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is off
2026-02-12T13:18:23.361 INFO:teuthology.orchestra.console.trial098:Power off completed
2026-02-12T13:18:23.596 INFO:teuthology.lock.ops:unlocked: trial111.front.sepia.ceph.com
2026-02-12T13:18:23.610 INFO:teuthology.lock.ops:unlocked: trial098.front.sepia.ceph.com