2026-02-25T07:57:49.585 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-25T07:57:49.585 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T07:57:49.670 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T07:57:49.860 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7a4bd9b86150>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7a4bd932a3e0>, signals=[15])
2026-02-25T07:57:49.860 INFO:teuthology.lock.ops:Start node 'trial169.front.sepia.ceph.com' reimaging
2026-02-25T07:57:49.860 INFO:teuthology.lock.ops:Updating [trial169.front.sepia.ceph.com]: reset os type and version on server
2026-02-25T07:57:49.860 INFO:teuthology.lock.ops:Updating trial169.front.sepia.ceph.com on lock server
2026-02-25T07:57:49.917 INFO:teuthology.lock.ops:Start node 'trial183.front.sepia.ceph.com' reimaging
2026-02-25T07:57:49.917 INFO:teuthology.lock.ops:Updating [trial183.front.sepia.ceph.com]: reset os type and version on server
2026-02-25T07:57:49.917 INFO:teuthology.lock.ops:Updating trial183.front.sepia.ceph.com on lock server
2026-02-25T07:57:50.112 DEBUG:teuthology.provision.fog.trial169:Requesting image trial_centos_9.stream (ID 3)
2026-02-25T07:57:50.114 DEBUG:teuthology.provision.fog.trial183:Requesting image trial_centos_9.stream (ID 3)
2026-02-25T07:57:50.136 INFO:teuthology.provision.fog.trial169:Scheduling deploy of centos 9.stream
2026-02-25T07:57:50.140 INFO:teuthology.provision.fog.trial183:Scheduling deploy of centos 9.stream
2026-02-25T07:57:54.407 INFO:teuthology.orchestra.console.trial183:Power off
2026-02-25T07:57:54.407 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T07:57:54.418 INFO:teuthology.orchestra.console.trial169:Power off
2026-02-25T07:57:54.418 DEBUG:teuthology.orchestra.console.trial169:pexpect command: ipmitool -H trial169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T07:57:54.450 DEBUG:teuthology.orchestra.console.trial183:power off output: Chassis Power Control: Down/Off
2026-02-25T07:57:54.456 DEBUG:teuthology.orchestra.console.trial169:power off output: Chassis Power Control: Down/Off
2026-02-25T07:57:58.455 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T07:57:58.461 DEBUG:teuthology.orchestra.console.trial169:pexpect command: ipmitool -H trial169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T07:57:58.564 DEBUG:teuthology.orchestra.console.trial183:check power output: Chassis Power is off
2026-02-25T07:57:58.564 INFO:teuthology.orchestra.console.trial183:Power off completed
2026-02-25T07:57:58.568 DEBUG:teuthology.orchestra.console.trial169:check power output: Chassis Power is off
2026-02-25T07:57:58.568 INFO:teuthology.orchestra.console.trial169:Power off completed
2026-02-25T07:57:58.666 INFO:teuthology.orchestra.console.trial183:Power on
2026-02-25T07:57:58.666 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-25T07:57:58.673 INFO:teuthology.orchestra.console.trial169:Power on
2026-02-25T07:57:58.674 DEBUG:teuthology.orchestra.console.trial169:pexpect command: ipmitool -H trial169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-25T07:57:58.704 DEBUG:teuthology.orchestra.console.trial183:power on output: Chassis Power Control: Up/On
2026-02-25T07:57:58.711 DEBUG:teuthology.orchestra.console.trial169:power on output: Chassis Power Control: Up/On
2026-02-25T07:58:02.709 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T07:58:02.714 DEBUG:teuthology.orchestra.console.trial169:pexpect command: ipmitool -H trial169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T07:58:02.815 DEBUG:teuthology.orchestra.console.trial183:check power output: Chassis Power is on
2026-02-25T07:58:02.816 INFO:teuthology.orchestra.console.trial183:Power on completed
2026-02-25T07:58:02.820 DEBUG:teuthology.orchestra.console.trial169:check power output: Chassis Power is on
2026-02-25T07:58:02.820 INFO:teuthology.orchestra.console.trial169:Power on completed
2026-02-25T07:58:02.916 INFO:teuthology.provision.fog.trial183:Waiting for deploy to finish
2026-02-25T07:58:02.921 INFO:teuthology.provision.fog.trial169:Waiting for deploy to finish
2026-02-25T08:01:37.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T08:01:40.544 WARNING:teuthology.provision.fog.trial169:[Errno None] Unable to connect to port 22 on 10.20.193.169
2026-02-25T08:01:46.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T08:01:49.633 WARNING:teuthology.provision.fog.trial169:[Errno None] Unable to connect to port 22 on 10.20.193.169
2026-02-25T08:01:55.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T08:01:58.720 WARNING:teuthology.provision.fog.trial169:[Errno None] Unable to connect to port 22 on 10.20.193.169
2026-02-25T08:02:04.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T08:02:07.808 WARNING:teuthology.provision.fog.trial169:[Errno None] Unable to connect to port 22 on 10.20.193.169
2026-02-25T08:02:09.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T08:02:12.928 WARNING:teuthology.provision.fog.trial183:[Errno None] Unable to connect to port 22 on 10.20.193.183
2026-02-25T08:02:13.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T08:02:18.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T08:02:22.016 WARNING:teuthology.provision.fog.trial183:[Errno None] Unable to connect to port 22 on 10.20.193.183
2026-02-25T08:02:28.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T08:02:31.104 WARNING:teuthology.provision.fog.trial183:[Errno None] Unable to connect to port 22 on 10.20.193.183
2026-02-25T08:02:37.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T08:02:40.191 WARNING:teuthology.provision.fog.trial183:[Errno None] Unable to connect to port 22 on 10.20.193.183
2026-02-25T08:02:46.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T08:02:49.977 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-25T08:02:49.978 DEBUG:teuthology.orchestra.run.trial169:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-25T08:02:50.138 INFO:teuthology.provision.fog.trial169:Node is ready
2026-02-25T08:02:50.138 DEBUG:teuthology.orchestra.run.trial169:> hostname
2026-02-25T08:02:50.193 INFO:teuthology.orchestra.run.trial169.stdout:trial169.front.sepia.ceph.com
2026-02-25T08:02:50.194 DEBUG:teuthology.orchestra.run.trial169:> grep trial169.front.sepia.ceph.com /etc/hosts
2026-02-25T08:02:50.249 INFO:teuthology.orchestra.run.trial169.stdout:10.20.193.169 trial169.front.sepia.ceph.com trial169
2026-02-25T08:02:50.250 DEBUG:teuthology.orchestra.run.trial169:> sudo hostname trial169
2026-02-25T08:02:50.319 DEBUG:teuthology.orchestra.run.trial169:> sudo sed -i -e 's/trial169.front.sepia.ceph.com/trial169/g' /etc/hosts
2026-02-25T08:02:50.384 DEBUG:teuthology.orchestra.run.trial169:> sudo sed -i -e 's/10.20.193.169/10.20.193.169/g' /etc/hosts
2026-02-25T08:02:50.447 DEBUG:teuthology.orchestra.run.trial169:> sudo sed -i -e 's/trial169.front.sepia.ceph.com/trial169/g' /etc/hostname
2026-02-25T08:02:50.512 DEBUG:teuthology.orchestra.run.trial169:> sudo hostname trial169
2026-02-25T08:02:50.575 DEBUG:teuthology.orchestra.run.trial169:> cat /etc/os-release
2026-02-25T08:02:50.631 INFO:teuthology.orchestra.run.trial169.stdout:NAME="CentOS Stream"
2026-02-25T08:02:50.631 INFO:teuthology.orchestra.run.trial169.stdout:VERSION="9"
2026-02-25T08:02:50.631 INFO:teuthology.orchestra.run.trial169.stdout:ID="centos"
2026-02-25T08:02:50.632 INFO:teuthology.orchestra.run.trial169.stdout:ID_LIKE="rhel fedora"
2026-02-25T08:02:50.632 INFO:teuthology.orchestra.run.trial169.stdout:VERSION_ID="9"
2026-02-25T08:02:50.632 INFO:teuthology.orchestra.run.trial169.stdout:PLATFORM_ID="platform:el9"
2026-02-25T08:02:50.632 INFO:teuthology.orchestra.run.trial169.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-25T08:02:50.632 INFO:teuthology.orchestra.run.trial169.stdout:ANSI_COLOR="0;31"
2026-02-25T08:02:50.632 INFO:teuthology.orchestra.run.trial169.stdout:LOGO="fedora-logo-icon"
2026-02-25T08:02:50.632 INFO:teuthology.orchestra.run.trial169.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-25T08:02:50.632 INFO:teuthology.orchestra.run.trial169.stdout:HOME_URL="https://centos.org/"
2026-02-25T08:02:50.632 INFO:teuthology.orchestra.run.trial169.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-25T08:02:50.633 INFO:teuthology.orchestra.run.trial169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-25T08:02:50.633 INFO:teuthology.orchestra.run.trial169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-25T08:02:50.634 INFO:teuthology.provision.fog.trial169:Deploy complete!
2026-02-25T08:02:50.636 DEBUG:teuthology.parallel:result is None
2026-02-25T08:03:22.237 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-25T08:03:22.237 DEBUG:teuthology.orchestra.run.trial183:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-25T08:03:22.466 INFO:teuthology.provision.fog.trial183:Node is ready
2026-02-25T08:03:22.466 DEBUG:teuthology.orchestra.run.trial183:> hostname
2026-02-25T08:03:22.519 INFO:teuthology.orchestra.run.trial183.stdout:trial183.front.sepia.ceph.com
2026-02-25T08:03:22.519 DEBUG:teuthology.orchestra.run.trial183:> grep trial183.front.sepia.ceph.com /etc/hosts
2026-02-25T08:03:22.572 INFO:teuthology.orchestra.run.trial183.stdout:10.20.193.183 trial183.front.sepia.ceph.com trial183
2026-02-25T08:03:22.573 DEBUG:teuthology.orchestra.run.trial183:> sudo hostname trial183
2026-02-25T08:03:22.641 DEBUG:teuthology.orchestra.run.trial183:> sudo sed -i -e 's/trial183.front.sepia.ceph.com/trial183/g' /etc/hosts
2026-02-25T08:03:22.703 DEBUG:teuthology.orchestra.run.trial183:> sudo sed -i -e 's/10.20.193.183/10.20.193.183/g' /etc/hosts
2026-02-25T08:03:22.766 DEBUG:teuthology.orchestra.run.trial183:> sudo sed -i -e 's/trial183.front.sepia.ceph.com/trial183/g' /etc/hostname
2026-02-25T08:03:22.829 DEBUG:teuthology.orchestra.run.trial183:> sudo hostname trial183
2026-02-25T08:03:22.904 DEBUG:teuthology.orchestra.run.trial183:> cat /etc/os-release
2026-02-25T08:03:22.959 INFO:teuthology.orchestra.run.trial183.stdout:NAME="CentOS Stream"
2026-02-25T08:03:22.959 INFO:teuthology.orchestra.run.trial183.stdout:VERSION="9"
2026-02-25T08:03:22.960 INFO:teuthology.orchestra.run.trial183.stdout:ID="centos"
2026-02-25T08:03:22.960 INFO:teuthology.orchestra.run.trial183.stdout:ID_LIKE="rhel fedora"
2026-02-25T08:03:22.960 INFO:teuthology.orchestra.run.trial183.stdout:VERSION_ID="9"
2026-02-25T08:03:22.960 INFO:teuthology.orchestra.run.trial183.stdout:PLATFORM_ID="platform:el9"
2026-02-25T08:03:22.960 INFO:teuthology.orchestra.run.trial183.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-25T08:03:22.960 INFO:teuthology.orchestra.run.trial183.stdout:ANSI_COLOR="0;31"
2026-02-25T08:03:22.960 INFO:teuthology.orchestra.run.trial183.stdout:LOGO="fedora-logo-icon"
2026-02-25T08:03:22.960 INFO:teuthology.orchestra.run.trial183.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-25T08:03:22.960 INFO:teuthology.orchestra.run.trial183.stdout:HOME_URL="https://centos.org/"
2026-02-25T08:03:22.961 INFO:teuthology.orchestra.run.trial183.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-25T08:03:22.961 INFO:teuthology.orchestra.run.trial183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-25T08:03:22.961 INFO:teuthology.orchestra.run.trial183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-25T08:03:22.961 INFO:teuthology.provision.fog.trial183:Deploy complete!
2026-02-25T08:03:22.962 DEBUG:teuthology.parallel:result is None
2026-02-25T08:03:23.388 INFO:teuthology.lock.ops:Checking trial169.front.sepia.ceph.com
2026-02-25T08:03:23.389 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-25T08:03:23.493 INFO:teuthology.lock.ops:Checking trial183.front.sepia.ceph.com
2026-02-25T08:03:23.493 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-25T08:03:23.556 INFO:teuthology.lock.ops:Updating [trial169.front.sepia.ceph.com]: set os type and version on server
2026-02-25T08:03:23.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial169.front.sepia.ceph.com'
2026-02-25T08:03:23.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T08:03:23.621 DEBUG:teuthology.orchestra.run.trial169:> true
2026-02-25T08:03:23.767 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial169.front.sepia.ceph.com'
2026-02-25T08:03:23.767 DEBUG:teuthology.orchestra.run.trial169:> uname -m
2026-02-25T08:03:23.823 INFO:teuthology.orchestra.run.trial169.stdout:x86_64
2026-02-25T08:03:23.823 DEBUG:teuthology.orchestra.run.trial169:> cat /etc/os-release
2026-02-25T08:03:23.881 INFO:teuthology.orchestra.run.trial169.stdout:NAME="CentOS Stream"
2026-02-25T08:03:23.881 INFO:teuthology.orchestra.run.trial169.stdout:VERSION="9"
2026-02-25T08:03:23.881 INFO:teuthology.orchestra.run.trial169.stdout:ID="centos"
2026-02-25T08:03:23.881 INFO:teuthology.orchestra.run.trial169.stdout:ID_LIKE="rhel fedora"
2026-02-25T08:03:23.881 INFO:teuthology.orchestra.run.trial169.stdout:VERSION_ID="9"
2026-02-25T08:03:23.881 INFO:teuthology.orchestra.run.trial169.stdout:PLATFORM_ID="platform:el9"
2026-02-25T08:03:23.881 INFO:teuthology.orchestra.run.trial169.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-25T08:03:23.881 INFO:teuthology.orchestra.run.trial169.stdout:ANSI_COLOR="0;31"
2026-02-25T08:03:23.881 INFO:teuthology.orchestra.run.trial169.stdout:LOGO="fedora-logo-icon"
2026-02-25T08:03:23.881 INFO:teuthology.orchestra.run.trial169.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-25T08:03:23.881 INFO:teuthology.orchestra.run.trial169.stdout:HOME_URL="https://centos.org/"
2026-02-25T08:03:23.882 INFO:teuthology.orchestra.run.trial169.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-25T08:03:23.882 INFO:teuthology.orchestra.run.trial169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-25T08:03:23.882 INFO:teuthology.orchestra.run.trial169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-25T08:03:23.882 INFO:teuthology.lock.ops:Updating trial169.front.sepia.ceph.com on lock server
2026-02-25T08:03:23.982 INFO:teuthology.lock.ops:Updating [trial183.front.sepia.ceph.com]: set os type and version on server
2026-02-25T08:03:23.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial183.front.sepia.ceph.com'
2026-02-25T08:03:23.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T08:03:24.061 DEBUG:teuthology.orchestra.run.trial183:> true
2026-02-25T08:03:24.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial183.front.sepia.ceph.com'
2026-02-25T08:03:24.137 DEBUG:teuthology.orchestra.run.trial183:> uname -m
2026-02-25T08:03:24.190 INFO:teuthology.orchestra.run.trial183.stdout:x86_64
2026-02-25T08:03:24.190 DEBUG:teuthology.orchestra.run.trial183:> cat /etc/os-release
2026-02-25T08:03:24.244 INFO:teuthology.orchestra.run.trial183.stdout:NAME="CentOS Stream"
2026-02-25T08:03:24.244 INFO:teuthology.orchestra.run.trial183.stdout:VERSION="9"
2026-02-25T08:03:24.244 INFO:teuthology.orchestra.run.trial183.stdout:ID="centos"
2026-02-25T08:03:24.244 INFO:teuthology.orchestra.run.trial183.stdout:ID_LIKE="rhel fedora"
2026-02-25T08:03:24.244 INFO:teuthology.orchestra.run.trial183.stdout:VERSION_ID="9"
2026-02-25T08:03:24.244 INFO:teuthology.orchestra.run.trial183.stdout:PLATFORM_ID="platform:el9"
2026-02-25T08:03:24.244 INFO:teuthology.orchestra.run.trial183.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-25T08:03:24.244 INFO:teuthology.orchestra.run.trial183.stdout:ANSI_COLOR="0;31"
2026-02-25T08:03:24.244 INFO:teuthology.orchestra.run.trial183.stdout:LOGO="fedora-logo-icon"
2026-02-25T08:03:24.244 INFO:teuthology.orchestra.run.trial183.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-25T08:03:24.244 INFO:teuthology.orchestra.run.trial183.stdout:HOME_URL="https://centos.org/"
2026-02-25T08:03:24.244 INFO:teuthology.orchestra.run.trial183.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-25T08:03:24.244 INFO:teuthology.orchestra.run.trial183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-25T08:03:24.244 INFO:teuthology.orchestra.run.trial183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-25T08:03:24.245 INFO:teuthology.lock.ops:Updating trial183.front.sepia.ceph.com on lock server
2026-02-25T08:03:24.310 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:03:24.401 INFO:teuthology.dispatcher.supervisor:Running job 69078
2026-02-25T08:03:24.401 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_matan@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/matan-2026-02-25_07:55:35-crimson-rados-wip-logstoremanager-distro-debug-trial/69078 --name matan-2026-02-25_07:55:35-crimson-rados-wip-logstoremanager-distro-debug-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{default} thrashosds-health workloads/snaps-few-objects-balanced} -- /home/teuthworker/mnt/teuthology/matan-2026-02-25_07:55:35-crimson-rados-wip-logstoremanager-distro-debug-trial/69078/orig.config.yaml
2026-02-25T08:03:24.401 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/matan-2026-02-25_07:55:35-crimson-rados-wip-logstoremanager-distro-debug-trial/69078
2026-02-25T08:03:24.401 INFO:teuthology.dispatcher.supervisor:Job PID: 3412153
2026-02-25T08:03:24.401 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-25T08:05:24.501 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:07:24.674 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:09:24.829 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:11:24.989 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:13:25.175 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:15:25.371 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:17:25.505 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:19:25.695 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:21:25.901 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:23:26.100 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:25:26.290 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:27:26.494 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:29:26.601 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:31:26.774 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:33:26.978 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:35:27.187 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:37:27.328 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:39:27.473 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:41:27.670 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:43:27.856 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:45:28.064 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:47:28.273 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:49:28.481 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:51:28.636 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:53:28.822 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:53:28.906 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-25T08:53:29.023 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-25T08:53:29.568 INFO:teuthology.orchestra.console.trial183:Power off
2026-02-25T08:53:29.569 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T08:53:29.579 INFO:teuthology.orchestra.console.trial169:Power off
2026-02-25T08:53:29.579 DEBUG:teuthology.orchestra.console.trial169:pexpect command: ipmitool -H trial169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T08:53:29.607 DEBUG:teuthology.orchestra.console.trial183:power off output: Chassis Power Control: Down/Off
2026-02-25T08:53:29.617 DEBUG:teuthology.orchestra.console.trial169:power off output: Chassis Power Control: Down/Off
2026-02-25T08:53:33.612 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T08:53:33.618 DEBUG:teuthology.orchestra.console.trial169:pexpect command: ipmitool -H trial169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T08:53:33.721 DEBUG:teuthology.orchestra.console.trial183:check power output: Chassis Power is on
2026-02-25T08:53:33.727 DEBUG:teuthology.orchestra.console.trial169:check power output: Chassis Power is on
2026-02-25T08:53:37.726 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T08:53:37.733 DEBUG:teuthology.orchestra.console.trial169:pexpect command: ipmitool -H trial169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T08:53:37.836 DEBUG:teuthology.orchestra.console.trial183:check power output: Chassis Power is off
2026-02-25T08:53:37.836 INFO:teuthology.orchestra.console.trial183:Power off completed
2026-02-25T08:53:37.840 DEBUG:teuthology.orchestra.console.trial169:check power output: Chassis Power is off
2026-02-25T08:53:37.840 INFO:teuthology.orchestra.console.trial169:Power off completed
2026-02-25T08:53:38.097 INFO:teuthology.lock.ops:unlocked: trial183.front.sepia.ceph.com
2026-02-25T08:53:38.100 INFO:teuthology.lock.ops:unlocked: trial169.front.sepia.ceph.com