2026-02-12T08:33:33.420 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062
2026-02-12T08:33:33.420 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:33:33.501 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:33:33.686 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x75eb95e42870>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x75eb9568a340>, signals=[15])
2026-02-12T08:33:33.686 INFO:teuthology.lock.ops:Start node 'trial049.front.sepia.ceph.com' reimaging
2026-02-12T08:33:33.686 INFO:teuthology.lock.ops:Updating [trial049.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T08:33:33.686 INFO:teuthology.lock.ops:Updating trial049.front.sepia.ceph.com on lock server
2026-02-12T08:33:33.742 INFO:teuthology.lock.ops:Start node 'trial060.front.sepia.ceph.com' reimaging
2026-02-12T08:33:33.742 INFO:teuthology.lock.ops:Updating [trial060.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T08:33:33.742 INFO:teuthology.lock.ops:Updating trial060.front.sepia.ceph.com on lock server
2026-02-12T08:33:33.976 DEBUG:teuthology.provision.fog.trial049:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T08:33:33.981 DEBUG:teuthology.provision.fog.trial060:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T08:33:34.004 INFO:teuthology.provision.fog.trial049:Scheduling deploy of centos 9.stream
2026-02-12T08:33:34.033 INFO:teuthology.provision.fog.trial060:Scheduling deploy of centos 9.stream
2026-02-12T08:33:35.061 INFO:teuthology.orchestra.console.trial049:Power off
2026-02-12T08:33:35.061 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T08:33:35.080 INFO:teuthology.orchestra.console.trial060:Power off
2026-02-12T08:33:35.080 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T08:33:35.107 DEBUG:teuthology.orchestra.console.trial049:power off output: Chassis Power Control: Down/Off
2026-02-12T08:33:35.116 DEBUG:teuthology.orchestra.console.trial060:power off output: Chassis Power Control: Down/Off
2026-02-12T08:33:39.112 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T08:33:39.119 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T08:33:39.220 DEBUG:teuthology.orchestra.console.trial049:check power output: Chassis Power is off
2026-02-12T08:33:39.221 INFO:teuthology.orchestra.console.trial049:Power off completed
2026-02-12T08:33:39.225 DEBUG:teuthology.orchestra.console.trial060:check power output: Chassis Power is off
2026-02-12T08:33:39.225 INFO:teuthology.orchestra.console.trial060:Power off completed
2026-02-12T08:33:39.322 INFO:teuthology.orchestra.console.trial049:Power on
2026-02-12T08:33:39.322 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T08:33:39.329 INFO:teuthology.orchestra.console.trial060:Power on
2026-02-12T08:33:39.329 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T08:33:39.363 DEBUG:teuthology.orchestra.console.trial049:power on output: Chassis Power Control: Up/On
2026-02-12T08:33:39.366 DEBUG:teuthology.orchestra.console.trial060:power on output: Chassis Power Control: Up/On
2026-02-12T08:33:43.367 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T08:33:43.375 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T08:33:43.478 DEBUG:teuthology.orchestra.console.trial049:check power output: Chassis Power is off
2026-02-12T08:33:43.484 DEBUG:teuthology.orchestra.console.trial060:check power output: Chassis Power is on
2026-02-12T08:33:43.484 INFO:teuthology.orchestra.console.trial060:Power on completed
2026-02-12T08:33:43.584 INFO:teuthology.provision.fog.trial060:Waiting for deploy to finish
2026-02-12T08:33:47.483 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T08:33:47.591 DEBUG:teuthology.orchestra.console.trial049:check power output: Chassis Power is on
2026-02-12T08:33:47.591 INFO:teuthology.orchestra.console.trial049:Power on completed
2026-02-12T08:33:47.692 INFO:teuthology.provision.fog.trial049:Waiting for deploy to finish
2026-02-12T08:35:30.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:35:33.597 WARNING:teuthology.provision.fog.trial060:[Errno None] Unable to connect to port 22 on 10.20.193.60
2026-02-12T08:35:34.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:35:37.757 WARNING:teuthology.provision.fog.trial049:[Errno None] Unable to connect to port 22 on 10.20.193.49
2026-02-12T08:35:39.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:35:42.685 WARNING:teuthology.provision.fog.trial060:[Errno None] Unable to connect to port 22 on 10.20.193.60
2026-02-12T08:35:43.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:35:46.845 WARNING:teuthology.provision.fog.trial049:[Errno None] Unable to connect to port 22 on 10.20.193.49
2026-02-12T08:35:48.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:35:51.773 WARNING:teuthology.provision.fog.trial060:[Errno None] Unable to connect to port 22 on 10.20.193.60
2026-02-12T08:35:52.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:35:55.933 WARNING:teuthology.provision.fog.trial049:[Errno None] Unable to connect to port 22 on 10.20.193.49
2026-02-12T08:35:57.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:36:00.861 WARNING:teuthology.provision.fog.trial060:[Errno None] Unable to connect to port 22 on 10.20.193.60
2026-02-12T08:36:01.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:36:05.021 WARNING:teuthology.provision.fog.trial049:[Errno None] Unable to connect to port 22 on 10.20.193.49
2026-02-12T08:36:06.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:36:11.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:36:42.910 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T08:36:42.911 DEBUG:teuthology.orchestra.run.trial060:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T08:36:43.069 INFO:teuthology.provision.fog.trial060:Node is ready
2026-02-12T08:36:43.069 DEBUG:teuthology.orchestra.run.trial060:> hostname
2026-02-12T08:36:43.125 INFO:teuthology.orchestra.run.trial060.stdout:trial060.front.sepia.ceph.com
2026-02-12T08:36:43.126 DEBUG:teuthology.orchestra.run.trial060:> grep trial060.front.sepia.ceph.com /etc/hosts
2026-02-12T08:36:43.182 INFO:teuthology.orchestra.run.trial060.stdout:10.20.193.60 trial060.front.sepia.ceph.com trial060
2026-02-12T08:36:43.183 DEBUG:teuthology.orchestra.run.trial060:> sudo hostname trial060
2026-02-12T08:36:43.251 DEBUG:teuthology.orchestra.run.trial060:> sudo sed -i -e 's/trial060.front.sepia.ceph.com/trial060/g' /etc/hosts
2026-02-12T08:36:43.317 DEBUG:teuthology.orchestra.run.trial060:> sudo sed -i -e 's/10.20.193.60/10.20.193.60/g' /etc/hosts
2026-02-12T08:36:43.380 DEBUG:teuthology.orchestra.run.trial060:> sudo sed -i -e 's/trial060.front.sepia.ceph.com/trial060/g' /etc/hostname
2026-02-12T08:36:43.445 DEBUG:teuthology.orchestra.run.trial060:> sudo hostname trial060
2026-02-12T08:36:43.509 DEBUG:teuthology.orchestra.run.trial060:> cat /etc/os-release
2026-02-12T08:36:43.564 INFO:teuthology.orchestra.run.trial060.stdout:NAME="CentOS Stream"
2026-02-12T08:36:43.565 INFO:teuthology.orchestra.run.trial060.stdout:VERSION="9"
2026-02-12T08:36:43.565 INFO:teuthology.orchestra.run.trial060.stdout:ID="centos"
2026-02-12T08:36:43.565 INFO:teuthology.orchestra.run.trial060.stdout:ID_LIKE="rhel fedora"
2026-02-12T08:36:43.565 INFO:teuthology.orchestra.run.trial060.stdout:VERSION_ID="9"
2026-02-12T08:36:43.565 INFO:teuthology.orchestra.run.trial060.stdout:PLATFORM_ID="platform:el9"
2026-02-12T08:36:43.565 INFO:teuthology.orchestra.run.trial060.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T08:36:43.565 INFO:teuthology.orchestra.run.trial060.stdout:ANSI_COLOR="0;31"
2026-02-12T08:36:43.565 INFO:teuthology.orchestra.run.trial060.stdout:LOGO="fedora-logo-icon"
2026-02-12T08:36:43.565 INFO:teuthology.orchestra.run.trial060.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T08:36:43.565 INFO:teuthology.orchestra.run.trial060.stdout:HOME_URL="https://centos.org/"
2026-02-12T08:36:43.566 INFO:teuthology.orchestra.run.trial060.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T08:36:43.566 INFO:teuthology.orchestra.run.trial060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T08:36:43.566 INFO:teuthology.orchestra.run.trial060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T08:36:43.567 INFO:teuthology.provision.fog.trial060:Deploy complete!
2026-02-12T08:36:43.568 DEBUG:teuthology.parallel:result is None
2026-02-12T08:36:47.011 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T08:36:47.011 DEBUG:teuthology.orchestra.run.trial049:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T08:36:47.156 INFO:teuthology.provision.fog.trial049:Node is ready
2026-02-12T08:36:47.156 DEBUG:teuthology.orchestra.run.trial049:> hostname
2026-02-12T08:36:47.211 INFO:teuthology.orchestra.run.trial049.stdout:trial049.front.sepia.ceph.com
2026-02-12T08:36:47.211 DEBUG:teuthology.orchestra.run.trial049:> grep trial049.front.sepia.ceph.com /etc/hosts
2026-02-12T08:36:47.267 INFO:teuthology.orchestra.run.trial049.stdout:10.20.193.49 trial049.front.sepia.ceph.com trial049
2026-02-12T08:36:47.267 DEBUG:teuthology.orchestra.run.trial049:> sudo hostname trial049
2026-02-12T08:36:47.336 DEBUG:teuthology.orchestra.run.trial049:> sudo sed -i -e 's/trial049.front.sepia.ceph.com/trial049/g' /etc/hosts
2026-02-12T08:36:47.401 DEBUG:teuthology.orchestra.run.trial049:> sudo sed -i -e 's/10.20.193.49/10.20.193.49/g' /etc/hosts
2026-02-12T08:36:47.464 DEBUG:teuthology.orchestra.run.trial049:> sudo sed -i -e 's/trial049.front.sepia.ceph.com/trial049/g' /etc/hostname
2026-02-12T08:36:47.528 DEBUG:teuthology.orchestra.run.trial049:> sudo hostname trial049
2026-02-12T08:36:47.592 DEBUG:teuthology.orchestra.run.trial049:> cat /etc/os-release
2026-02-12T08:36:47.647 INFO:teuthology.orchestra.run.trial049.stdout:NAME="CentOS Stream"
2026-02-12T08:36:47.647 INFO:teuthology.orchestra.run.trial049.stdout:VERSION="9"
2026-02-12T08:36:47.648 INFO:teuthology.orchestra.run.trial049.stdout:ID="centos"
2026-02-12T08:36:47.648 INFO:teuthology.orchestra.run.trial049.stdout:ID_LIKE="rhel fedora"
2026-02-12T08:36:47.648 INFO:teuthology.orchestra.run.trial049.stdout:VERSION_ID="9"
2026-02-12T08:36:47.648 INFO:teuthology.orchestra.run.trial049.stdout:PLATFORM_ID="platform:el9"
2026-02-12T08:36:47.648 INFO:teuthology.orchestra.run.trial049.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T08:36:47.648 INFO:teuthology.orchestra.run.trial049.stdout:ANSI_COLOR="0;31"
2026-02-12T08:36:47.648 INFO:teuthology.orchestra.run.trial049.stdout:LOGO="fedora-logo-icon"
2026-02-12T08:36:47.648 INFO:teuthology.orchestra.run.trial049.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T08:36:47.648 INFO:teuthology.orchestra.run.trial049.stdout:HOME_URL="https://centos.org/"
2026-02-12T08:36:47.648 INFO:teuthology.orchestra.run.trial049.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T08:36:47.648 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T08:36:47.649 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T08:36:47.649 INFO:teuthology.provision.fog.trial049:Deploy complete!
2026-02-12T08:36:47.650 DEBUG:teuthology.parallel:result is None
2026-02-12T08:36:48.065 INFO:teuthology.lock.ops:Checking trial049.front.sepia.ceph.com
2026-02-12T08:36:48.066 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T08:36:48.172 INFO:teuthology.lock.ops:Checking trial060.front.sepia.ceph.com
2026-02-12T08:36:48.172 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T08:36:48.234 INFO:teuthology.lock.ops:Updating [trial049.front.sepia.ceph.com]: set os type and version on server
2026-02-12T08:36:48.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com'
2026-02-12T08:36:48.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:36:48.296 DEBUG:teuthology.orchestra.run.trial049:> true
2026-02-12T08:36:48.371 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com'
2026-02-12T08:36:48.371 DEBUG:teuthology.orchestra.run.trial049:> uname -m
2026-02-12T08:36:48.427 INFO:teuthology.orchestra.run.trial049.stdout:x86_64
2026-02-12T08:36:48.427 DEBUG:teuthology.orchestra.run.trial049:> cat /etc/os-release
2026-02-12T08:36:48.483 INFO:teuthology.orchestra.run.trial049.stdout:NAME="CentOS Stream"
2026-02-12T08:36:48.484 INFO:teuthology.orchestra.run.trial049.stdout:VERSION="9"
2026-02-12T08:36:48.484 INFO:teuthology.orchestra.run.trial049.stdout:ID="centos"
2026-02-12T08:36:48.484 INFO:teuthology.orchestra.run.trial049.stdout:ID_LIKE="rhel fedora"
2026-02-12T08:36:48.484 INFO:teuthology.orchestra.run.trial049.stdout:VERSION_ID="9"
2026-02-12T08:36:48.484 INFO:teuthology.orchestra.run.trial049.stdout:PLATFORM_ID="platform:el9"
2026-02-12T08:36:48.484 INFO:teuthology.orchestra.run.trial049.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T08:36:48.484 INFO:teuthology.orchestra.run.trial049.stdout:ANSI_COLOR="0;31"
2026-02-12T08:36:48.484 INFO:teuthology.orchestra.run.trial049.stdout:LOGO="fedora-logo-icon"
2026-02-12T08:36:48.484 INFO:teuthology.orchestra.run.trial049.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T08:36:48.484 INFO:teuthology.orchestra.run.trial049.stdout:HOME_URL="https://centos.org/"
2026-02-12T08:36:48.484 INFO:teuthology.orchestra.run.trial049.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T08:36:48.485 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T08:36:48.485 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T08:36:48.485 INFO:teuthology.lock.ops:Updating trial049.front.sepia.ceph.com on lock server
2026-02-12T08:36:48.588 INFO:teuthology.lock.ops:Updating [trial060.front.sepia.ceph.com]: set os type and version on server
2026-02-12T08:36:48.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial060.front.sepia.ceph.com'
2026-02-12T08:36:48.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T08:36:48.656 DEBUG:teuthology.orchestra.run.trial060:> true
2026-02-12T08:36:48.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial060.front.sepia.ceph.com'
2026-02-12T08:36:48.730 DEBUG:teuthology.orchestra.run.trial060:> uname -m
2026-02-12T08:36:48.786 INFO:teuthology.orchestra.run.trial060.stdout:x86_64
2026-02-12T08:36:48.786 DEBUG:teuthology.orchestra.run.trial060:> cat /etc/os-release
2026-02-12T08:36:48.842 INFO:teuthology.orchestra.run.trial060.stdout:NAME="CentOS Stream"
2026-02-12T08:36:48.842 INFO:teuthology.orchestra.run.trial060.stdout:VERSION="9"
2026-02-12T08:36:48.843 INFO:teuthology.orchestra.run.trial060.stdout:ID="centos"
2026-02-12T08:36:48.843 INFO:teuthology.orchestra.run.trial060.stdout:ID_LIKE="rhel fedora"
2026-02-12T08:36:48.843 INFO:teuthology.orchestra.run.trial060.stdout:VERSION_ID="9"
2026-02-12T08:36:48.843 INFO:teuthology.orchestra.run.trial060.stdout:PLATFORM_ID="platform:el9"
2026-02-12T08:36:48.843 INFO:teuthology.orchestra.run.trial060.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T08:36:48.843 INFO:teuthology.orchestra.run.trial060.stdout:ANSI_COLOR="0;31"
2026-02-12T08:36:48.843 INFO:teuthology.orchestra.run.trial060.stdout:LOGO="fedora-logo-icon"
2026-02-12T08:36:48.843 INFO:teuthology.orchestra.run.trial060.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T08:36:48.843 INFO:teuthology.orchestra.run.trial060.stdout:HOME_URL="https://centos.org/"
2026-02-12T08:36:48.843 INFO:teuthology.orchestra.run.trial060.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T08:36:48.843 INFO:teuthology.orchestra.run.trial060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T08:36:48.844 INFO:teuthology.orchestra.run.trial060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T08:36:48.844 INFO:teuthology.lock.ops:Updating trial060.front.sepia.ceph.com on lock server
2026-02-12T08:36:48.947 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:36:49.040 INFO:teuthology.dispatcher.supervisor:Running job 41554
2026-02-12T08:36:49.040 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/bin/teuthology -v --owner scheduled_matan@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41554 --name matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/small-objects} -- /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41554/orig.config.yaml
2026-02-12T08:36:49.041 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:50:17-crimson-rados-main-distro-debug-trial/41554
2026-02-12T08:36:49.041 INFO:teuthology.dispatcher.supervisor:Job PID: 3348538
2026-02-12T08:36:49.041 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T08:38:49.091 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:40:49.202 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:42:49.409 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:44:49.617 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:46:49.802 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:48:49.991 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:50:50.183 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:52:50.368 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:54:50.574 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:56:50.773 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T08:58:50.909 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:00:51.087 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:02:51.195 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:04:51.338 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:04:51.427 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-12T09:04:51.542 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T09:04:52.021 INFO:teuthology.orchestra.console.trial049:Power off
2026-02-12T09:04:52.021 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T09:04:52.044 INFO:teuthology.orchestra.console.trial060:Power off
2026-02-12T09:04:52.044 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T09:04:52.063 DEBUG:teuthology.orchestra.console.trial049:power off output: Chassis Power Control: Down/Off
2026-02-12T09:04:52.082 DEBUG:teuthology.orchestra.console.trial060:power off output: Chassis Power Control: Down/Off
2026-02-12T09:04:56.068 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:04:56.083 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:04:56.178 DEBUG:teuthology.orchestra.console.trial049:check power output: Chassis Power is on
2026-02-12T09:04:56.192 DEBUG:teuthology.orchestra.console.trial060:check power output: Chassis Power is on
2026-02-12T09:05:00.183 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:05:00.193 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:05:00.293 DEBUG:teuthology.orchestra.console.trial049:check power output: Chassis Power is off
2026-02-12T09:05:00.294 INFO:teuthology.orchestra.console.trial049:Power off completed
2026-02-12T09:05:00.304 DEBUG:teuthology.orchestra.console.trial060:check power output: Chassis Power is off
2026-02-12T09:05:00.304 INFO:teuthology.orchestra.console.trial060:Power off completed
2026-02-12T09:05:00.546 INFO:teuthology.lock.ops:unlocked: trial049.front.sepia.ceph.com
2026-02-12T09:05:00.559 INFO:teuthology.lock.ops:unlocked: trial060.front.sepia.ceph.com