2026-02-12T09:37:34.482 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062
2026-02-12T09:37:34.482 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:37:34.554 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:37:34.748 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fd502b9a7b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fd50238a480>, signals=[15])
2026-02-12T09:37:34.748 INFO:teuthology.lock.ops:Start node 'trial050.front.sepia.ceph.com' reimaging
2026-02-12T09:37:34.749 INFO:teuthology.lock.ops:Updating [trial050.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T09:37:34.749 INFO:teuthology.lock.ops:Updating trial050.front.sepia.ceph.com on lock server
2026-02-12T09:37:34.807 INFO:teuthology.lock.ops:Start node 'trial149.front.sepia.ceph.com' reimaging
2026-02-12T09:37:34.807 INFO:teuthology.lock.ops:Updating [trial149.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T09:37:34.807 INFO:teuthology.lock.ops:Updating trial149.front.sepia.ceph.com on lock server
2026-02-12T09:37:35.022 DEBUG:teuthology.provision.fog.trial149:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T09:37:35.034 DEBUG:teuthology.provision.fog.trial050:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T09:37:35.044 INFO:teuthology.provision.fog.trial149:Scheduling deploy of centos 9.stream
2026-02-12T09:37:35.099 INFO:teuthology.provision.fog.trial050:Scheduling deploy of centos 9.stream
2026-02-12T09:37:36.085 INFO:teuthology.orchestra.console.trial149:Power off
2026-02-12T09:37:36.085 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T09:37:36.106 INFO:teuthology.orchestra.console.trial050:Power off
2026-02-12T09:37:36.106 DEBUG:teuthology.orchestra.console.trial050:pexpect command: ipmitool -H trial050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T09:37:36.124 DEBUG:teuthology.orchestra.console.trial149:power off output: Chassis Power Control: Down/Off
2026-02-12T09:37:36.143 DEBUG:teuthology.orchestra.console.trial050:power off output: Chassis Power Control: Down/Off
2026-02-12T09:37:40.129 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:37:40.144 DEBUG:teuthology.orchestra.console.trial050:pexpect command: ipmitool -H trial050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:37:40.238 DEBUG:teuthology.orchestra.console.trial149:check power output: Chassis Power is off
2026-02-12T09:37:40.239 INFO:teuthology.orchestra.console.trial149:Power off completed
2026-02-12T09:37:40.254 DEBUG:teuthology.orchestra.console.trial050:check power output: Chassis Power is off
2026-02-12T09:37:40.254 INFO:teuthology.orchestra.console.trial050:Power off completed
2026-02-12T09:37:40.340 INFO:teuthology.orchestra.console.trial149:Power on
2026-02-12T09:37:40.340 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T09:37:40.355 INFO:teuthology.orchestra.console.trial050:Power on
2026-02-12T09:37:40.355 DEBUG:teuthology.orchestra.console.trial050:pexpect command: ipmitool -H trial050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T09:37:40.381 DEBUG:teuthology.orchestra.console.trial149:power on output: Chassis Power Control: Up/On
2026-02-12T09:37:40.393 DEBUG:teuthology.orchestra.console.trial050:power on output: Chassis Power Control: Up/On
2026-02-12T09:37:44.386 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:37:44.395 DEBUG:teuthology.orchestra.console.trial050:pexpect command: ipmitool -H trial050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:37:44.498 DEBUG:teuthology.orchestra.console.trial149:check power output: Chassis Power is on
2026-02-12T09:37:44.498 INFO:teuthology.orchestra.console.trial149:Power on completed
2026-02-12T09:37:44.504 DEBUG:teuthology.orchestra.console.trial050:check power output: Chassis Power is off
2026-02-12T09:37:44.600 INFO:teuthology.provision.fog.trial149:Waiting for deploy to finish
2026-02-12T09:37:48.509 DEBUG:teuthology.orchestra.console.trial050:pexpect command: ipmitool -H trial050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T09:37:48.620 DEBUG:teuthology.orchestra.console.trial050:check power output: Chassis Power is on
2026-02-12T09:37:48.620 INFO:teuthology.orchestra.console.trial050:Power on completed
2026-02-12T09:37:48.721 INFO:teuthology.provision.fog.trial050:Waiting for deploy to finish
2026-02-12T09:39:31.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:39:34.493 WARNING:teuthology.provision.fog.trial149:[Errno None] Unable to connect to port 22 on 10.20.193.149
2026-02-12T09:39:35.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:39:38.653 WARNING:teuthology.provision.fog.trial050:[Errno None] Unable to connect to port 22 on 10.20.193.50
2026-02-12T09:39:40.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:39:43.581 WARNING:teuthology.provision.fog.trial149:[Errno None] Unable to connect to port 22 on 10.20.193.149
2026-02-12T09:39:44.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:39:47.741 WARNING:teuthology.provision.fog.trial050:[Errno None] Unable to connect to port 22 on 10.20.193.50
2026-02-12T09:39:49.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:39:52.669 WARNING:teuthology.provision.fog.trial149:[Errno None] Unable to connect to port 22 on 10.20.193.149
2026-02-12T09:39:53.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:39:56.829 WARNING:teuthology.provision.fog.trial050:[Errno None] Unable to connect to port 22 on 10.20.193.50
2026-02-12T09:39:58.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:40:01.757 WARNING:teuthology.provision.fog.trial149:[Errno None] Unable to connect to port 22 on 10.20.193.149
2026-02-12T09:40:02.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:40:05.917 WARNING:teuthology.provision.fog.trial050:[Errno None] Unable to connect to port 22 on 10.20.193.50
2026-02-12T09:40:07.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:40:11.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:40:43.939 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T09:40:43.939 DEBUG:teuthology.orchestra.run.trial149:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T09:40:44.148 INFO:teuthology.provision.fog.trial149:Node is ready
2026-02-12T09:40:44.149 DEBUG:teuthology.orchestra.run.trial149:> hostname
2026-02-12T09:40:44.206 INFO:teuthology.orchestra.run.trial149.stdout:trial149.front.sepia.ceph.com
2026-02-12T09:40:44.206 DEBUG:teuthology.orchestra.run.trial149:> grep trial149.front.sepia.ceph.com /etc/hosts
2026-02-12T09:40:44.263 INFO:teuthology.orchestra.run.trial149.stdout:10.20.193.149 trial149.front.sepia.ceph.com trial149
2026-02-12T09:40:44.263 DEBUG:teuthology.orchestra.run.trial149:> sudo hostname trial149
2026-02-12T09:40:44.332 DEBUG:teuthology.orchestra.run.trial149:> sudo sed -i -e 's/trial149.front.sepia.ceph.com/trial149/g' /etc/hosts
2026-02-12T09:40:44.398 DEBUG:teuthology.orchestra.run.trial149:> sudo sed -i -e 's/10.20.193.149/10.20.193.149/g' /etc/hosts
2026-02-12T09:40:44.464 DEBUG:teuthology.orchestra.run.trial149:> sudo sed -i -e 's/trial149.front.sepia.ceph.com/trial149/g' /etc/hostname
2026-02-12T09:40:44.530 DEBUG:teuthology.orchestra.run.trial149:> sudo hostname trial149
2026-02-12T09:40:44.596 DEBUG:teuthology.orchestra.run.trial149:> cat /etc/os-release
2026-02-12T09:40:44.651 INFO:teuthology.orchestra.run.trial149.stdout:NAME="CentOS Stream"
2026-02-12T09:40:44.651 INFO:teuthology.orchestra.run.trial149.stdout:VERSION="9"
2026-02-12T09:40:44.651 INFO:teuthology.orchestra.run.trial149.stdout:ID="centos"
2026-02-12T09:40:44.651 INFO:teuthology.orchestra.run.trial149.stdout:ID_LIKE="rhel fedora"
2026-02-12T09:40:44.651 INFO:teuthology.orchestra.run.trial149.stdout:VERSION_ID="9"
2026-02-12T09:40:44.651 INFO:teuthology.orchestra.run.trial149.stdout:PLATFORM_ID="platform:el9"
2026-02-12T09:40:44.651 INFO:teuthology.orchestra.run.trial149.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T09:40:44.651 INFO:teuthology.orchestra.run.trial149.stdout:ANSI_COLOR="0;31"
2026-02-12T09:40:44.651 INFO:teuthology.orchestra.run.trial149.stdout:LOGO="fedora-logo-icon"
2026-02-12T09:40:44.651 INFO:teuthology.orchestra.run.trial149.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T09:40:44.652 INFO:teuthology.orchestra.run.trial149.stdout:HOME_URL="https://centos.org/"
2026-02-12T09:40:44.652 INFO:teuthology.orchestra.run.trial149.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T09:40:44.652 INFO:teuthology.orchestra.run.trial149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T09:40:44.652 INFO:teuthology.orchestra.run.trial149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T09:40:44.652 INFO:teuthology.provision.fog.trial149:Deploy complete!
2026-02-12T09:40:44.652 DEBUG:teuthology.parallel:result is None
2026-02-12T09:40:47.990 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T09:40:47.990 DEBUG:teuthology.orchestra.run.trial050:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T09:40:48.134 INFO:teuthology.provision.fog.trial050:Node is ready
2026-02-12T09:40:48.135 DEBUG:teuthology.orchestra.run.trial050:> hostname
2026-02-12T09:40:48.191 INFO:teuthology.orchestra.run.trial050.stdout:trial050.front.sepia.ceph.com
2026-02-12T09:40:48.191 DEBUG:teuthology.orchestra.run.trial050:> grep trial050.front.sepia.ceph.com /etc/hosts
2026-02-12T09:40:48.248 INFO:teuthology.orchestra.run.trial050.stdout:10.20.193.50 trial050.front.sepia.ceph.com trial050
2026-02-12T09:40:48.248 DEBUG:teuthology.orchestra.run.trial050:> sudo hostname trial050
2026-02-12T09:40:48.318 DEBUG:teuthology.orchestra.run.trial050:> sudo sed -i -e 's/trial050.front.sepia.ceph.com/trial050/g' /etc/hosts
2026-02-12T09:40:48.383 DEBUG:teuthology.orchestra.run.trial050:> sudo sed -i -e 's/10.20.193.50/10.20.193.50/g' /etc/hosts
2026-02-12T09:40:48.446 DEBUG:teuthology.orchestra.run.trial050:> sudo sed -i -e 's/trial050.front.sepia.ceph.com/trial050/g' /etc/hostname
2026-02-12T09:40:48.511 DEBUG:teuthology.orchestra.run.trial050:> sudo hostname trial050
2026-02-12T09:40:48.575 DEBUG:teuthology.orchestra.run.trial050:> cat /etc/os-release
2026-02-12T09:40:48.631 INFO:teuthology.orchestra.run.trial050.stdout:NAME="CentOS Stream"
2026-02-12T09:40:48.632 INFO:teuthology.orchestra.run.trial050.stdout:VERSION="9"
2026-02-12T09:40:48.632 INFO:teuthology.orchestra.run.trial050.stdout:ID="centos"
2026-02-12T09:40:48.632 INFO:teuthology.orchestra.run.trial050.stdout:ID_LIKE="rhel fedora"
2026-02-12T09:40:48.632 INFO:teuthology.orchestra.run.trial050.stdout:VERSION_ID="9"
2026-02-12T09:40:48.632 INFO:teuthology.orchestra.run.trial050.stdout:PLATFORM_ID="platform:el9"
2026-02-12T09:40:48.632 INFO:teuthology.orchestra.run.trial050.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T09:40:48.632 INFO:teuthology.orchestra.run.trial050.stdout:ANSI_COLOR="0;31"
2026-02-12T09:40:48.632 INFO:teuthology.orchestra.run.trial050.stdout:LOGO="fedora-logo-icon"
2026-02-12T09:40:48.632 INFO:teuthology.orchestra.run.trial050.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T09:40:48.632 INFO:teuthology.orchestra.run.trial050.stdout:HOME_URL="https://centos.org/"
2026-02-12T09:40:48.633 INFO:teuthology.orchestra.run.trial050.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T09:40:48.633 INFO:teuthology.orchestra.run.trial050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T09:40:48.633 INFO:teuthology.orchestra.run.trial050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T09:40:48.633 INFO:teuthology.provision.fog.trial050:Deploy complete!
2026-02-12T09:40:48.634 DEBUG:teuthology.parallel:result is None
2026-02-12T09:40:49.027 INFO:teuthology.lock.ops:Checking trial050.front.sepia.ceph.com
2026-02-12T09:40:49.027 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T09:40:49.121 INFO:teuthology.lock.ops:Checking trial149.front.sepia.ceph.com
2026-02-12T09:40:49.121 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T09:40:49.182 INFO:teuthology.lock.ops:Updating [trial050.front.sepia.ceph.com]: set os type and version on server
2026-02-12T09:40:49.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial050.front.sepia.ceph.com'
2026-02-12T09:40:49.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:40:49.244 DEBUG:teuthology.orchestra.run.trial050:> true
2026-02-12T09:40:49.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial050.front.sepia.ceph.com'
2026-02-12T09:40:49.314 DEBUG:teuthology.orchestra.run.trial050:> uname -m
2026-02-12T09:40:49.369 INFO:teuthology.orchestra.run.trial050.stdout:x86_64
2026-02-12T09:40:49.369 DEBUG:teuthology.orchestra.run.trial050:> cat /etc/os-release
2026-02-12T09:40:49.426 INFO:teuthology.orchestra.run.trial050.stdout:NAME="CentOS Stream"
2026-02-12T09:40:49.426 INFO:teuthology.orchestra.run.trial050.stdout:VERSION="9"
2026-02-12T09:40:49.426 INFO:teuthology.orchestra.run.trial050.stdout:ID="centos"
2026-02-12T09:40:49.426 INFO:teuthology.orchestra.run.trial050.stdout:ID_LIKE="rhel fedora"
2026-02-12T09:40:49.426 INFO:teuthology.orchestra.run.trial050.stdout:VERSION_ID="9"
2026-02-12T09:40:49.427 INFO:teuthology.orchestra.run.trial050.stdout:PLATFORM_ID="platform:el9"
2026-02-12T09:40:49.427 INFO:teuthology.orchestra.run.trial050.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T09:40:49.427 INFO:teuthology.orchestra.run.trial050.stdout:ANSI_COLOR="0;31"
2026-02-12T09:40:49.427 INFO:teuthology.orchestra.run.trial050.stdout:LOGO="fedora-logo-icon"
2026-02-12T09:40:49.427 INFO:teuthology.orchestra.run.trial050.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T09:40:49.427 INFO:teuthology.orchestra.run.trial050.stdout:HOME_URL="https://centos.org/"
2026-02-12T09:40:49.427 INFO:teuthology.orchestra.run.trial050.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T09:40:49.427 INFO:teuthology.orchestra.run.trial050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T09:40:49.427 INFO:teuthology.orchestra.run.trial050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T09:40:49.428 INFO:teuthology.lock.ops:Updating trial050.front.sepia.ceph.com on lock server
2026-02-12T09:40:49.527 INFO:teuthology.lock.ops:Updating [trial149.front.sepia.ceph.com]: set os type and version on server
2026-02-12T09:40:49.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com'
2026-02-12T09:40:49.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T09:40:49.591 DEBUG:teuthology.orchestra.run.trial149:> true
2026-02-12T09:40:49.667 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com'
2026-02-12T09:40:49.667 DEBUG:teuthology.orchestra.run.trial149:> uname -m
2026-02-12T09:40:49.722 INFO:teuthology.orchestra.run.trial149.stdout:x86_64
2026-02-12T09:40:49.723 DEBUG:teuthology.orchestra.run.trial149:> cat /etc/os-release
2026-02-12T09:40:49.779 INFO:teuthology.orchestra.run.trial149.stdout:NAME="CentOS Stream"
2026-02-12T09:40:49.779 INFO:teuthology.orchestra.run.trial149.stdout:VERSION="9"
2026-02-12T09:40:49.780 INFO:teuthology.orchestra.run.trial149.stdout:ID="centos"
2026-02-12T09:40:49.780 INFO:teuthology.orchestra.run.trial149.stdout:ID_LIKE="rhel fedora"
2026-02-12T09:40:49.780 INFO:teuthology.orchestra.run.trial149.stdout:VERSION_ID="9"
2026-02-12T09:40:49.780 INFO:teuthology.orchestra.run.trial149.stdout:PLATFORM_ID="platform:el9"
2026-02-12T09:40:49.780 INFO:teuthology.orchestra.run.trial149.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T09:40:49.780 INFO:teuthology.orchestra.run.trial149.stdout:ANSI_COLOR="0;31"
2026-02-12T09:40:49.780 INFO:teuthology.orchestra.run.trial149.stdout:LOGO="fedora-logo-icon"
2026-02-12T09:40:49.780 INFO:teuthology.orchestra.run.trial149.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T09:40:49.780 INFO:teuthology.orchestra.run.trial149.stdout:HOME_URL="https://centos.org/"
2026-02-12T09:40:49.780 INFO:teuthology.orchestra.run.trial149.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T09:40:49.780 INFO:teuthology.orchestra.run.trial149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T09:40:49.781 INFO:teuthology.orchestra.run.trial149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T09:40:49.781 INFO:teuthology.lock.ops:Updating trial149.front.sepia.ceph.com on lock server
2026-02-12T09:40:49.883 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:40:49.977 INFO:teuthology.dispatcher.supervisor:Running job 41702
2026-02-12T09:40:49.977 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/bin/teuthology -v --owner scheduled_matan@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41702 --name matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/crimson_bluestore thrashers/{default} thrashosds-health workloads/snaps-few-objects-balanced} -- /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41702/orig.config.yaml
2026-02-12T09:40:49.977 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41702
2026-02-12T09:40:49.978 INFO:teuthology.dispatcher.supervisor:Job PID: 3507845
2026-02-12T09:40:49.978 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T09:42:50.072 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:44:50.282 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:46:50.495 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:48:50.717 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:50:50.910 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:52:51.110 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:54:51.260 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:56:51.458 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T09:58:51.615 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:00:51.799 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:02:51.966 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:04:52.101 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:06:52.283 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:08:52.485 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:10:52.670 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:12:52.779 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:14:52.975 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:16:53.160 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:18:53.327 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:20:53.492 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:22:53.675 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:24:53.878 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:26:54.055 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:28:54.228 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T10:28:54.309 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-12T10:28:54.426 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T10:28:54.912 INFO:teuthology.orchestra.console.trial050:Power off
2026-02-12T10:28:54.912 DEBUG:teuthology.orchestra.console.trial050:pexpect command: ipmitool -H trial050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T10:28:54.930 INFO:teuthology.orchestra.console.trial149:Power off
2026-02-12T10:28:54.930 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T10:28:54.951 DEBUG:teuthology.orchestra.console.trial050:power off output: Chassis Power Control: Down/Off
2026-02-12T10:28:54.968 DEBUG:teuthology.orchestra.console.trial149:power off output: Chassis Power Control: Down/Off
2026-02-12T10:28:58.955 DEBUG:teuthology.orchestra.console.trial050:pexpect command: ipmitool -H trial050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:28:58.969 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:28:59.063 DEBUG:teuthology.orchestra.console.trial050:check power output: Chassis Power is on
2026-02-12T10:28:59.076 DEBUG:teuthology.orchestra.console.trial149:check power output: Chassis Power is on
2026-02-12T10:29:03.068 DEBUG:teuthology.orchestra.console.trial050:pexpect command: ipmitool -H trial050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:29:03.077 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T10:29:03.178 DEBUG:teuthology.orchestra.console.trial050:check power output: Chassis Power is off
2026-02-12T10:29:03.178 INFO:teuthology.orchestra.console.trial050:Power off completed
2026-02-12T10:29:03.185 DEBUG:teuthology.orchestra.console.trial149:check power output: Chassis Power is off
2026-02-12T10:29:03.185 INFO:teuthology.orchestra.console.trial149:Power off completed
2026-02-12T10:29:03.406 INFO:teuthology.lock.ops:unlocked: trial050.front.sepia.ceph.com
2026-02-12T10:29:03.418 INFO:teuthology.lock.ops:unlocked: trial149.front.sepia.ceph.com