2026-02-12T12:34:26.634 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71
2026-02-12T12:34:26.634 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:34:26.705 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:34:26.898 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7e4615253a40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7e4614a711c0>, signals=[15])
2026-02-12T12:34:26.898 INFO:teuthology.lock.ops:Start node 'trial088.front.sepia.ceph.com' reimaging
2026-02-12T12:34:26.898 INFO:teuthology.lock.ops:Updating [trial088.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T12:34:26.898 INFO:teuthology.lock.ops:Updating trial088.front.sepia.ceph.com on lock server
2026-02-12T12:34:26.953 INFO:teuthology.lock.ops:Start node 'trial174.front.sepia.ceph.com' reimaging
2026-02-12T12:34:26.953 INFO:teuthology.lock.ops:Updating [trial174.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T12:34:26.954 INFO:teuthology.lock.ops:Updating trial174.front.sepia.ceph.com on lock server
2026-02-12T12:34:27.149 DEBUG:teuthology.provision.fog.trial088:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T12:34:27.180 DEBUG:teuthology.provision.fog.trial174:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T12:34:27.201 INFO:teuthology.provision.fog.trial088:Scheduling deploy of centos 9.stream
2026-02-12T12:34:27.227 INFO:teuthology.provision.fog.trial174:Scheduling deploy of centos 9.stream
2026-02-12T12:34:28.294 INFO:teuthology.orchestra.console.trial174:Power off
2026-02-12T12:34:28.294 DEBUG:teuthology.orchestra.console.trial174:pexpect command: ipmitool -H trial174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T12:34:28.312 INFO:teuthology.orchestra.console.trial088:Power off
2026-02-12T12:34:28.312 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T12:34:28.331 DEBUG:teuthology.orchestra.console.trial174:power off output: Chassis Power Control: Down/Off
2026-02-12T12:34:28.353 DEBUG:teuthology.orchestra.console.trial088:power off output: Chassis Power Control: Down/Off
2026-02-12T12:34:32.336 DEBUG:teuthology.orchestra.console.trial174:pexpect command: ipmitool -H trial174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T12:34:32.353 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T12:34:32.444 DEBUG:teuthology.orchestra.console.trial174:check power output: Chassis Power is off
2026-02-12T12:34:32.445 INFO:teuthology.orchestra.console.trial174:Power off completed
2026-02-12T12:34:32.461 DEBUG:teuthology.orchestra.console.trial088:check power output: Chassis Power is off
2026-02-12T12:34:32.461 INFO:teuthology.orchestra.console.trial088:Power off completed
2026-02-12T12:34:32.546 INFO:teuthology.orchestra.console.trial174:Power on
2026-02-12T12:34:32.546 DEBUG:teuthology.orchestra.console.trial174:pexpect command: ipmitool -H trial174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T12:34:32.562 INFO:teuthology.orchestra.console.trial088:Power on
2026-02-12T12:34:32.563 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T12:34:32.585 DEBUG:teuthology.orchestra.console.trial174:power on output: Chassis Power Control: Up/On
2026-02-12T12:34:32.602 DEBUG:teuthology.orchestra.console.trial088:power on output: Chassis Power Control: Up/On
2026-02-12T12:34:36.590 DEBUG:teuthology.orchestra.console.trial174:pexpect command: ipmitool -H trial174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T12:34:36.604 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T12:34:36.700 DEBUG:teuthology.orchestra.console.trial174:check power output: Chassis Power is on
2026-02-12T12:34:36.701 INFO:teuthology.orchestra.console.trial174:Power on completed
2026-02-12T12:34:36.713 DEBUG:teuthology.orchestra.console.trial088:check power output: Chassis Power is off
2026-02-12T12:34:36.802 INFO:teuthology.provision.fog.trial174:Waiting for deploy to finish
2026-02-12T12:34:40.717 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T12:34:40.825 DEBUG:teuthology.orchestra.console.trial088:check power output: Chassis Power is on
2026-02-12T12:34:40.826 INFO:teuthology.orchestra.console.trial088:Power on completed
2026-02-12T12:34:40.926 INFO:teuthology.provision.fog.trial088:Waiting for deploy to finish
2026-02-12T12:36:23.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:36:26.973 WARNING:teuthology.provision.fog.trial174:[Errno None] Unable to connect to port 22 on 10.20.193.174
2026-02-12T12:36:27.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:36:32.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:36:36.061 WARNING:teuthology.provision.fog.trial174:[Errno None] Unable to connect to port 22 on 10.20.193.174
2026-02-12T12:36:42.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:36:42.270 WARNING:teuthology.provision.fog.trial088:[Errno None] Unable to connect to port 22 on 10.20.193.88
2026-02-12T12:36:45.149 WARNING:teuthology.provision.fog.trial174:[Errno None] Unable to connect to port 22 on 10.20.193.174
2026-02-12T12:36:48.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:36:51.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:36:51.357 WARNING:teuthology.provision.fog.trial088:[Errno None] Unable to connect to port 22 on 10.20.193.88
2026-02-12T12:36:54.237 WARNING:teuthology.provision.fog.trial174:[Errno None] Unable to connect to port 22 on 10.20.193.174
2026-02-12T12:36:57.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:37:00.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:37:33.600 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T12:37:33.600 DEBUG:teuthology.orchestra.run.trial088:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T12:37:36.164 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T12:37:36.164 DEBUG:teuthology.orchestra.run.trial174:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T12:37:36.385 INFO:teuthology.provision.fog.trial174:Node is ready
2026-02-12T12:37:36.386 DEBUG:teuthology.orchestra.run.trial174:> hostname
2026-02-12T12:37:36.443 INFO:teuthology.orchestra.run.trial174.stdout:trial174.front.sepia.ceph.com
2026-02-12T12:37:36.444 DEBUG:teuthology.orchestra.run.trial174:> grep trial174.front.sepia.ceph.com /etc/hosts
2026-02-12T12:37:36.499 INFO:teuthology.orchestra.run.trial174.stdout:10.20.193.174 trial174.front.sepia.ceph.com trial174
2026-02-12T12:37:36.500 DEBUG:teuthology.orchestra.run.trial174:> sudo hostname trial174
2026-02-12T12:37:36.570 DEBUG:teuthology.orchestra.run.trial174:> sudo sed -i -e 's/trial174.front.sepia.ceph.com/trial174/g' /etc/hosts
2026-02-12T12:37:36.635 DEBUG:teuthology.orchestra.run.trial174:> sudo sed -i -e 's/10.20.193.174/10.20.193.174/g' /etc/hosts
2026-02-12T12:37:36.700 DEBUG:teuthology.orchestra.run.trial174:> sudo sed -i -e 's/trial174.front.sepia.ceph.com/trial174/g' /etc/hostname
2026-02-12T12:37:36.766 DEBUG:teuthology.orchestra.run.trial174:> sudo hostname trial174
2026-02-12T12:37:36.831 DEBUG:teuthology.orchestra.run.trial174:> cat /etc/os-release
2026-02-12T12:37:36.888 INFO:teuthology.orchestra.run.trial174.stdout:NAME="CentOS Stream"
2026-02-12T12:37:36.888 INFO:teuthology.orchestra.run.trial174.stdout:VERSION="9"
2026-02-12T12:37:36.889 INFO:teuthology.orchestra.run.trial174.stdout:ID="centos"
2026-02-12T12:37:36.889 INFO:teuthology.orchestra.run.trial174.stdout:ID_LIKE="rhel fedora"
2026-02-12T12:37:36.889 INFO:teuthology.orchestra.run.trial174.stdout:VERSION_ID="9"
2026-02-12T12:37:36.889 INFO:teuthology.orchestra.run.trial174.stdout:PLATFORM_ID="platform:el9"
2026-02-12T12:37:36.889 INFO:teuthology.orchestra.run.trial174.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T12:37:36.889 INFO:teuthology.orchestra.run.trial174.stdout:ANSI_COLOR="0;31"
2026-02-12T12:37:36.889 INFO:teuthology.orchestra.run.trial174.stdout:LOGO="fedora-logo-icon"
2026-02-12T12:37:36.889 INFO:teuthology.orchestra.run.trial174.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T12:37:36.889 INFO:teuthology.orchestra.run.trial174.stdout:HOME_URL="https://centos.org/"
2026-02-12T12:37:36.889 INFO:teuthology.orchestra.run.trial174.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T12:37:36.889 INFO:teuthology.orchestra.run.trial174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T12:37:36.890 INFO:teuthology.orchestra.run.trial174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T12:37:36.891 INFO:teuthology.provision.fog.trial174:Deploy complete!
2026-02-12T12:37:36.892 DEBUG:teuthology.parallel:result is None
2026-02-12T12:37:38.766 INFO:teuthology.provision.fog.trial088:Node is ready
2026-02-12T12:37:38.766 DEBUG:teuthology.orchestra.run.trial088:> hostname
2026-02-12T12:37:38.784 INFO:teuthology.orchestra.run.trial088.stdout:trial088.front.sepia.ceph.com
2026-02-12T12:37:38.785 DEBUG:teuthology.orchestra.run.trial088:> grep trial088.front.sepia.ceph.com /etc/hosts
2026-02-12T12:37:38.841 INFO:teuthology.orchestra.run.trial088.stdout:10.20.193.88 trial088.front.sepia.ceph.com trial088
2026-02-12T12:37:38.842 DEBUG:teuthology.orchestra.run.trial088:> sudo hostname trial088
2026-02-12T12:37:38.912 DEBUG:teuthology.orchestra.run.trial088:> sudo sed -i -e 's/trial088.front.sepia.ceph.com/trial088/g' /etc/hosts
2026-02-12T12:37:38.977 DEBUG:teuthology.orchestra.run.trial088:> sudo sed -i -e 's/10.20.193.88/10.20.193.88/g' /etc/hosts
2026-02-12T12:37:39.041 DEBUG:teuthology.orchestra.run.trial088:> sudo sed -i -e 's/trial088.front.sepia.ceph.com/trial088/g' /etc/hostname
2026-02-12T12:37:39.106 DEBUG:teuthology.orchestra.run.trial088:> sudo hostname trial088
2026-02-12T12:37:39.170 DEBUG:teuthology.orchestra.run.trial088:> cat /etc/os-release
2026-02-12T12:37:39.226 INFO:teuthology.orchestra.run.trial088.stdout:NAME="CentOS Stream"
2026-02-12T12:37:39.226 INFO:teuthology.orchestra.run.trial088.stdout:VERSION="9"
2026-02-12T12:37:39.227 INFO:teuthology.orchestra.run.trial088.stdout:ID="centos"
2026-02-12T12:37:39.227 INFO:teuthology.orchestra.run.trial088.stdout:ID_LIKE="rhel fedora"
2026-02-12T12:37:39.227 INFO:teuthology.orchestra.run.trial088.stdout:VERSION_ID="9"
2026-02-12T12:37:39.227 INFO:teuthology.orchestra.run.trial088.stdout:PLATFORM_ID="platform:el9"
2026-02-12T12:37:39.227 INFO:teuthology.orchestra.run.trial088.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T12:37:39.227 INFO:teuthology.orchestra.run.trial088.stdout:ANSI_COLOR="0;31"
2026-02-12T12:37:39.227 INFO:teuthology.orchestra.run.trial088.stdout:LOGO="fedora-logo-icon"
2026-02-12T12:37:39.227 INFO:teuthology.orchestra.run.trial088.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T12:37:39.227 INFO:teuthology.orchestra.run.trial088.stdout:HOME_URL="https://centos.org/"
2026-02-12T12:37:39.227 INFO:teuthology.orchestra.run.trial088.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T12:37:39.227 INFO:teuthology.orchestra.run.trial088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T12:37:39.228 INFO:teuthology.orchestra.run.trial088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T12:37:39.228 INFO:teuthology.provision.fog.trial088:Deploy complete!
2026-02-12T12:37:39.229 DEBUG:teuthology.parallel:result is None
2026-02-12T12:37:39.621 INFO:teuthology.lock.ops:Checking trial088.front.sepia.ceph.com
2026-02-12T12:37:39.621 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T12:37:39.698 INFO:teuthology.lock.ops:Checking trial174.front.sepia.ceph.com
2026-02-12T12:37:39.698 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T12:37:39.758 INFO:teuthology.lock.ops:Updating [trial088.front.sepia.ceph.com]: set os type and version on server
2026-02-12T12:37:39.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial088.front.sepia.ceph.com'
2026-02-12T12:37:39.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:37:39.819 DEBUG:teuthology.orchestra.run.trial088:> true
2026-02-12T12:37:39.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial088.front.sepia.ceph.com'
2026-02-12T12:37:39.895 DEBUG:teuthology.orchestra.run.trial088:> uname -m
2026-02-12T12:37:39.950 INFO:teuthology.orchestra.run.trial088.stdout:x86_64
2026-02-12T12:37:39.950 DEBUG:teuthology.orchestra.run.trial088:> cat /etc/os-release
2026-02-12T12:37:40.007 INFO:teuthology.orchestra.run.trial088.stdout:NAME="CentOS Stream"
2026-02-12T12:37:40.007 INFO:teuthology.orchestra.run.trial088.stdout:VERSION="9"
2026-02-12T12:37:40.007 INFO:teuthology.orchestra.run.trial088.stdout:ID="centos"
2026-02-12T12:37:40.007 INFO:teuthology.orchestra.run.trial088.stdout:ID_LIKE="rhel fedora"
2026-02-12T12:37:40.007 INFO:teuthology.orchestra.run.trial088.stdout:VERSION_ID="9"
2026-02-12T12:37:40.007 INFO:teuthology.orchestra.run.trial088.stdout:PLATFORM_ID="platform:el9"
2026-02-12T12:37:40.007 INFO:teuthology.orchestra.run.trial088.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T12:37:40.008 INFO:teuthology.orchestra.run.trial088.stdout:ANSI_COLOR="0;31"
2026-02-12T12:37:40.008 INFO:teuthology.orchestra.run.trial088.stdout:LOGO="fedora-logo-icon"
2026-02-12T12:37:40.008 INFO:teuthology.orchestra.run.trial088.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T12:37:40.008 INFO:teuthology.orchestra.run.trial088.stdout:HOME_URL="https://centos.org/"
2026-02-12T12:37:40.008 INFO:teuthology.orchestra.run.trial088.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T12:37:40.008 INFO:teuthology.orchestra.run.trial088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T12:37:40.008 INFO:teuthology.orchestra.run.trial088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T12:37:40.009 INFO:teuthology.lock.ops:Updating trial088.front.sepia.ceph.com on lock server
2026-02-12T12:37:40.111 INFO:teuthology.lock.ops:Updating [trial174.front.sepia.ceph.com]: set os type and version on server
2026-02-12T12:37:40.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial174.front.sepia.ceph.com'
2026-02-12T12:37:40.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T12:37:40.183 DEBUG:teuthology.orchestra.run.trial174:> true
2026-02-12T12:37:40.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial174.front.sepia.ceph.com'
2026-02-12T12:37:40.255 DEBUG:teuthology.orchestra.run.trial174:> uname -m
2026-02-12T12:37:40.311 INFO:teuthology.orchestra.run.trial174.stdout:x86_64
2026-02-12T12:37:40.311 DEBUG:teuthology.orchestra.run.trial174:> cat /etc/os-release
2026-02-12T12:37:40.368 INFO:teuthology.orchestra.run.trial174.stdout:NAME="CentOS Stream"
2026-02-12T12:37:40.368 INFO:teuthology.orchestra.run.trial174.stdout:VERSION="9"
2026-02-12T12:37:40.368 INFO:teuthology.orchestra.run.trial174.stdout:ID="centos"
2026-02-12T12:37:40.368 INFO:teuthology.orchestra.run.trial174.stdout:ID_LIKE="rhel fedora"
2026-02-12T12:37:40.368 INFO:teuthology.orchestra.run.trial174.stdout:VERSION_ID="9"
2026-02-12T12:37:40.368 INFO:teuthology.orchestra.run.trial174.stdout:PLATFORM_ID="platform:el9"
2026-02-12T12:37:40.369 INFO:teuthology.orchestra.run.trial174.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T12:37:40.369 INFO:teuthology.orchestra.run.trial174.stdout:ANSI_COLOR="0;31"
2026-02-12T12:37:40.369 INFO:teuthology.orchestra.run.trial174.stdout:LOGO="fedora-logo-icon"
2026-02-12T12:37:40.369 INFO:teuthology.orchestra.run.trial174.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T12:37:40.369 INFO:teuthology.orchestra.run.trial174.stdout:HOME_URL="https://centos.org/"
2026-02-12T12:37:40.369 INFO:teuthology.orchestra.run.trial174.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T12:37:40.369 INFO:teuthology.orchestra.run.trial174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T12:37:40.369 INFO:teuthology.orchestra.run.trial174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T12:37:40.370 INFO:teuthology.lock.ops:Updating trial174.front.sepia.ceph.com on lock server
2026-02-12T12:37:40.473 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:37:40.567 INFO:teuthology.dispatcher.supervisor:Running job 45926
2026-02-12T12:37:40.567 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/bin/teuthology -v --owner scheduled_moagrawa@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial/45926 --name moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} -- /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial/45926/orig.config.yaml
2026-02-12T12:37:40.568 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:08:11-crimson-rados-main-distro-debug-trial/45926
2026-02-12T12:37:40.568 INFO:teuthology.dispatcher.supervisor:Job PID: 3861002
2026-02-12T12:37:40.568 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T12:39:40.625 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:41:40.742 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:43:40.877 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:45:41.053 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:47:41.241 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:49:41.434 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:51:41.619 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:53:41.750 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:55:41.955 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:57:42.155 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:59:47.173 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:01:47.389 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:03:47.596 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:05:47.802 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:07:48.002 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:09:48.207 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:11:48.427 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:13:48.574 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:15:49.783 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:17:49.979 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:19:50.168 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:21:50.374 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:23:50.579 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:25:50.753 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:27:50.921 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:29:51.141 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:31:51.325 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:33:51.503 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:35:51.705 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:37:51.830 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:39:52.038 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:41:52.153 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:43:52.355 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T13:43:52.441 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-12T13:43:52.556 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T13:43:53.076 INFO:teuthology.orchestra.console.trial088:Power off
2026-02-12T13:43:53.076 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T13:43:53.094 INFO:teuthology.orchestra.console.trial174:Power off
2026-02-12T13:43:53.094 DEBUG:teuthology.orchestra.console.trial174:pexpect command: ipmitool -H trial174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T13:43:53.115 DEBUG:teuthology.orchestra.console.trial088:power off output: Chassis Power Control: Down/Off
2026-02-12T13:43:53.133 DEBUG:teuthology.orchestra.console.trial174:power off output: Chassis Power Control: Down/Off
2026-02-12T13:43:57.119 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T13:43:57.134 DEBUG:teuthology.orchestra.console.trial174:pexpect command: ipmitool -H trial174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T13:43:57.227 DEBUG:teuthology.orchestra.console.trial088:check power output: Chassis Power is on
2026-02-12T13:43:57.241 DEBUG:teuthology.orchestra.console.trial174:check power output: Chassis Power is on
2026-02-12T13:44:01.233 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T13:44:01.242 DEBUG:teuthology.orchestra.console.trial174:pexpect command: ipmitool -H trial174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T13:44:01.342 DEBUG:teuthology.orchestra.console.trial088:check power output: Chassis Power is off
2026-02-12T13:44:01.343 INFO:teuthology.orchestra.console.trial088:Power off completed
2026-02-12T13:44:01.351 DEBUG:teuthology.orchestra.console.trial174:check power output: Chassis Power is off
2026-02-12T13:44:01.351 INFO:teuthology.orchestra.console.trial174:Power off completed
2026-02-12T13:44:01.588 INFO:teuthology.lock.ops:unlocked: trial088.front.sepia.ceph.com
2026-02-12T13:44:01.600 INFO:teuthology.lock.ops:unlocked: trial174.front.sepia.ceph.com