2026-02-12T11:03:11.749 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71
2026-02-12T11:03:11.749 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:03:11.820 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:03:12.008 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x769ebd955d90>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x769ebd182980>, signals=[15])
2026-02-12T11:03:12.008 INFO:teuthology.lock.ops:Start node 'trial049.front.sepia.ceph.com' reimaging
2026-02-12T11:03:12.008 INFO:teuthology.lock.ops:Updating [trial049.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T11:03:12.008 INFO:teuthology.lock.ops:Updating trial049.front.sepia.ceph.com on lock server
2026-02-12T11:03:12.064 INFO:teuthology.lock.ops:Start node 'trial159.front.sepia.ceph.com' reimaging
2026-02-12T11:03:12.064 INFO:teuthology.lock.ops:Updating [trial159.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T11:03:12.064 INFO:teuthology.lock.ops:Updating trial159.front.sepia.ceph.com on lock server
2026-02-12T11:03:12.281 DEBUG:teuthology.provision.fog.trial049:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T11:03:12.298 DEBUG:teuthology.provision.fog.trial159:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T11:03:12.315 INFO:teuthology.provision.fog.trial049:Scheduling deploy of centos 9.stream
2026-02-12T11:03:12.349 INFO:teuthology.provision.fog.trial159:Scheduling deploy of centos 9.stream
2026-02-12T11:03:13.405 INFO:teuthology.orchestra.console.trial159:Power off
2026-02-12T11:03:13.405 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T11:03:13.425 INFO:teuthology.orchestra.console.trial049:Power off
2026-02-12T11:03:13.425 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T11:03:13.449 DEBUG:teuthology.orchestra.console.trial159:power off output: Chassis Power Control: Down/Off
2026-02-12T11:03:13.461 DEBUG:teuthology.orchestra.console.trial049:power off output: Chassis Power Control: Down/Off
2026-02-12T11:03:17.452 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:03:17.462 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:03:17.560 DEBUG:teuthology.orchestra.console.trial159:check power output: Chassis Power is off
2026-02-12T11:03:17.561 INFO:teuthology.orchestra.console.trial159:Power off completed
2026-02-12T11:03:17.568 DEBUG:teuthology.orchestra.console.trial049:check power output: Chassis Power is off
2026-02-12T11:03:17.568 INFO:teuthology.orchestra.console.trial049:Power off completed
2026-02-12T11:03:17.661 INFO:teuthology.orchestra.console.trial159:Power on
2026-02-12T11:03:17.661 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T11:03:17.669 INFO:teuthology.orchestra.console.trial049:Power on
2026-02-12T11:03:17.669 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T11:03:17.698 DEBUG:teuthology.orchestra.console.trial159:power on output: Chassis Power Control: Up/On
2026-02-12T11:03:17.707 DEBUG:teuthology.orchestra.console.trial049:power on output: Chassis Power Control: Up/On
2026-02-12T11:03:21.702 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:03:21.708 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T11:03:21.810 DEBUG:teuthology.orchestra.console.trial159:check power output: Chassis Power is on
2026-02-12T11:03:21.810 INFO:teuthology.orchestra.console.trial159:Power on completed
2026-02-12T11:03:21.816 DEBUG:teuthology.orchestra.console.trial049:check power output: Chassis Power is on
2026-02-12T11:03:21.816 INFO:teuthology.orchestra.console.trial049:Power on completed
2026-02-12T11:03:21.911 INFO:teuthology.provision.fog.trial159:Waiting for deploy to finish
2026-02-12T11:03:21.916 INFO:teuthology.provision.fog.trial049:Waiting for deploy to finish
2026-02-12T11:05:09.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:05:23.677 WARNING:teuthology.provision.fog.trial159:[Errno None] Unable to connect to port 22 on 10.20.193.159
2026-02-12T11:05:24.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:05:27.710 WARNING:teuthology.provision.fog.trial049:[Errno None] Unable to connect to port 22 on 10.20.193.49
2026-02-12T11:05:29.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:05:32.765 WARNING:teuthology.provision.fog.trial159:[Errno None] Unable to connect to port 22 on 10.20.193.159
2026-02-12T11:05:33.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:05:36.797 WARNING:teuthology.provision.fog.trial049:[Errno None] Unable to connect to port 22 on 10.20.193.49
2026-02-12T11:05:38.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:05:41.853 WARNING:teuthology.provision.fog.trial159:[Errno None] Unable to connect to port 22 on 10.20.193.159
2026-02-12T11:05:42.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:05:45.885 WARNING:teuthology.provision.fog.trial049:[Errno None] Unable to connect to port 22 on 10.20.193.49
2026-02-12T11:05:47.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:05:51.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:06:23.907 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T11:06:23.907 DEBUG:teuthology.orchestra.run.trial159:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T11:06:24.193 INFO:teuthology.provision.fog.trial159:Node is ready
2026-02-12T11:06:24.193 DEBUG:teuthology.orchestra.run.trial159:> hostname
2026-02-12T11:06:24.252 INFO:teuthology.orchestra.run.trial159.stdout:trial159.front.sepia.ceph.com
2026-02-12T11:06:24.252 DEBUG:teuthology.orchestra.run.trial159:> grep trial159.front.sepia.ceph.com /etc/hosts
2026-02-12T11:06:24.312 INFO:teuthology.orchestra.run.trial159.stdout:10.20.193.159 trial159.front.sepia.ceph.com trial159
2026-02-12T11:06:24.313 DEBUG:teuthology.orchestra.run.trial159:> sudo hostname trial159
2026-02-12T11:06:24.386 DEBUG:teuthology.orchestra.run.trial159:> sudo sed -i -e 's/trial159.front.sepia.ceph.com/trial159/g' /etc/hosts
2026-02-12T11:06:24.456 DEBUG:teuthology.orchestra.run.trial159:> sudo sed -i -e 's/10.20.193.159/10.20.193.159/g' /etc/hosts
2026-02-12T11:06:24.534 DEBUG:teuthology.orchestra.run.trial159:> sudo sed -i -e 's/trial159.front.sepia.ceph.com/trial159/g' /etc/hostname
2026-02-12T11:06:24.604 DEBUG:teuthology.orchestra.run.trial159:> sudo hostname trial159
2026-02-12T11:06:24.673 DEBUG:teuthology.orchestra.run.trial159:> cat /etc/os-release
2026-02-12T11:06:24.732 INFO:teuthology.orchestra.run.trial159.stdout:NAME="CentOS Stream"
2026-02-12T11:06:24.732 INFO:teuthology.orchestra.run.trial159.stdout:VERSION="9"
2026-02-12T11:06:24.733 INFO:teuthology.orchestra.run.trial159.stdout:ID="centos"
2026-02-12T11:06:24.733 INFO:teuthology.orchestra.run.trial159.stdout:ID_LIKE="rhel fedora"
2026-02-12T11:06:24.733 INFO:teuthology.orchestra.run.trial159.stdout:VERSION_ID="9"
2026-02-12T11:06:24.733 INFO:teuthology.orchestra.run.trial159.stdout:PLATFORM_ID="platform:el9"
2026-02-12T11:06:24.733 INFO:teuthology.orchestra.run.trial159.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T11:06:24.733 INFO:teuthology.orchestra.run.trial159.stdout:ANSI_COLOR="0;31"
2026-02-12T11:06:24.733 INFO:teuthology.orchestra.run.trial159.stdout:LOGO="fedora-logo-icon"
2026-02-12T11:06:24.733 INFO:teuthology.orchestra.run.trial159.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T11:06:24.733 INFO:teuthology.orchestra.run.trial159.stdout:HOME_URL="https://centos.org/"
2026-02-12T11:06:24.733 INFO:teuthology.orchestra.run.trial159.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T11:06:24.733 INFO:teuthology.orchestra.run.trial159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T11:06:24.734 INFO:teuthology.orchestra.run.trial159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T11:06:24.735 INFO:teuthology.provision.fog.trial159:Deploy complete!
2026-02-12T11:06:24.735 DEBUG:teuthology.parallel:result is None
2026-02-12T11:06:27.951 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T11:06:27.951 DEBUG:teuthology.orchestra.run.trial049:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T11:06:28.125 INFO:teuthology.provision.fog.trial049:Node is ready
2026-02-12T11:06:28.126 DEBUG:teuthology.orchestra.run.trial049:> hostname
2026-02-12T11:06:28.182 INFO:teuthology.orchestra.run.trial049.stdout:trial049.front.sepia.ceph.com
2026-02-12T11:06:28.182 DEBUG:teuthology.orchestra.run.trial049:> grep trial049.front.sepia.ceph.com /etc/hosts
2026-02-12T11:06:28.238 INFO:teuthology.orchestra.run.trial049.stdout:10.20.193.49 trial049.front.sepia.ceph.com trial049
2026-02-12T11:06:28.238 DEBUG:teuthology.orchestra.run.trial049:> sudo hostname trial049
2026-02-12T11:06:28.307 DEBUG:teuthology.orchestra.run.trial049:> sudo sed -i -e 's/trial049.front.sepia.ceph.com/trial049/g' /etc/hosts
2026-02-12T11:06:28.372 DEBUG:teuthology.orchestra.run.trial049:> sudo sed -i -e 's/10.20.193.49/10.20.193.49/g' /etc/hosts
2026-02-12T11:06:28.436 DEBUG:teuthology.orchestra.run.trial049:> sudo sed -i -e 's/trial049.front.sepia.ceph.com/trial049/g' /etc/hostname
2026-02-12T11:06:28.500 DEBUG:teuthology.orchestra.run.trial049:> sudo hostname trial049
2026-02-12T11:06:28.562 DEBUG:teuthology.orchestra.run.trial049:> cat /etc/os-release
2026-02-12T11:06:28.619 INFO:teuthology.orchestra.run.trial049.stdout:NAME="CentOS Stream"
2026-02-12T11:06:28.619 INFO:teuthology.orchestra.run.trial049.stdout:VERSION="9"
2026-02-12T11:06:28.619 INFO:teuthology.orchestra.run.trial049.stdout:ID="centos"
2026-02-12T11:06:28.619 INFO:teuthology.orchestra.run.trial049.stdout:ID_LIKE="rhel fedora"
2026-02-12T11:06:28.619 INFO:teuthology.orchestra.run.trial049.stdout:VERSION_ID="9"
2026-02-12T11:06:28.619 INFO:teuthology.orchestra.run.trial049.stdout:PLATFORM_ID="platform:el9"
2026-02-12T11:06:28.619 INFO:teuthology.orchestra.run.trial049.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T11:06:28.619 INFO:teuthology.orchestra.run.trial049.stdout:ANSI_COLOR="0;31"
2026-02-12T11:06:28.620 INFO:teuthology.orchestra.run.trial049.stdout:LOGO="fedora-logo-icon"
2026-02-12T11:06:28.620 INFO:teuthology.orchestra.run.trial049.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T11:06:28.620 INFO:teuthology.orchestra.run.trial049.stdout:HOME_URL="https://centos.org/"
2026-02-12T11:06:28.620 INFO:teuthology.orchestra.run.trial049.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T11:06:28.620 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T11:06:28.620 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T11:06:28.620 INFO:teuthology.provision.fog.trial049:Deploy complete!
2026-02-12T11:06:28.621 DEBUG:teuthology.parallel:result is None
2026-02-12T11:06:29.015 INFO:teuthology.lock.ops:Checking trial049.front.sepia.ceph.com
2026-02-12T11:06:29.016 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T11:06:29.105 INFO:teuthology.lock.ops:Checking trial159.front.sepia.ceph.com
2026-02-12T11:06:29.105 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T11:06:29.168 INFO:teuthology.lock.ops:Updating [trial049.front.sepia.ceph.com]: set os type and version on server
2026-02-12T11:06:29.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com'
2026-02-12T11:06:29.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:06:29.229 DEBUG:teuthology.orchestra.run.trial049:> true
2026-02-12T11:06:29.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com'
2026-02-12T11:06:29.306 DEBUG:teuthology.orchestra.run.trial049:> uname -m
2026-02-12T11:06:29.362 INFO:teuthology.orchestra.run.trial049.stdout:x86_64
2026-02-12T11:06:29.362 DEBUG:teuthology.orchestra.run.trial049:> cat /etc/os-release
2026-02-12T11:06:29.418 INFO:teuthology.orchestra.run.trial049.stdout:NAME="CentOS Stream"
2026-02-12T11:06:29.419 INFO:teuthology.orchestra.run.trial049.stdout:VERSION="9"
2026-02-12T11:06:29.419 INFO:teuthology.orchestra.run.trial049.stdout:ID="centos"
2026-02-12T11:06:29.419 INFO:teuthology.orchestra.run.trial049.stdout:ID_LIKE="rhel fedora"
2026-02-12T11:06:29.419 INFO:teuthology.orchestra.run.trial049.stdout:VERSION_ID="9"
2026-02-12T11:06:29.419 INFO:teuthology.orchestra.run.trial049.stdout:PLATFORM_ID="platform:el9"
2026-02-12T11:06:29.419 INFO:teuthology.orchestra.run.trial049.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T11:06:29.419 INFO:teuthology.orchestra.run.trial049.stdout:ANSI_COLOR="0;31"
2026-02-12T11:06:29.420 INFO:teuthology.orchestra.run.trial049.stdout:LOGO="fedora-logo-icon"
2026-02-12T11:06:29.420 INFO:teuthology.orchestra.run.trial049.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T11:06:29.420 INFO:teuthology.orchestra.run.trial049.stdout:HOME_URL="https://centos.org/"
2026-02-12T11:06:29.420 INFO:teuthology.orchestra.run.trial049.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T11:06:29.420 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T11:06:29.420 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T11:06:29.421 INFO:teuthology.lock.ops:Updating trial049.front.sepia.ceph.com on lock server
2026-02-12T11:06:29.524 INFO:teuthology.lock.ops:Updating [trial159.front.sepia.ceph.com]: set os type and version on server
2026-02-12T11:06:29.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial159.front.sepia.ceph.com'
2026-02-12T11:06:29.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T11:06:29.589 DEBUG:teuthology.orchestra.run.trial159:> true
2026-02-12T11:06:29.664 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial159.front.sepia.ceph.com'
2026-02-12T11:06:29.664 DEBUG:teuthology.orchestra.run.trial159:> uname -m
2026-02-12T11:06:29.720 INFO:teuthology.orchestra.run.trial159.stdout:x86_64
2026-02-12T11:06:29.720 DEBUG:teuthology.orchestra.run.trial159:> cat /etc/os-release
2026-02-12T11:06:29.776 INFO:teuthology.orchestra.run.trial159.stdout:NAME="CentOS Stream"
2026-02-12T11:06:29.776 INFO:teuthology.orchestra.run.trial159.stdout:VERSION="9"
2026-02-12T11:06:29.776 INFO:teuthology.orchestra.run.trial159.stdout:ID="centos"
2026-02-12T11:06:29.776 INFO:teuthology.orchestra.run.trial159.stdout:ID_LIKE="rhel fedora"
2026-02-12T11:06:29.776 INFO:teuthology.orchestra.run.trial159.stdout:VERSION_ID="9"
2026-02-12T11:06:29.777 INFO:teuthology.orchestra.run.trial159.stdout:PLATFORM_ID="platform:el9"
2026-02-12T11:06:29.777 INFO:teuthology.orchestra.run.trial159.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T11:06:29.777 INFO:teuthology.orchestra.run.trial159.stdout:ANSI_COLOR="0;31"
2026-02-12T11:06:29.777 INFO:teuthology.orchestra.run.trial159.stdout:LOGO="fedora-logo-icon"
2026-02-12T11:06:29.777 INFO:teuthology.orchestra.run.trial159.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T11:06:29.777 INFO:teuthology.orchestra.run.trial159.stdout:HOME_URL="https://centos.org/"
2026-02-12T11:06:29.777 INFO:teuthology.orchestra.run.trial159.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T11:06:29.777 INFO:teuthology.orchestra.run.trial159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T11:06:29.777 INFO:teuthology.orchestra.run.trial159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T11:06:29.778 INFO:teuthology.lock.ops:Updating trial159.front.sepia.ceph.com on lock server
2026-02-12T11:06:29.882 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:06:29.975 INFO:teuthology.dispatcher.supervisor:Running job 46149
2026-02-12T11:06:29.976 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/bin/teuthology -v --owner scheduled_amathuri@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/amathuri-2026-02-12_10:22:28-crimson-rados:thrash-wip-amat-fix-74504-distro-debug-trial/46149 --name amathuri-2026-02-12_10:22:28-crimson-rados:thrash-wip-amat-fix-74504-distro-debug-trial --description crimson-rados:thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{pggrow} thrashosds-health workloads/radosbench-high-concurrency} -- /home/teuthworker/mnt/teuthology/amathuri-2026-02-12_10:22:28-crimson-rados:thrash-wip-amat-fix-74504-distro-debug-trial/46149/orig.config.yaml
2026-02-12T11:06:29.976 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/amathuri-2026-02-12_10:22:28-crimson-rados:thrash-wip-amat-fix-74504-distro-debug-trial/46149
2026-02-12T11:06:29.976 INFO:teuthology.dispatcher.supervisor:Job PID: 3733871
2026-02-12T11:06:29.976 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T11:08:30.076 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:10:30.221 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:12:30.397 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:14:30.578 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:16:30.756 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:18:30.937 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:20:31.139 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:22:31.261 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:24:31.482 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:26:31.592 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:28:31.804 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:30:31.968 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:32:32.143 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:34:32.356 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:36:32.524 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:38:32.725 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:40:32.910 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:42:33.117 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:44:33.264 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:46:33.861 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:48:34.083 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:50:34.229 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:52:34.333 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:54:34.515 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:56:34.712 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T11:58:34.936 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:00:35.063 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:02:35.249 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:04:35.436 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:06:35.616 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:08:35.741 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:10:35.904 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:12:36.026 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:14:36.239 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:16:36.383 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:18:36.589 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:20:36.771 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:22:36.960 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:24:37.161 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:26:37.338 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:28:37.493 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:30:37.702 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:32:37.950 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:34:38.168 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:36:38.342 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T12:36:38.458 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-12T12:36:38.581 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T12:36:39.080 INFO:teuthology.orchestra.console.trial049:Power off
2026-02-12T12:36:39.080 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T12:36:39.099 INFO:teuthology.orchestra.console.trial159:Power off
2026-02-12T12:36:39.099 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T12:36:39.119 DEBUG:teuthology.orchestra.console.trial049:power off output: Chassis Power Control: Down/Off
2026-02-12T12:36:39.137 DEBUG:teuthology.orchestra.console.trial159:power off output: Chassis Power Control: Down/Off
2026-02-12T12:36:43.123 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T12:36:43.137 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T12:36:43.232 DEBUG:teuthology.orchestra.console.trial049:check power output: Chassis Power is on
2026-02-12T12:36:43.245 DEBUG:teuthology.orchestra.console.trial159:check power output: Chassis Power is on
2026-02-12T12:36:47.237 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T12:36:47.245 DEBUG:teuthology.orchestra.console.trial159:pexpect command: ipmitool -H trial159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T12:36:47.348 DEBUG:teuthology.orchestra.console.trial049:check power output: Chassis Power is off
2026-02-12T12:36:47.348 INFO:teuthology.orchestra.console.trial049:Power off completed
2026-02-12T12:36:47.355 DEBUG:teuthology.orchestra.console.trial159:check power output: Chassis Power is off
2026-02-12T12:36:47.355 INFO:teuthology.orchestra.console.trial159:Power off completed
2026-02-12T12:36:47.593 INFO:teuthology.lock.ops:unlocked: trial049.front.sepia.ceph.com
2026-02-12T12:36:47.605 INFO:teuthology.lock.ops:unlocked: trial159.front.sepia.ceph.com