2026-02-25T08:53:57.777 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-25T08:53:57.777 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:53:57.851 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:53:57.987 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7014ea5fcc20>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7014e9fe0ea0>, signals=[15])
2026-02-25T08:53:57.987 INFO:teuthology.lock.ops:Start node 'trial169.front.sepia.ceph.com' reimaging
2026-02-25T08:53:57.987 INFO:teuthology.lock.ops:Updating [trial169.front.sepia.ceph.com]: reset os type and version on server
2026-02-25T08:53:57.987 INFO:teuthology.lock.ops:Updating trial169.front.sepia.ceph.com on lock server
2026-02-25T08:53:58.184 DEBUG:teuthology.provision.fog.trial169:Requesting image trial_centos_9.stream (ID 3)
2026-02-25T08:53:58.219 INFO:teuthology.provision.fog.trial169:Scheduling deploy of centos 9.stream
2026-02-25T08:54:00.184 INFO:teuthology.orchestra.console.trial169:Power off
2026-02-25T08:54:00.184 DEBUG:teuthology.orchestra.console.trial169:pexpect command: ipmitool -H trial169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T08:54:00.222 DEBUG:teuthology.orchestra.console.trial169:power off output: Chassis Power Control: Down/Off
2026-02-25T08:54:04.227 DEBUG:teuthology.orchestra.console.trial169:pexpect command: ipmitool -H trial169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T08:54:04.336 DEBUG:teuthology.orchestra.console.trial169:check power output: Chassis Power is off
2026-02-25T08:54:04.336 INFO:teuthology.orchestra.console.trial169:Power off completed
2026-02-25T08:54:04.436 INFO:teuthology.orchestra.console.trial169:Power on
2026-02-25T08:54:04.437 DEBUG:teuthology.orchestra.console.trial169:pexpect command: ipmitool -H trial169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-25T08:54:04.511 DEBUG:teuthology.orchestra.console.trial169:power on output: Chassis Power Control: Up/On
2026-02-25T08:54:08.516 DEBUG:teuthology.orchestra.console.trial169:pexpect command: ipmitool -H trial169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T08:54:08.624 DEBUG:teuthology.orchestra.console.trial169:check power output: Chassis Power is on
2026-02-25T08:54:08.624 INFO:teuthology.orchestra.console.trial169:Power on completed
2026-02-25T08:54:08.724 INFO:teuthology.provision.fog.trial169:Waiting for deploy to finish
2026-02-25T08:55:56.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T08:55:56.847 ERROR:teuthology.orchestra.connection:Error authenticating with trial169.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-25T08:56:39.552 WARNING:teuthology.provision.fog.trial169:[Errno None] Unable to connect to port 22 on 10.20.193.169
2026-02-25T08:56:45.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T08:57:21.656 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-25T08:57:21.657 DEBUG:teuthology.orchestra.run.trial169:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-25T08:57:21.825 INFO:teuthology.provision.fog.trial169:Node is ready
2026-02-25T08:57:21.825 DEBUG:teuthology.orchestra.run.trial169:> hostname
2026-02-25T08:57:21.882 INFO:teuthology.orchestra.run.trial169.stdout:trial169.front.sepia.ceph.com
2026-02-25T08:57:21.882 DEBUG:teuthology.orchestra.run.trial169:> grep trial169.front.sepia.ceph.com /etc/hosts
2026-02-25T08:57:21.948 INFO:teuthology.orchestra.run.trial169.stdout:10.20.193.169 trial169.front.sepia.ceph.com trial169
2026-02-25T08:57:21.948 DEBUG:teuthology.orchestra.run.trial169:> sudo hostname trial169
2026-02-25T08:57:22.100 DEBUG:teuthology.orchestra.run.trial169:> sudo sed -i -e 's/trial169.front.sepia.ceph.com/trial169/g' /etc/hosts
2026-02-25T08:57:22.125 DEBUG:teuthology.orchestra.run.trial169:> sudo sed -i -e 's/10.20.193.169/10.20.193.169/g' /etc/hosts
2026-02-25T08:57:22.193 DEBUG:teuthology.orchestra.run.trial169:> sudo sed -i -e 's/trial169.front.sepia.ceph.com/trial169/g' /etc/hostname
2026-02-25T08:57:22.260 DEBUG:teuthology.orchestra.run.trial169:> sudo hostname trial169
2026-02-25T08:57:22.324 DEBUG:teuthology.orchestra.run.trial169:> cat /etc/os-release
2026-02-25T08:57:22.382 INFO:teuthology.orchestra.run.trial169.stdout:NAME="CentOS Stream"
2026-02-25T08:57:22.382 INFO:teuthology.orchestra.run.trial169.stdout:VERSION="9"
2026-02-25T08:57:22.383 INFO:teuthology.orchestra.run.trial169.stdout:ID="centos"
2026-02-25T08:57:22.383 INFO:teuthology.orchestra.run.trial169.stdout:ID_LIKE="rhel fedora"
2026-02-25T08:57:22.383 INFO:teuthology.orchestra.run.trial169.stdout:VERSION_ID="9"
2026-02-25T08:57:22.383 INFO:teuthology.orchestra.run.trial169.stdout:PLATFORM_ID="platform:el9"
2026-02-25T08:57:22.383 INFO:teuthology.orchestra.run.trial169.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-25T08:57:22.383 INFO:teuthology.orchestra.run.trial169.stdout:ANSI_COLOR="0;31"
2026-02-25T08:57:22.383 INFO:teuthology.orchestra.run.trial169.stdout:LOGO="fedora-logo-icon"
2026-02-25T08:57:22.383 INFO:teuthology.orchestra.run.trial169.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-25T08:57:22.383 INFO:teuthology.orchestra.run.trial169.stdout:HOME_URL="https://centos.org/"
2026-02-25T08:57:22.383 INFO:teuthology.orchestra.run.trial169.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-25T08:57:22.384 INFO:teuthology.orchestra.run.trial169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-25T08:57:22.384 INFO:teuthology.orchestra.run.trial169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-25T08:57:22.385 INFO:teuthology.provision.fog.trial169:Deploy complete!
2026-02-25T08:57:22.386 DEBUG:teuthology.parallel:result is None
2026-02-25T08:57:22.662 INFO:teuthology.lock.ops:Checking trial169.front.sepia.ceph.com
2026-02-25T08:57:22.662 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-25T08:57:22.744 INFO:teuthology.lock.ops:Updating [trial169.front.sepia.ceph.com]: set os type and version on server
2026-02-25T08:57:22.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial169.front.sepia.ceph.com'
2026-02-25T08:57:22.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T08:57:22.809 DEBUG:teuthology.orchestra.run.trial169:> true
2026-02-25T08:57:22.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial169.front.sepia.ceph.com'
2026-02-25T08:57:22.888 DEBUG:teuthology.orchestra.run.trial169:> uname -m
2026-02-25T08:57:22.944 INFO:teuthology.orchestra.run.trial169.stdout:x86_64
2026-02-25T08:57:22.944 DEBUG:teuthology.orchestra.run.trial169:> cat /etc/os-release
2026-02-25T08:57:23.000 INFO:teuthology.orchestra.run.trial169.stdout:NAME="CentOS Stream"
2026-02-25T08:57:23.000 INFO:teuthology.orchestra.run.trial169.stdout:VERSION="9"
2026-02-25T08:57:23.000 INFO:teuthology.orchestra.run.trial169.stdout:ID="centos"
2026-02-25T08:57:23.001 INFO:teuthology.orchestra.run.trial169.stdout:ID_LIKE="rhel fedora"
2026-02-25T08:57:23.001 INFO:teuthology.orchestra.run.trial169.stdout:VERSION_ID="9"
2026-02-25T08:57:23.001 INFO:teuthology.orchestra.run.trial169.stdout:PLATFORM_ID="platform:el9"
2026-02-25T08:57:23.001 INFO:teuthology.orchestra.run.trial169.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-25T08:57:23.001 INFO:teuthology.orchestra.run.trial169.stdout:ANSI_COLOR="0;31"
2026-02-25T08:57:23.001 INFO:teuthology.orchestra.run.trial169.stdout:LOGO="fedora-logo-icon"
2026-02-25T08:57:23.001 INFO:teuthology.orchestra.run.trial169.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-25T08:57:23.001 INFO:teuthology.orchestra.run.trial169.stdout:HOME_URL="https://centos.org/"
2026-02-25T08:57:23.001 INFO:teuthology.orchestra.run.trial169.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-25T08:57:23.001 INFO:teuthology.orchestra.run.trial169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-25T08:57:23.001 INFO:teuthology.orchestra.run.trial169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-25T08:57:23.002 INFO:teuthology.lock.ops:Updating trial169.front.sepia.ceph.com on lock server
2026-02-25T08:57:23.231 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T08:57:23.364 INFO:teuthology.dispatcher.supervisor:Running job 69193
2026-02-25T08:57:23.365 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_matan@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/matan-2026-02-25_07:58:25-crimson-rados-main-distro-debug-trial/69193 --name matan-2026-02-25_07:58:25-crimson-rados-main-distro-debug-trial --description crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} tasks/rbd_lock_and_fence} -- /home/teuthworker/mnt/teuthology/matan-2026-02-25_07:58:25-crimson-rados-main-distro-debug-trial/69193/orig.config.yaml
2026-02-25T08:57:23.365 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/matan-2026-02-25_07:58:25-crimson-rados-main-distro-debug-trial/69193
2026-02-25T08:57:23.365 INFO:teuthology.dispatcher.supervisor:Job PID: 3725995
2026-02-25T08:57:23.365 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-25T08:59:23.366 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:01:23.824 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:03:23.960 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:05:24.110 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:07:24.230 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:09:24.350 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:11:24.470 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:13:24.590 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:15:24.714 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:17:24.833 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:19:24.950 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:21:25.068 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:23:25.168 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:25:25.289 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:27:25.410 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:29:25.513 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:31:25.639 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:33:25.763 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:35:25.883 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:37:25.994 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:39:26.084 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:41:26.155 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:43:26.241 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:45:26.357 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:47:26.438 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:49:26.542 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:51:26.662 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:53:26.779 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:55:26.902 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:57:26.989 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T09:59:27.110 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:01:27.196 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:03:27.309 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:05:27.431 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:07:27.626 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:09:27.750 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:11:27.868 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:13:27.959 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:15:28.081 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:17:28.200 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:19:28.323 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:21:28.445 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:23:28.568 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:25:28.692 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:27:28.763 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:29:28.884 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:31:29.008 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:33:29.132 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:35:29.237 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:37:29.351 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:39:29.473 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:41:29.603 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:43:29.730 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:45:29.852 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:47:29.980 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:49:30.100 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:51:30.222 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:53:30.352 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:55:30.463 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:57:30.552 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T10:59:30.627 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:01:30.746 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:03:30.960 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:05:31.061 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:07:31.179 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:09:31.300 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:11:31.421 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:13:31.528 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:15:31.659 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:17:31.783 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:19:32.963 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:21:33.082 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:23:33.202 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:25:33.323 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:27:33.444 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:29:33.569 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:31:33.685 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:33:33.797 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:35:33.922 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:37:34.043 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:39:34.162 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:41:34.251 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:43:34.346 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:45:34.474 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:47:34.595 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:49:34.721 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:51:34.840 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:53:34.963 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:55:35.171 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:57:35.288 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T11:59:35.413 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:01:35.539 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:03:35.630 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:05:35.755 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:07:35.876 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:09:35.995 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:11:36.121 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:13:36.220 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:15:36.338 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:17:36.410 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:19:36.506 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:21:36.637 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:23:36.759 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:25:36.879 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:27:36.988 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:29:37.088 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:31:37.204 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:33:37.305 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:35:37.434 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:37:37.562 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:39:37.678 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:41:37.774 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:43:38.246 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:45:38.345 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:47:38.468 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:49:38.628 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:51:38.751 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:53:38.867 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:55:39.067 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:57:39.189 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T12:59:39.308 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:01:39.399 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:03:39.521 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:05:39.644 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:07:39.762 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:09:39.885 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:11:40.014 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:13:40.140 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:15:40.262 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:17:40.359 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:19:40.479 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:21:40.604 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:23:40.696 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:25:40.810 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:27:40.932 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:29:41.028 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:31:41.151 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:33:41.233 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:35:42.616 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:37:42.731 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:39:42.832 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:41:42.904 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:43:43.017 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:45:43.139 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:47:43.261 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:49:43.383 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:51:43.482 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:53:43.554 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:55:43.672 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:57:43.790 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:59:43.913 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:01:44.032 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:03:44.158 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:05:44.283 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:07:44.358 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:09:44.433 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:11:44.512 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:13:44.634 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:15:44.750 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:17:45.182 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:19:45.292 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:21:45.401 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:23:45.604 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:25:45.724 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:27:45.844 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:29:49.150 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:31:49.269 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:33:49.390 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:35:49.463 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:37:49.595 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:39:49.714 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:41:49.833 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:43:49.964 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:45:50.084 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:47:50.209 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:49:50.327 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:51:50.461 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:53:50.592 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:55:50.713 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:57:50.840 WARNING:teuthology.dispatcher.supervisor:Job matan-2026-02-25_07:58:25-crimson-rados-main-distro-debug-trial/69193 ran longer than 21600s. Killing...
2026-02-25T14:57:50.968 INFO:teuthology.kill:Killing Pids: {3725995}
2026-02-25T14:57:50.970 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:57:51.086 INFO:teuthology.task.internal:roles: ubuntu@trial169.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']
2026-02-25T14:57:51.086 INFO:teuthology.misc:Compressing logs...
2026-02-25T14:57:51.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial169.front.sepia.ceph.com'
2026-02-25T14:57:51.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T14:57:51.150 DEBUG:teuthology.orchestra.run.trial169:> true
2026-02-25T14:57:51.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial169.front.sepia.ceph.com'
2026-02-25T14:57:51.295 DEBUG:teuthology.orchestra.run.trial169:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2026-02-25T14:57:51.359 INFO:teuthology.orchestra.run.trial169.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2026-02-25T14:57:51.360 INFO:teuthology.orchestra.run.trial169.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2026-02-25T14:57:51.360 INFO:teuthology.orchestra.run.trial169.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2026-02-25T14:57:51.361 INFO:teuthology.orchestra.run.trial169.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2026-02-25T14:57:51.365 DEBUG:teuthology.misc:Transferring archived files from trial169:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/matan-2026-02-25_07:58:25-crimson-rados-main-distro-debug-trial/69193/remote/trial169/
2026-02-25T14:57:51.366 DEBUG:teuthology.orchestra.run.trial169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- .
2026-02-25T14:57:51.555 INFO:teuthology.kill:No teuthology processes running
2026-02-25T14:57:51.555 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:57:52.012 INFO:teuthology.orchestra.console.trial169:Power off
2026-02-25T14:57:52.012 DEBUG:teuthology.orchestra.console.trial169:pexpect command: ipmitool -H trial169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T14:57:52.051 DEBUG:teuthology.orchestra.console.trial169:power off output: Chassis Power Control: Down/Off
2026-02-25T14:57:56.051 DEBUG:teuthology.orchestra.console.trial169:pexpect command: ipmitool -H trial169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T14:57:56.162 DEBUG:teuthology.orchestra.console.trial169:check power output: Chassis Power is on
2026-02-25T14:58:00.163 DEBUG:teuthology.orchestra.console.trial169:pexpect command: ipmitool -H trial169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T14:58:00.273 DEBUG:teuthology.orchestra.console.trial169:check power output: Chassis Power is off
2026-02-25T14:58:00.273 INFO:teuthology.orchestra.console.trial169:Power off completed
2026-02-25T14:58:00.483 INFO:teuthology.lock.ops:unlocked: trial169.front.sepia.ceph.com
2026-02-25T14:58:00.484 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T15:00:00.560 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T15:00:00.689 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2026-02-25T15:00:00.756 WARNING:teuthology.dispatcher.supervisor:Was going to unlock trial169 but it was locked by another job: /home/teuthworker/mnt/teuthology/vshankar-2026-02-25_09:28:04-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/69591