2026-02-12T10:24:36.639 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062 2026-02-12T10:24:36.639 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:24:36.710 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:24:36.842 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x79de6f96e340>, signals=[15]) 2026-02-12T10:24:36.842 INFO:teuthology.lock.ops:Start node 'trial199.front.sepia.ceph.com' reimaging 2026-02-12T10:24:36.842 INFO:teuthology.lock.ops:Updating [trial199.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T10:24:36.842 INFO:teuthology.lock.ops:Updating trial199.front.sepia.ceph.com on lock server 2026-02-12T10:24:37.052 DEBUG:teuthology.provision.fog.trial199:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T10:24:37.112 INFO:teuthology.provision.fog.trial199:Scheduling deploy of centos 9.stream 2026-02-12T10:24:38.240 INFO:teuthology.orchestra.console.trial199:Power off 2026-02-12T10:24:38.240 DEBUG:teuthology.orchestra.console.trial199:pexpect command: ipmitool -H trial199.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T10:24:38.278 DEBUG:teuthology.orchestra.console.trial199:power off output: Chassis Power Control: Down/Off 2026-02-12T10:24:42.283 DEBUG:teuthology.orchestra.console.trial199:pexpect command: ipmitool -H trial199.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:24:42.392 DEBUG:teuthology.orchestra.console.trial199:check power output: Chassis Power is off 2026-02-12T10:24:42.393 INFO:teuthology.orchestra.console.trial199:Power off completed 2026-02-12T10:24:42.493 INFO:teuthology.orchestra.console.trial199:Power on 2026-02-12T10:24:42.494 DEBUG:teuthology.orchestra.console.trial199:pexpect command: ipmitool -H trial199.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T10:24:42.533 DEBUG:teuthology.orchestra.console.trial199:power on output: Chassis Power Control: Up/On 2026-02-12T10:24:46.537 DEBUG:teuthology.orchestra.console.trial199:pexpect command: ipmitool -H trial199.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:24:46.647 DEBUG:teuthology.orchestra.console.trial199:check power output: Chassis Power is on 2026-02-12T10:24:46.648 INFO:teuthology.orchestra.console.trial199:Power on completed 2026-02-12T10:24:46.748 INFO:teuthology.provision.fog.trial199:Waiting for deploy to finish 2026-02-12T10:26:33.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial199.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:26:36.957 WARNING:teuthology.provision.fog.trial199:[Errno None] Unable to connect to port 22 on 10.20.193.199 2026-02-12T10:26:42.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial199.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:26:46.045 WARNING:teuthology.provision.fog.trial199:[Errno None] Unable to connect to port 22 on 10.20.193.199 2026-02-12T10:26:52.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial199.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:26:55.133 WARNING:teuthology.provision.fog.trial199:[Errno None] Unable to connect to port 22 on 10.20.193.199 2026-02-12T10:27:01.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial199.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:27:04.221 WARNING:teuthology.provision.fog.trial199:[Errno None] Unable to connect to port 22 on 10.20.193.199 2026-02-12T10:27:10.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial199.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:27:46.081 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T10:27:46.082 DEBUG:teuthology.orchestra.run.trial199:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T10:27:46.310 INFO:teuthology.provision.fog.trial199:Node is ready 2026-02-12T10:27:46.310 DEBUG:teuthology.orchestra.run.trial199:> hostname 2026-02-12T10:27:46.369 INFO:teuthology.orchestra.run.trial199.stdout:trial199.front.sepia.ceph.com 2026-02-12T10:27:46.370 DEBUG:teuthology.orchestra.run.trial199:> grep trial199.front.sepia.ceph.com /etc/hosts 2026-02-12T10:27:46.429 INFO:teuthology.orchestra.run.trial199.stdout:10.20.193.199 trial199.front.sepia.ceph.com trial199 2026-02-12T10:27:46.430 DEBUG:teuthology.orchestra.run.trial199:> sudo hostname trial199 2026-02-12T10:27:46.503 DEBUG:teuthology.orchestra.run.trial199:> sudo sed -i -e 's/trial199.front.sepia.ceph.com/trial199/g' /etc/hosts 2026-02-12T10:27:46.570 DEBUG:teuthology.orchestra.run.trial199:> sudo sed -i -e 's/10.20.193.199/10.20.193.199/g' /etc/hosts 2026-02-12T10:27:46.638 DEBUG:teuthology.orchestra.run.trial199:> sudo sed -i -e 's/trial199.front.sepia.ceph.com/trial199/g' /etc/hostname 2026-02-12T10:27:46.708 DEBUG:teuthology.orchestra.run.trial199:> sudo hostname trial199 2026-02-12T10:27:46.776 DEBUG:teuthology.orchestra.run.trial199:> cat /etc/os-release 2026-02-12T10:27:46.850 INFO:teuthology.orchestra.run.trial199.stdout:NAME="CentOS Stream" 2026-02-12T10:27:46.850 INFO:teuthology.orchestra.run.trial199.stdout:VERSION="9" 2026-02-12T10:27:46.851 INFO:teuthology.orchestra.run.trial199.stdout:ID="centos" 2026-02-12T10:27:46.851 INFO:teuthology.orchestra.run.trial199.stdout:ID_LIKE="rhel fedora" 2026-02-12T10:27:46.851 INFO:teuthology.orchestra.run.trial199.stdout:VERSION_ID="9" 2026-02-12T10:27:46.851 INFO:teuthology.orchestra.run.trial199.stdout:PLATFORM_ID="platform:el9" 2026-02-12T10:27:46.851 INFO:teuthology.orchestra.run.trial199.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T10:27:46.851 INFO:teuthology.orchestra.run.trial199.stdout:ANSI_COLOR="0;31" 2026-02-12T10:27:46.851 INFO:teuthology.orchestra.run.trial199.stdout:LOGO="fedora-logo-icon" 2026-02-12T10:27:46.851 INFO:teuthology.orchestra.run.trial199.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T10:27:46.851 INFO:teuthology.orchestra.run.trial199.stdout:HOME_URL="https://centos.org/" 2026-02-12T10:27:46.852 INFO:teuthology.orchestra.run.trial199.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T10:27:46.852 INFO:teuthology.orchestra.run.trial199.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T10:27:46.852 INFO:teuthology.orchestra.run.trial199.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T10:27:46.853 INFO:teuthology.provision.fog.trial199:Deploy complete! 2026-02-12T10:27:46.854 DEBUG:teuthology.parallel:result is None 2026-02-12T10:27:47.178 INFO:teuthology.lock.ops:Checking trial199.front.sepia.ceph.com 2026-02-12T10:27:47.178 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T10:27:47.277 INFO:teuthology.lock.ops:Updating [trial199.front.sepia.ceph.com]: set os type and version on server 2026-02-12T10:27:47.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial199.front.sepia.ceph.com' 2026-02-12T10:27:47.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial199.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:27:47.344 DEBUG:teuthology.orchestra.run.trial199:> true 2026-02-12T10:27:47.457 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial199.front.sepia.ceph.com' 2026-02-12T10:27:47.457 DEBUG:teuthology.orchestra.run.trial199:> uname -m 2026-02-12T10:27:47.519 INFO:teuthology.orchestra.run.trial199.stdout:x86_64 2026-02-12T10:27:47.519 DEBUG:teuthology.orchestra.run.trial199:> cat /etc/os-release 2026-02-12T10:27:47.581 INFO:teuthology.orchestra.run.trial199.stdout:NAME="CentOS Stream" 2026-02-12T10:27:47.581 INFO:teuthology.orchestra.run.trial199.stdout:VERSION="9" 2026-02-12T10:27:47.581 INFO:teuthology.orchestra.run.trial199.stdout:ID="centos" 2026-02-12T10:27:47.582 INFO:teuthology.orchestra.run.trial199.stdout:ID_LIKE="rhel fedora" 2026-02-12T10:27:47.582 INFO:teuthology.orchestra.run.trial199.stdout:VERSION_ID="9" 2026-02-12T10:27:47.582 INFO:teuthology.orchestra.run.trial199.stdout:PLATFORM_ID="platform:el9" 2026-02-12T10:27:47.582 INFO:teuthology.orchestra.run.trial199.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T10:27:47.582 INFO:teuthology.orchestra.run.trial199.stdout:ANSI_COLOR="0;31" 2026-02-12T10:27:47.582 INFO:teuthology.orchestra.run.trial199.stdout:LOGO="fedora-logo-icon" 2026-02-12T10:27:47.582 INFO:teuthology.orchestra.run.trial199.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T10:27:47.582 INFO:teuthology.orchestra.run.trial199.stdout:HOME_URL="https://centos.org/" 2026-02-12T10:27:47.582 INFO:teuthology.orchestra.run.trial199.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T10:27:47.582 INFO:teuthology.orchestra.run.trial199.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T10:27:47.583 INFO:teuthology.orchestra.run.trial199.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T10:27:47.583 INFO:teuthology.lock.ops:Updating trial199.front.sepia.ceph.com on lock server 2026-02-12T10:27:47.688 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:27:47.782 INFO:teuthology.dispatcher.supervisor:Running job 41793 2026-02-12T10:27:47.782 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/bin/teuthology -v --owner scheduled_matan@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41793 --name matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial --description crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} perf_ignorelist settings/optimized workloads/radosbench_4M_write} -- /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41793/orig.config.yaml 2026-02-12T10:27:47.782 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41793 2026-02-12T10:27:47.782 INFO:teuthology.dispatcher.supervisor:Job PID: 3631776 2026-02-12T10:27:47.782 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-12T10:29:47.883 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:31:48.125 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:33:48.292 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:35:48.479 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:37:48.650 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:39:48.816 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:41:48.987 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:43:49.186 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:45:49.391 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:47:49.581 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:49:49.787 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:51:49.980 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:53:50.171 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:55:50.361 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:57:50.565 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:59:50.703 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:01:50.786 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:03:50.901 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:05:51.076 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:07:51.253 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:09:51.359 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:11:51.520 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:13:51.695 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:15:51.803 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:17:51.990 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:19:52.142 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:21:52.348 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:23:52.522 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:25:52.649 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:27:52.781 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:29:52.927 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:31:53.131 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:33:53.256 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:35:53.399 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:37:53.611 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:39:53.828 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:41:54.062 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:43:54.286 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:45:54.504 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:47:54.729 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:49:54.857 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:51:55.053 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:53:55.261 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:55:55.469 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:57:55.588 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:59:55.797 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:01:56.004 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:03:56.196 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:05:56.324 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:07:56.521 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:09:56.683 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:11:56.874 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:13:57.048 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:15:57.241 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:17:57.434 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:19:57.618 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:21:57.812 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:23:58.000 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:25:58.175 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:27:58.315 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:29:58.474 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:31:58.604 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:33:58.779 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:35:58.974 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:37:59.174 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:39:59.370 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:41:59.577 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:43:59.753 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:45:59.887 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:48:00.042 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:50:00.203 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:52:00.399 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:54:00.590 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:56:00.725 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:58:00.917 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:00:01.079 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:02:01.281 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:04:01.469 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:06:01.651 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:08:01.785 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:10:01.992 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:12:02.163 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:14:02.342 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:16:02.517 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:18:02.686 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:20:02.813 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:22:03.010 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:24:03.233 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:26:03.409 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:28:03.590 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:30:03.766 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:32:03.957 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:34:04.149 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:36:04.353 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:38:04.554 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:40:04.764 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:42:04.914 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:44:05.072 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:46:05.283 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:48:05.489 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:50:05.693 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:52:05.899 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:54:06.107 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:56:06.314 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:58:06.524 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:00:06.735 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:02:06.953 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:04:07.171 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:06:07.397 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:08:07.594 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:10:07.771 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:12:07.934 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:14:08.084 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:16:08.291 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:18:08.487 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:20:08.703 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:22:08.885 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:24:09.067 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:26:09.271 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:28:09.460 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:30:09.657 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:32:09.862 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:34:10.070 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:36:10.288 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:38:10.499 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:40:10.707 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:42:10.917 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:44:11.093 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:46:11.299 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:48:11.487 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:50:11.660 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:52:11.805 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:54:11.918 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:56:12.015 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:58:12.217 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:00:12.314 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:02:12.489 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:04:12.644 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:06:12.755 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:08:12.904 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:10:13.106 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:12:13.306 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:14:13.422 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:16:13.609 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:18:13.821 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:20:13.989 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:22:14.173 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:24:14.361 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:26:14.571 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:28:14.780 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:30:14.925 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:32:15.135 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:34:15.359 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:36:15.560 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:38:15.770 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:40:15.979 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:42:16.168 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:44:16.388 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:46:16.556 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:48:16.716 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:50:16.903 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:52:17.071 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:54:17.244 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:56:17.424 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:58:17.530 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:00:17.708 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:02:17.885 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:04:18.092 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:06:18.215 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:08:18.411 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:10:18.598 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:12:18.713 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:14:18.846 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:16:19.032 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:18:19.228 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:20:19.399 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:22:19.573 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:24:19.726 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:26:19.943 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:28:20.154 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 21600s. Killing... 2026-02-12T16:28:20.155 ERROR:teuthology.dispatcher.supervisor:Failed to kill job Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/teuthology/dispatcher/supervisor.py", line 306, in run_with_watchdog kill.kill_job( TypeError: kill_job() got multiple values for argument 'skip_unlock' 2026-02-12T16:28:20.198 INFO:teuthology.task.internal:roles: ubuntu@trial199.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-12T16:28:20.198 INFO:teuthology.misc:Compressing logs... 2026-02-12T16:28:20.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial199.front.sepia.ceph.com' 2026-02-12T16:28:20.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial199.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:28:20.304 DEBUG:teuthology.orchestra.run.trial199:> true 2026-02-12T16:28:20.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial199.front.sepia.ceph.com' 2026-02-12T16:28:20.380 DEBUG:teuthology.orchestra.run.trial199:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T16:28:20.452 DEBUG:teuthology.misc:Transferring archived files from trial199:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41793/remote/trial199/crash 2026-02-12T16:28:20.453 DEBUG:teuthology.orchestra.run.trial199:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T16:28:20.514 INFO:teuthology.misc:Compressing logs... 2026-02-12T16:28:20.514 DEBUG:teuthology.orchestra.run.trial199:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T16:28:20.579 INFO:teuthology.orchestra.run.trial199.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T16:28:20.580 INFO:teuthology.orchestra.run.trial199.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T16:28:20.580 INFO:teuthology.orchestra.run.trial199.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T16:28:20.581 INFO:teuthology.orchestra.run.trial199.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T16:28:20.582 DEBUG:teuthology.misc:Transferring archived files from trial199:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41793/remote/trial199/ 2026-02-12T16:28:20.583 DEBUG:teuthology.orchestra.run.trial199:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T16:28:20.655 INFO:teuthology.misc:Compressing logs... 2026-02-12T16:28:20.655 DEBUG:teuthology.orchestra.run.trial199:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T16:28:20.720 INFO:teuthology.orchestra.run.trial199.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-12T16:28:20.727 INFO:teuthology.orchestra.run.trial199.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-12T16:28:20.728 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26339.log 2026-02-12T16:28:20.728 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22722.log 2026-02-12T16:28:20.728 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.26339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22820.log 2026-02-12T16:28:20.728 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.26339.log.gz 2026-02-12T16:28:20.728 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.22722.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-12T16:28:20.728 INFO:teuthology.orchestra.run.trial199.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.22722.log.gz 2026-02-12T16:28:20.728 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.22820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22970.log 2026-02-12T16:28:20.728 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23555.log 2026-02-12T16:28:20.728 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22820.log.gz 2026-02-12T16:28:20.728 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.22970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22366.log 2026-02-12T16:28:20.728 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22970.log.gz 2026-02-12T16:28:20.729 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.23555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23154.log 2026-02-12T16:28:20.729 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23555.log.gz 2026-02-12T16:28:20.729 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.22366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26543.log 2026-02-12T16:28:20.729 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22366.log.gz 2026-02-12T16:28:20.729 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.23154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23359.log 2026-02-12T16:28:20.729 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23154.log.gz 2026-02-12T16:28:20.729 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.26543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22408.log 2026-02-12T16:28:20.729 INFO:teuthology.orchestra.run.trial199.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.26543.log.gz 2026-02-12T16:28:20.729 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.23359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23285.log 2026-02-12T16:28:20.729 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.22408.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23359.log.gz 2026-02-12T16:28:20.729 INFO:teuthology.orchestra.run.trial199.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23427.log 2026-02-12T16:28:20.729 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22408.log.gz 2026-02-12T16:28:20.729 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.23285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21915.log 2026-02-12T16:28:20.730 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23285.log.gz 2026-02-12T16:28:20.730 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.23427.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20497.log 2026-02-12T16:28:20.730 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23427.log.gz 2026-02-12T16:28:20.730 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.21915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23212.log 2026-02-12T16:28:20.730 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.21915.log.gz 2026-02-12T16:28:20.730 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph.tmp-client.admin.20497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23604.log 2026-02-12T16:28:20.730 INFO:teuthology.orchestra.run.trial199.stderr: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20497.log.gz 2026-02-12T16:28:20.730 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.23212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22771.log 2026-02-12T16:28:20.730 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23212.log.gz 2026-02-12T16:28:20.730 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.23604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21868.log 2026-02-12T16:28:20.730 INFO:teuthology.orchestra.run.trial199.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23604.log.gz 2026-02-12T16:28:20.730 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.22771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22631.log 2026-02-12T16:28:20.731 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22771.log.gz 2026-02-12T16:28:20.731 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.21868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22146.log 2026-02-12T16:28:20.731 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.21868.log.gz 2026-02-12T16:28:20.731 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.22631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27099.log 2026-02-12T16:28:20.731 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22631.log.gz 2026-02-12T16:28:20.731 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.22146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21773.log 2026-02-12T16:28:20.731 INFO:teuthology.orchestra.run.trial199.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.22146.log.gz 2026-02-12T16:28:20.731 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.27099.log: 66.1% -- replaced with /var/log/ceph/ceph-client.admin.27099.log.gz 2026-02-12T16:28:20.731 INFO:teuthology.orchestra.run.trial199.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22656.log 2026-02-12T16:28:20.731 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.21773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22869.log 2026-02-12T16:28:20.731 INFO:teuthology.orchestra.run.trial199.stderr: 96.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-12T16:28:20.731 INFO:teuthology.orchestra.run.trial199.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.21773.log.gz 2026-02-12T16:28:20.731 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.22656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23286.log 2026-02-12T16:28:20.732 INFO:teuthology.orchestra.run.trial199.stderr: 66.9% -- replaced with /var/log/ceph/ceph-client.admin.22656.log.gz 2026-02-12T16:28:20.732 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.22869.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-12T16:28:20.732 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22869.log.gz 2026-02-12T16:28:20.737 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.23286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26453.log 2026-02-12T16:28:20.737 INFO:teuthology.orchestra.run.trial199.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.23286.log.gz 2026-02-12T16:28:20.737 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26395.log 2026-02-12T16:28:20.737 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.26453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22971.log 2026-02-12T16:28:20.737 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.26453.log.gz 2026-02-12T16:28:20.737 INFO:teuthology.orchestra.run.trial199.stderr: 87.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-12T16:28:20.737 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.26395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22972.log 2026-02-12T16:28:20.737 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.26395.log.gz 2026-02-12T16:28:20.738 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.22971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22052.log 2026-02-12T16:28:20.738 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22971.log.gz 2026-02-12T16:28:20.738 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.22972.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-12T16:28:20.738 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22972.log.gz 2026-02-12T16:28:20.738 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.22052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23506.log 2026-02-12T16:28:20.738 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22052.log.gz 2026-02-12T16:28:20.738 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26489.log 2026-02-12T16:28:20.738 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.23506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23092.log 2026-02-12T16:28:20.738 INFO:teuthology.orchestra.run.trial199.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.23506.log.gz 2026-02-12T16:28:20.738 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.26489.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-12T16:28:20.738 INFO:teuthology.orchestra.run.trial199.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.26489.log.gz 2026-02-12T16:28:20.738 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.23092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23422.log 2026-02-12T16:28:20.738 INFO:teuthology.orchestra.run.trial199.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23092.log.gz 2026-02-12T16:28:20.739 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-12T16:28:20.739 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.23422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22099.log 2026-02-12T16:28:20.739 INFO:teuthology.orchestra.run.trial199.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.23422.log.gz 2026-02-12T16:28:20.739 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27095.log 2026-02-12T16:28:20.739 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.22099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23091.log 2026-02-12T16:28:20.739 INFO:teuthology.orchestra.run.trial199.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22099.log.gz 2026-02-12T16:28:20.739 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.27095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22561.log 2026-02-12T16:28:20.739 INFO:teuthology.orchestra.run.trial199.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.27095.log.gz 2026-02-12T16:28:20.739 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.23091.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.23091.log.gz 2026-02-12T16:28:20.739 INFO:teuthology.orchestra.run.trial199.stderr:/var/log/ceph/ceph-client.admin.22561.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22561.log.gz 2026-02-12T16:28:20.776 INFO:teuthology.orchestra.run.trial199.stderr: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-12T16:28:21.167 INFO:teuthology.orchestra.run.trial199.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-12T16:28:25.013 INFO:teuthology.orchestra.run.trial199.stderr:gzip: /var/log/ceph/ceph-osd.2.log: file size changed while zipping 2026-02-12T16:28:25.013 INFO:teuthology.orchestra.run.trial199.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-12T16:28:25.820 INFO:teuthology.orchestra.run.trial199.stderr:gzip: /var/log/ceph/ceph-osd.1.log: file size changed while zipping 2026-02-12T16:28:25.820 INFO:teuthology.orchestra.run.trial199.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-12T16:28:26.938 INFO:teuthology.orchestra.run.trial199.stderr:gzip: /var/log/ceph/ceph-osd.0.log: file size changed while zipping 2026-02-12T16:28:26.938 INFO:teuthology.orchestra.run.trial199.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-12T16:28:26.939 DEBUG:teuthology.misc:Transferring archived files from trial199:/var/log/ceph to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41793/remote/trial199/log 2026-02-12T16:28:26.941 DEBUG:teuthology.orchestra.run.trial199:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T16:28:28.351 INFO:teuthology.kill:Killing Pids: {3631776} 2026-02-12T16:28:28.353 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:28:28.454 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:30:28.657 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:30:28.748 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2026-02-12T16:30:28.811 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-12T16:30:29.142 INFO:teuthology.orchestra.console.trial199:Power off 2026-02-12T16:30:29.142 DEBUG:teuthology.orchestra.console.trial199:pexpect command: ipmitool -H trial199.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T16:30:29.182 DEBUG:teuthology.orchestra.console.trial199:power off output: Chassis Power Control: Down/Off 2026-02-12T16:30:33.188 DEBUG:teuthology.orchestra.console.trial199:pexpect command: ipmitool -H trial199.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T16:30:33.296 DEBUG:teuthology.orchestra.console.trial199:check power output: Chassis Power is on 2026-02-12T16:30:37.300 DEBUG:teuthology.orchestra.console.trial199:pexpect command: ipmitool -H trial199.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T16:30:37.409 DEBUG:teuthology.orchestra.console.trial199:check power output: Chassis Power is off 2026-02-12T16:30:37.410 INFO:teuthology.orchestra.console.trial199:Power off completed 2026-02-12T16:30:37.582 INFO:teuthology.lock.ops:unlocked: trial199.front.sepia.ceph.com