2026-02-12T10:24:14.311 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062 2026-02-12T10:24:14.311 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:24:14.383 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:24:14.518 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x72049937cf40>, signals=[15]) 2026-02-12T10:24:14.518 INFO:teuthology.lock.ops:Start node 'trial118.front.sepia.ceph.com' reimaging 2026-02-12T10:24:14.518 INFO:teuthology.lock.ops:Updating [trial118.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T10:24:14.518 INFO:teuthology.lock.ops:Updating trial118.front.sepia.ceph.com on lock server 2026-02-12T10:24:14.727 DEBUG:teuthology.provision.fog.trial118:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T10:24:14.780 INFO:teuthology.provision.fog.trial118:Scheduling deploy of centos 9.stream 2026-02-12T10:24:15.826 INFO:teuthology.orchestra.console.trial118:Power off 2026-02-12T10:24:15.826 DEBUG:teuthology.orchestra.console.trial118:pexpect command: ipmitool -H trial118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T10:24:15.864 DEBUG:teuthology.orchestra.console.trial118:power off output: Chassis Power Control: Down/Off 2026-02-12T10:24:19.868 DEBUG:teuthology.orchestra.console.trial118:pexpect command: ipmitool -H trial118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:24:19.977 DEBUG:teuthology.orchestra.console.trial118:check power output: Chassis Power is off 2026-02-12T10:24:19.977 INFO:teuthology.orchestra.console.trial118:Power off completed 2026-02-12T10:24:20.078 INFO:teuthology.orchestra.console.trial118:Power on 2026-02-12T10:24:20.078 DEBUG:teuthology.orchestra.console.trial118:pexpect command: ipmitool -H trial118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T10:24:20.119 DEBUG:teuthology.orchestra.console.trial118:power on output: Chassis Power Control: Up/On 2026-02-12T10:24:24.124 DEBUG:teuthology.orchestra.console.trial118:pexpect command: ipmitool -H trial118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:24:24.234 DEBUG:teuthology.orchestra.console.trial118:check power output: Chassis Power is off 2026-02-12T10:24:28.239 DEBUG:teuthology.orchestra.console.trial118:pexpect command: ipmitool -H trial118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T10:24:28.348 DEBUG:teuthology.orchestra.console.trial118:check power output: Chassis Power is on 2026-02-12T10:24:28.349 INFO:teuthology.orchestra.console.trial118:Power on completed 2026-02-12T10:24:28.449 INFO:teuthology.provision.fog.trial118:Waiting for deploy to finish 2026-02-12T10:26:15.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:26:18.653 WARNING:teuthology.provision.fog.trial118:[Errno None] Unable to connect to port 22 on 10.20.193.118 2026-02-12T10:26:24.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:26:27.741 WARNING:teuthology.provision.fog.trial118:[Errno None] Unable to connect to port 22 on 10.20.193.118 2026-02-12T10:26:33.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:26:36.829 WARNING:teuthology.provision.fog.trial118:[Errno None] Unable to connect to port 22 on 10.20.193.118 2026-02-12T10:26:42.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:26:45.917 WARNING:teuthology.provision.fog.trial118:[Errno None] Unable to connect to port 22 on 10.20.193.118 2026-02-12T10:26:51.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:26:55.005 WARNING:teuthology.provision.fog.trial118:[Errno None] Unable to connect to port 22 on 10.20.193.118 2026-02-12T10:27:01.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:27:04.093 WARNING:teuthology.provision.fog.trial118:[Errno None] Unable to connect to port 22 on 10.20.193.118 2026-02-12T10:27:10.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:27:13.181 WARNING:teuthology.provision.fog.trial118:[Errno None] Unable to connect to port 22 on 10.20.193.118 2026-02-12T10:27:19.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:27:55.297 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T10:27:55.298 DEBUG:teuthology.orchestra.run.trial118:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T10:27:55.446 INFO:teuthology.provision.fog.trial118:Node is ready 2026-02-12T10:27:55.446 DEBUG:teuthology.orchestra.run.trial118:> hostname 2026-02-12T10:27:55.500 INFO:teuthology.orchestra.run.trial118.stdout:trial118.front.sepia.ceph.com 2026-02-12T10:27:55.500 DEBUG:teuthology.orchestra.run.trial118:> grep trial118.front.sepia.ceph.com /etc/hosts 2026-02-12T10:27:55.555 INFO:teuthology.orchestra.run.trial118.stdout:10.20.193.118 trial118.front.sepia.ceph.com trial118 2026-02-12T10:27:55.555 DEBUG:teuthology.orchestra.run.trial118:> sudo hostname trial118 2026-02-12T10:27:55.624 DEBUG:teuthology.orchestra.run.trial118:> sudo sed -i -e 's/trial118.front.sepia.ceph.com/trial118/g' /etc/hosts 2026-02-12T10:27:55.687 DEBUG:teuthology.orchestra.run.trial118:> sudo sed -i -e 's/10.20.193.118/10.20.193.118/g' /etc/hosts 2026-02-12T10:27:55.751 DEBUG:teuthology.orchestra.run.trial118:> sudo sed -i -e 's/trial118.front.sepia.ceph.com/trial118/g' /etc/hostname 2026-02-12T10:27:55.813 DEBUG:teuthology.orchestra.run.trial118:> sudo hostname trial118 2026-02-12T10:27:55.877 DEBUG:teuthology.orchestra.run.trial118:> cat /etc/os-release 2026-02-12T10:27:55.931 INFO:teuthology.orchestra.run.trial118.stdout:NAME="CentOS Stream" 2026-02-12T10:27:55.931 INFO:teuthology.orchestra.run.trial118.stdout:VERSION="9" 2026-02-12T10:27:55.931 INFO:teuthology.orchestra.run.trial118.stdout:ID="centos" 2026-02-12T10:27:55.931 INFO:teuthology.orchestra.run.trial118.stdout:ID_LIKE="rhel fedora" 2026-02-12T10:27:55.931 INFO:teuthology.orchestra.run.trial118.stdout:VERSION_ID="9" 2026-02-12T10:27:55.931 INFO:teuthology.orchestra.run.trial118.stdout:PLATFORM_ID="platform:el9" 2026-02-12T10:27:55.931 INFO:teuthology.orchestra.run.trial118.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T10:27:55.932 INFO:teuthology.orchestra.run.trial118.stdout:ANSI_COLOR="0;31" 2026-02-12T10:27:55.932 INFO:teuthology.orchestra.run.trial118.stdout:LOGO="fedora-logo-icon" 2026-02-12T10:27:55.932 INFO:teuthology.orchestra.run.trial118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T10:27:55.932 INFO:teuthology.orchestra.run.trial118.stdout:HOME_URL="https://centos.org/" 2026-02-12T10:27:55.932 INFO:teuthology.orchestra.run.trial118.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T10:27:55.932 INFO:teuthology.orchestra.run.trial118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T10:27:55.932 INFO:teuthology.orchestra.run.trial118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T10:27:55.933 INFO:teuthology.provision.fog.trial118:Deploy complete! 2026-02-12T10:27:55.934 DEBUG:teuthology.parallel:result is None 2026-02-12T10:27:56.198 INFO:teuthology.lock.ops:Checking trial118.front.sepia.ceph.com 2026-02-12T10:27:56.198 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T10:27:56.285 INFO:teuthology.lock.ops:Updating [trial118.front.sepia.ceph.com]: set os type and version on server 2026-02-12T10:27:56.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial118.front.sepia.ceph.com' 2026-02-12T10:27:56.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:27:56.365 DEBUG:teuthology.orchestra.run.trial118:> true 2026-02-12T10:27:56.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial118.front.sepia.ceph.com' 2026-02-12T10:27:56.438 DEBUG:teuthology.orchestra.run.trial118:> uname -m 2026-02-12T10:27:56.491 INFO:teuthology.orchestra.run.trial118.stdout:x86_64 2026-02-12T10:27:56.491 DEBUG:teuthology.orchestra.run.trial118:> cat /etc/os-release 2026-02-12T10:27:56.545 INFO:teuthology.orchestra.run.trial118.stdout:NAME="CentOS Stream" 2026-02-12T10:27:56.545 INFO:teuthology.orchestra.run.trial118.stdout:VERSION="9" 2026-02-12T10:27:56.545 INFO:teuthology.orchestra.run.trial118.stdout:ID="centos" 2026-02-12T10:27:56.546 INFO:teuthology.orchestra.run.trial118.stdout:ID_LIKE="rhel fedora" 2026-02-12T10:27:56.546 INFO:teuthology.orchestra.run.trial118.stdout:VERSION_ID="9" 2026-02-12T10:27:56.546 INFO:teuthology.orchestra.run.trial118.stdout:PLATFORM_ID="platform:el9" 2026-02-12T10:27:56.546 INFO:teuthology.orchestra.run.trial118.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T10:27:56.546 INFO:teuthology.orchestra.run.trial118.stdout:ANSI_COLOR="0;31" 2026-02-12T10:27:56.546 INFO:teuthology.orchestra.run.trial118.stdout:LOGO="fedora-logo-icon" 2026-02-12T10:27:56.546 INFO:teuthology.orchestra.run.trial118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T10:27:56.546 INFO:teuthology.orchestra.run.trial118.stdout:HOME_URL="https://centos.org/" 2026-02-12T10:27:56.546 INFO:teuthology.orchestra.run.trial118.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T10:27:56.546 INFO:teuthology.orchestra.run.trial118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T10:27:56.546 INFO:teuthology.orchestra.run.trial118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T10:27:56.546 INFO:teuthology.lock.ops:Updating trial118.front.sepia.ceph.com on lock server 2026-02-12T10:27:56.632 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:27:56.724 INFO:teuthology.dispatcher.supervisor:Running job 41788 2026-02-12T10:27:56.724 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/bin/teuthology -v --owner scheduled_matan@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41788 --name matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial --description crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} perf_ignorelist settings/optimized workloads/radosbench_4M_seq_read} -- /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41788/orig.config.yaml 2026-02-12T10:27:56.724 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41788 2026-02-12T10:27:56.724 INFO:teuthology.dispatcher.supervisor:Job PID: 3632646 2026-02-12T10:27:56.724 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-12T10:29:56.825 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:31:56.974 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:33:57.132 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:35:57.276 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:37:57.474 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:39:57.678 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:41:57.833 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:43:58.036 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:45:58.152 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:47:58.312 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:49:58.507 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:51:58.657 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:53:58.871 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:55:59.033 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:57:59.204 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:59:59.362 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:01:59.550 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:03:59.698 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:05:59.873 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:08:00.059 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:10:00.253 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:12:00.438 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:14:00.640 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:16:00.853 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:18:00.995 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:20:01.162 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:22:01.376 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:24:01.584 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:26:01.794 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:28:01.951 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:30:02.060 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:32:02.249 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:34:02.371 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:36:02.528 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:38:02.747 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:40:02.897 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:42:03.038 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:44:03.248 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:46:03.408 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:48:03.496 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:50:03.677 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:52:03.878 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:54:04.065 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:56:04.238 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:58:04.428 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:00:04.618 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:02:04.809 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:04:04.970 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:06:05.151 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:08:05.305 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:10:05.493 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:12:05.685 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:14:05.868 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:16:06.057 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:18:06.169 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:20:06.365 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:22:06.556 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:24:06.766 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:26:06.968 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:28:07.151 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:30:07.360 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:32:07.561 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:34:07.744 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:36:07.927 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:38:08.127 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:40:08.320 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:42:08.519 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:44:08.710 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:46:08.919 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:48:09.096 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:50:09.228 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:52:09.362 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:54:09.573 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:56:09.775 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T12:58:09.977 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:00:10.153 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:02:10.294 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:04:10.475 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:06:10.659 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:08:10.861 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:10:11.034 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:12:11.205 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:14:11.343 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:16:11.468 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:18:11.612 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:20:11.801 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:22:11.988 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:24:12.205 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:26:12.383 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:28:12.488 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:30:12.680 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:32:12.876 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:34:13.047 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:36:13.173 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:38:13.381 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:40:13.589 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:42:13.801 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:44:14.010 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:46:14.216 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:48:14.336 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:50:14.507 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:52:14.630 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:54:14.780 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:56:14.933 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T13:58:15.136 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:00:15.326 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:02:15.528 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:04:15.752 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:06:15.901 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:08:16.111 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:10:16.317 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:12:16.527 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:14:16.735 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:16:16.925 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:18:17.109 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:20:17.313 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:22:17.403 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:24:17.565 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:26:17.672 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:28:17.748 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:30:17.937 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:32:18.073 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:34:18.436 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:36:18.519 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:38:18.601 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:40:18.803 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:42:18.906 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:44:19.104 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:46:19.179 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:48:19.312 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:50:19.446 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:52:19.596 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:54:19.805 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:56:19.958 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:58:20.059 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:00:20.177 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:02:20.337 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:04:20.491 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:06:20.696 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:08:20.893 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:10:21.085 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:12:21.169 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:14:21.364 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:16:21.615 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:18:21.781 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:20:21.912 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:22:22.070 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:24:22.256 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:26:22.476 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:28:22.663 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:30:22.818 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:32:22.967 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:34:23.136 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:36:23.356 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:38:23.570 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:40:23.726 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:42:23.926 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:44:24.114 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:46:24.274 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:48:24.479 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:50:24.685 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:52:24.874 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:54:25.137 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:56:25.340 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:58:25.558 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:00:25.748 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:02:25.905 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:04:26.034 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:06:26.231 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:08:26.410 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:10:26.601 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:12:26.779 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:14:27.005 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:16:27.157 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:18:27.360 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:20:27.556 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:22:27.742 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:24:27.937 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:26:28.149 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:28:28.306 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 21600s. Killing... 2026-02-12T16:28:28.306 ERROR:teuthology.dispatcher.supervisor:Failed to kill job Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/teuthology/dispatcher/supervisor.py", line 306, in run_with_watchdog kill.kill_job( TypeError: kill_job() got multiple values for argument 'skip_unlock' 2026-02-12T16:28:28.354 INFO:teuthology.task.internal:roles: ubuntu@trial118.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-12T16:28:28.354 INFO:teuthology.misc:Compressing logs... 2026-02-12T16:28:28.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial118.front.sepia.ceph.com' 2026-02-12T16:28:28.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:28:28.522 DEBUG:teuthology.orchestra.run.trial118:> true 2026-02-12T16:28:28.596 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial118.front.sepia.ceph.com' 2026-02-12T16:28:28.596 DEBUG:teuthology.orchestra.run.trial118:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T16:28:28.667 DEBUG:teuthology.misc:Transferring archived files from trial118:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41788/remote/trial118/crash 2026-02-12T16:28:28.668 DEBUG:teuthology.orchestra.run.trial118:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T16:28:28.730 INFO:teuthology.misc:Compressing logs... 2026-02-12T16:28:28.730 DEBUG:teuthology.orchestra.run.trial118:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T16:28:28.796 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T16:28:28.797 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T16:28:28.797 INFO:teuthology.orchestra.run.trial118.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T16:28:28.797 INFO:teuthology.orchestra.run.trial118.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T16:28:28.799 DEBUG:teuthology.misc:Transferring archived files from trial118:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41788/remote/trial118/ 2026-02-12T16:28:28.800 DEBUG:teuthology.orchestra.run.trial118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T16:28:28.870 INFO:teuthology.misc:Compressing logs... 2026-02-12T16:28:28.871 DEBUG:teuthology.orchestra.run.trial118:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T16:28:28.953 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22235.log 2026-02-12T16:28:28.953 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-12T16:28:28.954 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.22235.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-12T16:28:28.954 INFO:teuthology.orchestra.run.trial118.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22235.log.gz 2026-02-12T16:28:28.954 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-12T16:28:28.954 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27474.log 2026-02-12T16:28:28.954 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26865.log 2026-02-12T16:28:28.954 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.27474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23762.log 2026-02-12T16:28:28.954 INFO:teuthology.orchestra.run.trial118.stderr: 51.6% -- replaced with /var/log/ceph/ceph-client.admin.27474.log.gz 2026-02-12T16:28:28.954 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.26865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22420.log 2026-02-12T16:28:28.954 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.23762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22373.log 2026-02-12T16:28:28.955 INFO:teuthology.orchestra.run.trial118.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.26865.log.gz 2026-02-12T16:28:28.955 INFO:teuthology.orchestra.run.trial118.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23762.log.gz 2026-02-12T16:28:28.955 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.22420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22467.log 2026-02-12T16:28:28.955 INFO:teuthology.orchestra.run.trial118.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22420.log.gz 2026-02-12T16:28:28.955 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.22373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23288.log 2026-02-12T16:28:28.955 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.22467.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22373.log.gz 2026-02-12T16:28:28.955 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23436.log 2026-02-12T16:28:28.955 INFO:teuthology.orchestra.run.trial118.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22467.log.gz 2026-02-12T16:28:28.955 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.23288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22093.log 2026-02-12T16:28:28.956 INFO:teuthology.orchestra.run.trial118.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23288.log.gz 2026-02-12T16:28:28.956 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.23436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23438.log 2026-02-12T16:28:28.956 INFO:teuthology.orchestra.run.trial118.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23436.log.gz 2026-02-12T16:28:28.956 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.22093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23139.log 2026-02-12T16:28:28.956 INFO:teuthology.orchestra.run.trial118.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22093.log.gz 2026-02-12T16:28:28.956 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.23438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22976.log 2026-02-12T16:28:28.956 INFO:teuthology.orchestra.run.trial118.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23438.log.gz 2026-02-12T16:28:28.956 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.23139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23437.log 2026-02-12T16:28:28.957 INFO:teuthology.orchestra.run.trial118.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23139.log.gz 2026-02-12T16:28:28.957 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.22976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23923.log 2026-02-12T16:28:28.957 INFO:teuthology.orchestra.run.trial118.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.22976.log.gz 2026-02-12T16:28:28.957 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.23437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23602.log 2026-02-12T16:28:28.957 INFO:teuthology.orchestra.run.trial118.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23437.log.gz 2026-02-12T16:28:28.957 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.23923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23291.log 2026-02-12T16:28:28.957 INFO:teuthology.orchestra.run.trial118.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23923.log.gz 2026-02-12T16:28:28.958 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.23602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23041.log 2026-02-12T16:28:28.958 INFO:teuthology.orchestra.run.trial118.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23602.log.gz 2026-02-12T16:28:28.958 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.23291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23558.log 2026-02-12T16:28:28.958 INFO:teuthology.orchestra.run.trial118.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23291.log.gz 2026-02-12T16:28:28.958 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.23041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23874.log 2026-02-12T16:28:28.958 INFO:teuthology.orchestra.run.trial118.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.23041.log.gz 2026-02-12T16:28:28.958 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.23558.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-12T16:28:28.958 INFO:teuthology.orchestra.run.trial118.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23558.log.gz 2026-02-12T16:28:28.958 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.23874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22733.log 2026-02-12T16:28:28.958 INFO:teuthology.orchestra.run.trial118.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.23874.log.gz 2026-02-12T16:28:28.958 INFO:teuthology.orchestra.run.trial118.stderr: 96.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-12T16:28:28.959 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-12T16:28:28.959 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.22733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22188.log 2026-02-12T16:28:28.959 INFO:teuthology.orchestra.run.trial118.stderr: 87.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-12T16:28:28.959 INFO:teuthology.orchestra.run.trial118.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22733.log.gz 2026-02-12T16:28:28.959 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23090.log 2026-02-12T16:28:28.959 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.22188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23705.log 2026-02-12T16:28:28.959 INFO:teuthology.orchestra.run.trial118.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.22188.log.gz 2026-02-12T16:28:28.959 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.23090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22951.log 2026-02-12T16:28:28.959 INFO:teuthology.orchestra.run.trial118.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23090.log.gz 2026-02-12T16:28:28.959 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.23705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23188.log 2026-02-12T16:28:28.960 INFO:teuthology.orchestra.run.trial118.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23705.log.gz 2026-02-12T16:28:28.960 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26715.log 2026-02-12T16:28:28.960 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.22951.log: /var/log/ceph/ceph-client.admin.23188.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22951.log.gz 2026-02-12T16:28:28.960 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23825.log 2026-02-12T16:28:28.960 INFO:teuthology.orchestra.run.trial118.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.23188.log.gz 2026-02-12T16:28:28.960 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.26715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26771.log 2026-02-12T16:28:28.960 INFO:teuthology.orchestra.run.trial118.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.26715.log.gz 2026-02-12T16:28:28.960 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.23825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26919.log 2026-02-12T16:28:28.960 INFO:teuthology.orchestra.run.trial118.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.23825.log.gz 2026-02-12T16:28:28.960 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.26771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22687.log 2026-02-12T16:28:28.960 INFO:teuthology.orchestra.run.trial118.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.26771.log.gz 2026-02-12T16:28:28.961 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.26919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23704.log 2026-02-12T16:28:28.961 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.22687.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.26919.log.gz 2026-02-12T16:28:28.961 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-12T16:28:28.961 INFO:teuthology.orchestra.run.trial118.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22687.log.gz 2026-02-12T16:28:28.961 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.23704.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20812.log 2026-02-12T16:28:28.961 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-mgr.x.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.23704.log.gz 2026-02-12T16:28:28.961 INFO:teuthology.orchestra.run.trial118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23290.log 2026-02-12T16:28:28.961 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph.tmp-client.admin.20812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22881.log 2026-02-12T16:28:28.961 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.23290.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-12T16:28:28.961 INFO:teuthology.orchestra.run.trial118.stderr: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20812.log.gz 2026-02-12T16:28:28.962 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.22881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27473.log 2026-02-12T16:28:28.962 INFO:teuthology.orchestra.run.trial118.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.22881.log.gz 2026-02-12T16:28:28.962 INFO:teuthology.orchestra.run.trial118.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.23290.log.gz 2026-02-12T16:28:28.962 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23557.log 2026-02-12T16:28:28.962 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.27473.log: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.27473.log.gzgzip 2026-02-12T16:28:28.962 INFO:teuthology.orchestra.run.trial118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.26830.log 2026-02-12T16:28:28.962 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.23557.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.23557.log.gz 2026-02-12T16:28:28.962 INFO:teuthology.orchestra.run.trial118.stderr:/var/log/ceph/ceph-client.admin.26830.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.26830.log.gz 2026-02-12T16:28:28.976 INFO:teuthology.orchestra.run.trial118.stderr: 91.9% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-12T16:28:29.380 INFO:teuthology.orchestra.run.trial118.stderr:gzip: /var/log/ceph/ceph-mgr.x.log: file size changed while zipping 2026-02-12T16:28:29.380 INFO:teuthology.orchestra.run.trial118.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-12T16:28:31.837 INFO:teuthology.orchestra.run.trial118.stderr:gzip: /var/log/ceph/ceph-osd.2.log: file size changed while zipping 2026-02-12T16:28:31.837 INFO:teuthology.orchestra.run.trial118.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-12T16:28:31.942 INFO:teuthology.orchestra.run.trial118.stderr:gzip: /var/log/ceph/ceph-osd.1.log: file size changed while zipping 2026-02-12T16:28:31.942 INFO:teuthology.orchestra.run.trial118.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-12T16:28:32.803 INFO:teuthology.orchestra.run.trial118.stderr:gzip: /var/log/ceph/ceph-osd.0.log: file size changed while zipping 2026-02-12T16:28:32.803 INFO:teuthology.orchestra.run.trial118.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-12T16:28:32.805 DEBUG:teuthology.misc:Transferring archived files from trial118:/var/log/ceph to /home/teuthworker/mnt/teuthology/matan-2026-02-09_15:55:47-crimson-rados-main-distro-default-trial/41788/remote/trial118/log 2026-02-12T16:28:32.807 DEBUG:teuthology.orchestra.run.trial118:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T16:28:33.813 INFO:teuthology.kill:Killing Pids: {3632646} 2026-02-12T16:28:33.815 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:28:33.896 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:30:34.064 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:30:34.142 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2026-02-12T16:30:34.202 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-12T16:30:34.511 INFO:teuthology.orchestra.console.trial118:Power off 2026-02-12T16:30:34.511 DEBUG:teuthology.orchestra.console.trial118:pexpect command: ipmitool -H trial118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T16:30:34.551 DEBUG:teuthology.orchestra.console.trial118:power off output: Chassis Power Control: Down/Off 2026-02-12T16:30:38.556 DEBUG:teuthology.orchestra.console.trial118:pexpect command: ipmitool -H trial118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T16:30:38.664 DEBUG:teuthology.orchestra.console.trial118:check power output: Chassis Power is on 2026-02-12T16:30:42.669 DEBUG:teuthology.orchestra.console.trial118:pexpect command: ipmitool -H trial118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T16:30:42.778 DEBUG:teuthology.orchestra.console.trial118:check power output: Chassis Power is off 2026-02-12T16:30:42.778 INFO:teuthology.orchestra.console.trial118:Power off completed 2026-02-12T16:30:42.987 INFO:teuthology.lock.ops:unlocked: trial118.front.sepia.ceph.com