2026-02-25T09:59:21.029 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-25T09:59:21.029 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T09:59:21.102 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T09:59:21.238 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7534ed7beca0>, signals=[15]) 2026-02-25T09:59:21.238 INFO:teuthology.lock.ops:Start node 'trial185.front.sepia.ceph.com' reimaging 2026-02-25T09:59:21.238 INFO:teuthology.lock.ops:Updating [trial185.front.sepia.ceph.com]: reset os type and version on server 2026-02-25T09:59:21.238 INFO:teuthology.lock.ops:Updating trial185.front.sepia.ceph.com on lock server 2026-02-25T09:59:21.418 DEBUG:teuthology.provision.fog.trial185:Requesting image trial_centos_9.stream (ID 3) 2026-02-25T09:59:21.463 INFO:teuthology.provision.fog.trial185:Scheduling deploy of centos 9.stream 2026-02-25T09:59:22.471 INFO:teuthology.orchestra.console.trial185:Power off 2026-02-25T09:59:22.472 DEBUG:teuthology.orchestra.console.trial185:pexpect command: ipmitool -H trial185.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-25T09:59:22.511 DEBUG:teuthology.orchestra.console.trial185:power off output: Chassis Power Control: Down/Off 2026-02-25T09:59:26.515 DEBUG:teuthology.orchestra.console.trial185:pexpect command: ipmitool -H trial185.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T09:59:26.624 DEBUG:teuthology.orchestra.console.trial185:check power output: Chassis Power is off 2026-02-25T09:59:26.624 INFO:teuthology.orchestra.console.trial185:Power off completed 2026-02-25T09:59:26.724 INFO:teuthology.orchestra.console.trial185:Power on 2026-02-25T09:59:26.725 DEBUG:teuthology.orchestra.console.trial185:pexpect command: ipmitool -H trial185.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-25T09:59:26.768 DEBUG:teuthology.orchestra.console.trial185:power on output: Chassis Power Control: Up/On 2026-02-25T09:59:30.773 DEBUG:teuthology.orchestra.console.trial185:pexpect command: ipmitool -H trial185.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T09:59:30.884 DEBUG:teuthology.orchestra.console.trial185:check power output: Chassis Power is on 2026-02-25T09:59:30.885 INFO:teuthology.orchestra.console.trial185:Power on completed 2026-02-25T09:59:30.985 INFO:teuthology.provision.fog.trial185:Waiting for deploy to finish 2026-02-25T10:01:18.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:01:18.890 ERROR:teuthology.orchestra.connection:Error authenticating with trial185.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2026-02-25T10:02:22.893 WARNING:teuthology.provision.fog.trial185:timed out 2026-02-25T10:02:28.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:02:32.128 ERROR:teuthology.orchestra.connection:Error authenticating with trial185.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-25T10:02:36.251 ERROR:teuthology.orchestra.connection:Error authenticating with trial185.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-25T10:02:43.370 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-25T10:02:43.370 DEBUG:teuthology.orchestra.run.trial185:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-25T10:02:43.600 INFO:teuthology.provision.fog.trial185:Node is ready 2026-02-25T10:02:43.600 DEBUG:teuthology.orchestra.run.trial185:> hostname 2026-02-25T10:02:43.661 INFO:teuthology.orchestra.run.trial185.stdout:trial185.front.sepia.ceph.com 2026-02-25T10:02:43.662 DEBUG:teuthology.orchestra.run.trial185:> grep trial185.front.sepia.ceph.com /etc/hosts 2026-02-25T10:02:43.723 INFO:teuthology.orchestra.run.trial185.stdout:10.20.193.185 trial185.front.sepia.ceph.com trial185 2026-02-25T10:02:43.723 DEBUG:teuthology.orchestra.run.trial185:> sudo hostname trial185 2026-02-25T10:02:43.797 DEBUG:teuthology.orchestra.run.trial185:> sudo sed -i -e 's/trial185.front.sepia.ceph.com/trial185/g' /etc/hosts 2026-02-25T10:02:43.867 DEBUG:teuthology.orchestra.run.trial185:> sudo sed -i -e 's/10.20.193.185/10.20.193.185/g' /etc/hosts 2026-02-25T10:02:43.936 DEBUG:teuthology.orchestra.run.trial185:> sudo sed -i -e 's/trial185.front.sepia.ceph.com/trial185/g' /etc/hostname 2026-02-25T10:02:44.007 DEBUG:teuthology.orchestra.run.trial185:> sudo hostname trial185 2026-02-25T10:02:44.077 DEBUG:teuthology.orchestra.run.trial185:> cat /etc/os-release 2026-02-25T10:02:44.137 INFO:teuthology.orchestra.run.trial185.stdout:NAME="CentOS Stream" 2026-02-25T10:02:44.137 INFO:teuthology.orchestra.run.trial185.stdout:VERSION="9" 2026-02-25T10:02:44.138 INFO:teuthology.orchestra.run.trial185.stdout:ID="centos" 2026-02-25T10:02:44.138 INFO:teuthology.orchestra.run.trial185.stdout:ID_LIKE="rhel fedora" 2026-02-25T10:02:44.138 INFO:teuthology.orchestra.run.trial185.stdout:VERSION_ID="9" 2026-02-25T10:02:44.138 INFO:teuthology.orchestra.run.trial185.stdout:PLATFORM_ID="platform:el9" 2026-02-25T10:02:44.138 INFO:teuthology.orchestra.run.trial185.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-25T10:02:44.138 INFO:teuthology.orchestra.run.trial185.stdout:ANSI_COLOR="0;31" 2026-02-25T10:02:44.138 INFO:teuthology.orchestra.run.trial185.stdout:LOGO="fedora-logo-icon" 2026-02-25T10:02:44.138 INFO:teuthology.orchestra.run.trial185.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-25T10:02:44.138 INFO:teuthology.orchestra.run.trial185.stdout:HOME_URL="https://centos.org/" 2026-02-25T10:02:44.138 INFO:teuthology.orchestra.run.trial185.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-25T10:02:44.139 INFO:teuthology.orchestra.run.trial185.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-25T10:02:44.139 INFO:teuthology.orchestra.run.trial185.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-25T10:02:44.140 INFO:teuthology.provision.fog.trial185:Deploy complete! 2026-02-25T10:02:44.141 DEBUG:teuthology.parallel:result is None 2026-02-25T10:02:44.430 INFO:teuthology.lock.ops:Checking trial185.front.sepia.ceph.com 2026-02-25T10:02:44.431 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-25T10:02:44.517 INFO:teuthology.lock.ops:Updating [trial185.front.sepia.ceph.com]: set os type and version on server 2026-02-25T10:02:44.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-25T10:02:44.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T10:02:44.581 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-25T10:02:44.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-25T10:02:44.654 DEBUG:teuthology.orchestra.run.trial185:> uname -m 2026-02-25T10:02:44.714 INFO:teuthology.orchestra.run.trial185.stdout:x86_64 2026-02-25T10:02:44.715 DEBUG:teuthology.orchestra.run.trial185:> cat /etc/os-release 2026-02-25T10:02:44.774 INFO:teuthology.orchestra.run.trial185.stdout:NAME="CentOS Stream" 2026-02-25T10:02:44.774 INFO:teuthology.orchestra.run.trial185.stdout:VERSION="9" 2026-02-25T10:02:44.774 INFO:teuthology.orchestra.run.trial185.stdout:ID="centos" 2026-02-25T10:02:44.774 INFO:teuthology.orchestra.run.trial185.stdout:ID_LIKE="rhel fedora" 2026-02-25T10:02:44.774 INFO:teuthology.orchestra.run.trial185.stdout:VERSION_ID="9" 2026-02-25T10:02:44.774 INFO:teuthology.orchestra.run.trial185.stdout:PLATFORM_ID="platform:el9" 2026-02-25T10:02:44.774 INFO:teuthology.orchestra.run.trial185.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-25T10:02:44.774 INFO:teuthology.orchestra.run.trial185.stdout:ANSI_COLOR="0;31" 2026-02-25T10:02:44.775 INFO:teuthology.orchestra.run.trial185.stdout:LOGO="fedora-logo-icon" 2026-02-25T10:02:44.775 INFO:teuthology.orchestra.run.trial185.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-25T10:02:44.775 INFO:teuthology.orchestra.run.trial185.stdout:HOME_URL="https://centos.org/" 2026-02-25T10:02:44.775 INFO:teuthology.orchestra.run.trial185.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-25T10:02:44.775 INFO:teuthology.orchestra.run.trial185.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-25T10:02:44.775 INFO:teuthology.orchestra.run.trial185.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-25T10:02:44.776 INFO:teuthology.lock.ops:Updating trial185.front.sepia.ceph.com on lock server 2026-02-25T10:02:44.880 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:02:44.982 INFO:teuthology.dispatcher.supervisor:Running job 69393 2026-02-25T10:02:44.982 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_matan@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/matan-2026-02-25_08:02:37-crimson-rados-main-distro-default-trial/69393 --name matan-2026-02-25_08:02:37-crimson-rados-main-distro-default-trial --description crimson-rados/perf/{0-crimson_install clusters/{crimson-fixed-1} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} perf_ignorelist settings/optimized workloads/radosbench_4M_seq_read} -- /home/teuthworker/mnt/teuthology/matan-2026-02-25_08:02:37-crimson-rados-main-distro-default-trial/69393/orig.config.yaml 2026-02-25T10:02:44.982 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/matan-2026-02-25_08:02:37-crimson-rados-main-distro-default-trial/69393 2026-02-25T10:02:44.982 INFO:teuthology.dispatcher.supervisor:Job PID: 4165778 2026-02-25T10:02:44.982 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-25T10:04:44.983 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:06:45.102 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:08:45.221 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:10:45.339 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:12:45.416 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:14:45.499 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:16:45.631 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:18:45.749 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:20:45.857 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:22:45.963 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:24:46.044 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:26:46.165 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:28:46.284 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:30:46.412 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:32:46.534 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:34:46.653 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:36:46.783 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:38:46.915 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:40:47.035 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:42:47.155 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:44:47.275 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:46:47.346 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:48:48.285 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:50:48.406 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:52:48.530 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:54:48.638 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:56:48.722 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T10:58:48.836 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:00:48.951 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:02:49.073 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:04:49.148 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:06:49.267 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:08:49.354 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:10:49.476 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:12:49.597 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:14:49.673 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:16:49.747 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:18:49.868 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:20:49.990 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:22:50.742 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:24:51.003 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:26:51.099 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:28:51.176 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:30:51.259 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:32:51.383 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:34:51.508 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:36:51.616 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:38:51.700 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:40:51.783 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:42:51.926 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:44:52.021 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:46:52.139 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:48:52.234 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:50:52.358 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:52:52.478 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:54:52.602 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:56:52.686 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T11:58:52.784 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:00:52.871 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:02:52.944 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:04:53.064 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:06:53.188 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:08:53.289 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:10:53.411 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:12:53.494 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:14:54.249 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:16:54.337 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:18:54.415 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:20:54.540 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:22:54.663 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:24:54.792 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:26:54.875 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:28:54.963 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:30:55.042 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:32:55.174 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:34:55.296 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:36:55.386 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:38:55.514 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:40:55.586 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:42:55.748 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:44:56.505 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:46:56.621 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:48:56.749 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:50:56.831 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:52:56.957 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:54:57.231 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:56:57.447 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:58:57.566 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:00:57.694 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:02:58.151 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:04:58.273 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:06:58.393 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:08:58.515 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:10:58.638 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:12:58.759 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:14:58.837 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:16:58.915 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:18:58.995 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:20:59.222 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:22:59.484 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:25:00.392 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:27:00.514 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:29:00.636 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:31:00.765 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:33:00.869 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:35:00.954 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:37:01.078 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:39:01.183 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:41:01.452 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:43:01.550 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:45:01.638 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:47:01.761 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:49:01.883 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:51:01.991 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:53:02.098 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:55:02.170 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:57:02.291 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T13:59:02.400 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:01:02.512 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:03:02.639 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:05:02.759 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:07:02.882 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:09:03.004 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:11:03.125 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:13:03.199 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:15:03.319 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:17:03.437 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:19:03.551 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:21:03.674 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:23:03.795 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:25:03.894 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:27:04.014 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:29:04.135 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:31:04.256 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:33:04.381 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:35:04.618 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:37:04.739 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:39:04.865 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:41:04.985 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:43:05.106 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:45:05.258 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:47:05.332 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:49:05.452 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:51:05.557 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:53:05.680 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:55:05.793 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:57:05.914 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:59:06.035 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:01:06.160 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:03:06.255 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:05:06.375 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:07:06.495 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:09:06.616 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:11:11.068 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:13:11.188 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:15:11.315 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:17:11.437 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:19:11.560 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:21:11.682 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:23:11.805 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:25:11.931 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:27:12.051 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:29:12.182 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:31:12.264 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:33:12.385 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:35:12.509 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:37:12.580 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:39:12.700 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:41:12.828 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:43:12.951 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:45:13.041 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:47:13.163 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:49:13.292 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:51:13.388 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:53:13.513 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:55:13.619 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:57:13.748 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:59:13.871 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T16:01:13.968 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T16:03:14.093 WARNING:teuthology.dispatcher.supervisor:Job matan-2026-02-25_08:02:37-crimson-rados-main-distro-default-trial/69393 ran longer than 21600s. Killing... 2026-02-25T16:03:14.230 INFO:teuthology.kill:Killing Pids: {4165778} 2026-02-25T16:03:14.231 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T16:03:14.351 INFO:teuthology.task.internal:roles: ubuntu@trial185.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-25T16:03:14.351 INFO:teuthology.misc:Compressing logs... 2026-02-25T16:03:14.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-25T16:03:14.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T16:03:14.421 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-25T16:03:14.495 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-25T16:03:14.495 DEBUG:teuthology.orchestra.run.trial185:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T16:03:14.567 DEBUG:teuthology.misc:Transferring archived files from trial185:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/matan-2026-02-25_08:02:37-crimson-rados-main-distro-default-trial/69393/remote/trial185/crash 2026-02-25T16:03:14.568 DEBUG:teuthology.orchestra.run.trial185:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-25T16:03:14.629 INFO:teuthology.misc:Compressing logs... 2026-02-25T16:03:14.629 DEBUG:teuthology.orchestra.run.trial185:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T16:03:14.694 INFO:teuthology.orchestra.run.trial185.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T16:03:14.696 INFO:teuthology.orchestra.run.trial185.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T16:03:14.696 INFO:teuthology.orchestra.run.trial185.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-25T16:03:14.696 INFO:teuthology.orchestra.run.trial185.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-25T16:03:14.697 DEBUG:teuthology.misc:Transferring archived files from trial185:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/matan-2026-02-25_08:02:37-crimson-rados-main-distro-default-trial/69393/remote/trial185/ 2026-02-25T16:03:14.698 DEBUG:teuthology.orchestra.run.trial185:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-25T16:03:14.768 INFO:teuthology.misc:Compressing logs... 2026-02-25T16:03:14.768 DEBUG:teuthology.orchestra.run.trial185:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T16:03:14.843 INFO:teuthology.orchestra.run.trial185.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-25T16:03:14.844 INFO:teuthology.orchestra.run.trial185.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42010.log 2026-02-25T16:03:14.844 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-25T16:03:14.844 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.42010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41522.log 2026-02-25T16:03:14.844 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-mon.a.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42010.log.gz 2026-02-25T16:03:14.844 INFO:teuthology.orchestra.run.trial185.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-25T16:03:14.844 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.41522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45182.log 2026-02-25T16:03:14.844 INFO:teuthology.orchestra.run.trial185.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41522.log.gz 2026-02-25T16:03:14.844 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42446.log 2026-02-25T16:03:14.844 INFO:teuthology.orchestra.run.trial185.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42397.log 2026-02-25T16:03:14.844 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.45182.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45182.log.gz 2026-02-25T16:03:14.845 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.42446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42130.log 2026-02-25T16:03:14.845 INFO:teuthology.orchestra.run.trial185.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42446.log.gz 2026-02-25T16:03:14.845 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.42397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40989.log 2026-02-25T16:03:14.845 INFO:teuthology.orchestra.run.trial185.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42397.log.gz 2026-02-25T16:03:14.845 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.42130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41662.log 2026-02-25T16:03:14.845 INFO:teuthology.orchestra.run.trial185.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42130.log.gz 2026-02-25T16:03:14.845 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.40989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41711.log 2026-02-25T16:03:14.845 INFO:teuthology.orchestra.run.trial185.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40989.log.gz 2026-02-25T16:03:14.845 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.41662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41547.log 2026-02-25T16:03:14.845 INFO:teuthology.orchestra.run.trial185.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41662.log.gz 2026-02-25T16:03:14.845 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.41711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45330.log 2026-02-25T16:03:14.845 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.41547.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41711.log.gz 2026-02-25T16:03:14.846 INFO:teuthology.orchestra.run.trial185.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42008.log 2026-02-25T16:03:14.846 INFO:teuthology.orchestra.run.trial185.stderr: 66.9% -- replaced with /var/log/ceph/ceph-client.admin.41547.log.gz 2026-02-25T16:03:14.846 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.45330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41613.log 2026-02-25T16:03:14.846 INFO:teuthology.orchestra.run.trial185.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45330.log.gz 2026-02-25T16:03:14.846 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.42008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40757.log 2026-02-25T16:03:14.846 INFO:teuthology.orchestra.run.trial185.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42008.log.gz 2026-02-25T16:03:14.846 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.41613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41302.log 2026-02-25T16:03:14.846 INFO:teuthology.orchestra.run.trial185.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41613.log.gz 2026-02-25T16:03:14.846 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.40757.log: 95.9%gzip -- replaced with /var/log/ceph/ceph-mon.a.log.gz -5 2026-02-25T16:03:14.846 INFO:teuthology.orchestra.run.trial185.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41862.log 2026-02-25T16:03:14.846 INFO:teuthology.orchestra.run.trial185.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40757.log.gz 2026-02-25T16:03:14.847 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.41302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42196.log 2026-02-25T16:03:14.847 INFO:teuthology.orchestra.run.trial185.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41302.log.gz 2026-02-25T16:03:14.847 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.41862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42274.log 2026-02-25T16:03:14.847 INFO:teuthology.orchestra.run.trial185.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41862.log.gz 2026-02-25T16:03:14.847 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.42196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42495.log 2026-02-25T16:03:14.847 INFO:teuthology.orchestra.run.trial185.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42196.log.gz 2026-02-25T16:03:14.847 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.42274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42316.log 2026-02-25T16:03:14.847 INFO:teuthology.orchestra.run.trial185.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42274.log.gz 2026-02-25T16:03:14.847 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.42495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41861.log 2026-02-25T16:03:14.847 INFO:teuthology.orchestra.run.trial185.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42495.log.gz 2026-02-25T16:03:14.847 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.42316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42009.log 2026-02-25T16:03:14.847 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.41861.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42316.log.gz 2026-02-25T16:03:14.848 INFO:teuthology.orchestra.run.trial185.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45884.log 2026-02-25T16:03:14.848 INFO:teuthology.orchestra.run.trial185.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41861.log.gz 2026-02-25T16:03:14.848 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.42009.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-25T16:03:14.848 INFO:teuthology.orchestra.run.trial185.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42009.log.gz 2026-02-25T16:03:14.848 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.45884.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-25T16:03:14.848 INFO:teuthology.orchestra.run.trial185.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.45884.log.gz 2026-02-25T16:03:14.848 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42129.log 2026-02-25T16:03:14.848 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41256.log 2026-02-25T16:03:14.848 INFO:teuthology.orchestra.run.trial185.stderr: 87.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-25T16:03:14.848 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.42129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45886.log 2026-02-25T16:03:14.848 INFO:teuthology.orchestra.run.trial185.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42129.log.gz 2026-02-25T16:03:14.848 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.41256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45240.log 2026-02-25T16:03:14.848 INFO:teuthology.orchestra.run.trial185.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41256.log.gz 2026-02-25T16:03:14.849 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.45886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41452.log 2026-02-25T16:03:14.849 INFO:teuthology.orchestra.run.trial185.stderr: 52.0% -- replaced with /var/log/ceph/ceph-client.admin.45886.log.gz 2026-02-25T16:03:14.849 INFO:teuthology.orchestra.run.trial185.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-25T16:03:14.849 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.45240.log: /var/log/ceph/ceph-client.admin.41452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45276.log 2026-02-25T16:03:14.849 INFO:teuthology.orchestra.run.trial185.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45240.log.gz 2026-02-25T16:03:14.849 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-mgr.x.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41452.log.gz 2026-02-25T16:03:14.849 INFO:teuthology.orchestra.run.trial185.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40942.log 2026-02-25T16:03:14.849 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.45276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40661.log 2026-02-25T16:03:14.849 INFO:teuthology.orchestra.run.trial185.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45276.log.gz 2026-02-25T16:03:14.849 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.40942.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.39383.log 2026-02-25T16:03:14.849 INFO:teuthology.orchestra.run.trial185.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40942.log.gz 2026-02-25T16:03:14.849 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.40661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41863.log 2026-02-25T16:03:14.850 INFO:teuthology.orchestra.run.trial185.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40661.log.gz 2026-02-25T16:03:14.850 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph.tmp-client.admin.39383.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-25T16:03:14.850 INFO:teuthology.orchestra.run.trial185.stderr: 68.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.39383.log.gz 2026-02-25T16:03:14.850 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.41863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41036.log 2026-02-25T16:03:14.850 INFO:teuthology.orchestra.run.trial185.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41863.log.gz 2026-02-25T16:03:14.850 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41760.log 2026-02-25T16:03:14.850 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.41036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42277.log 2026-02-25T16:03:14.850 INFO:teuthology.orchestra.run.trial185.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41036.log.gz 2026-02-25T16:03:14.852 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.41760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40805.log 2026-02-25T16:03:14.852 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.42277.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.41760.log.gz 2026-02-25T16:03:14.852 INFO:teuthology.orchestra.run.trial185.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45126.log 2026-02-25T16:03:14.852 INFO:teuthology.orchestra.run.trial185.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42277.log.gz 2026-02-25T16:03:14.852 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.40805.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40805.log.gz 2026-02-25T16:03:14.852 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.45126.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45126.log.gz 2026-02-25T16:03:14.853 INFO:teuthology.orchestra.run.trial185.stderr: 91.9% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-25T16:03:15.244 INFO:teuthology.orchestra.run.trial185.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-25T16:03:17.895 INFO:teuthology.orchestra.run.trial185.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-25T16:03:18.005 INFO:teuthology.orchestra.run.trial185.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-25T16:03:18.172 INFO:teuthology.orchestra.run.trial185.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-25T16:03:18.174 DEBUG:teuthology.misc:Transferring archived files from trial185:/var/log/ceph to /home/teuthworker/mnt/teuthology/matan-2026-02-25_08:02:37-crimson-rados-main-distro-default-trial/69393/remote/trial185/log 2026-02-25T16:03:18.175 DEBUG:teuthology.orchestra.run.trial185:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-25T16:03:19.091 INFO:teuthology.kill:No teuthology processes running 2026-02-25T16:03:19.091 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T16:03:19.544 INFO:teuthology.orchestra.console.trial185:Power off 2026-02-25T16:03:19.544 DEBUG:teuthology.orchestra.console.trial185:pexpect command: ipmitool -H trial185.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-25T16:03:19.583 DEBUG:teuthology.orchestra.console.trial185:power off output: Chassis Power Control: Down/Off 2026-02-25T16:03:23.583 DEBUG:teuthology.orchestra.console.trial185:pexpect command: ipmitool -H trial185.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T16:03:23.696 DEBUG:teuthology.orchestra.console.trial185:check power output: Chassis Power is on 2026-02-25T16:03:27.697 DEBUG:teuthology.orchestra.console.trial185:pexpect command: ipmitool -H trial185.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T16:03:27.808 DEBUG:teuthology.orchestra.console.trial185:check power output: Chassis Power is off 2026-02-25T16:03:27.808 INFO:teuthology.orchestra.console.trial185:Power off completed 2026-02-25T16:03:28.019 INFO:teuthology.lock.ops:unlocked: trial185.front.sepia.ceph.com 2026-02-25T16:03:28.020 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T16:05:28.092 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T16:05:28.210 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2026-02-25T16:05:28.290 WARNING:teuthology.dispatcher.supervisor:Was going to unlock trial185 but it was locked by another job: /home/teuthworker/mnt/teuthology/yuriw-2026-02-25_15:27:50-fs-reef-release-distro-default-trial/70309