2026-02-24T07:08:11.486 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-24T07:08:11.486 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:08:11.560 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:08:11.769 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x77a285ea79b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x77a285697ec0>, signals=[15])
2026-02-24T07:08:11.769 INFO:teuthology.lock.ops:Start node 'trial109.front.sepia.ceph.com' reimaging
2026-02-24T07:08:11.769 INFO:teuthology.lock.ops:Updating [trial109.front.sepia.ceph.com]: reset os type and version on server
2026-02-24T07:08:11.769 INFO:teuthology.lock.ops:Updating trial109.front.sepia.ceph.com on lock server
2026-02-24T07:08:11.826 INFO:teuthology.lock.ops:Start node 'trial139.front.sepia.ceph.com' reimaging
2026-02-24T07:08:11.827 INFO:teuthology.lock.ops:Updating [trial139.front.sepia.ceph.com]: reset os type and version on server
2026-02-24T07:08:11.827 INFO:teuthology.lock.ops:Updating trial139.front.sepia.ceph.com on lock server
2026-02-24T07:08:12.035 DEBUG:teuthology.provision.fog.trial139:Requesting image trial_centos_9.stream (ID 3)
2026-02-24T07:08:12.038 DEBUG:teuthology.provision.fog.trial109:Requesting image trial_centos_9.stream (ID 3)
2026-02-24T07:08:12.075 INFO:teuthology.provision.fog.trial109:Scheduling deploy of centos 9.stream
2026-02-24T07:08:12.091 INFO:teuthology.provision.fog.trial139:Scheduling deploy of centos 9.stream
2026-02-24T07:08:13.634 INFO:teuthology.orchestra.console.trial109:Power off
2026-02-24T07:08:13.634 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T07:08:13.654 INFO:teuthology.orchestra.console.trial139:Power off
2026-02-24T07:08:13.655 DEBUG:teuthology.orchestra.console.trial139:pexpect command: ipmitool -H trial139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T07:08:13.673 DEBUG:teuthology.orchestra.console.trial109:power off output: Chassis Power Control: Down/Off
2026-02-24T07:08:13.691 DEBUG:teuthology.orchestra.console.trial139:power off output: Chassis Power Control: Down/Off
2026-02-24T07:08:17.678 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T07:08:17.692 DEBUG:teuthology.orchestra.console.trial139:pexpect command: ipmitool -H trial139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T07:08:17.789 DEBUG:teuthology.orchestra.console.trial109:check power output: Chassis Power is off
2026-02-24T07:08:17.789 INFO:teuthology.orchestra.console.trial109:Power off completed
2026-02-24T07:08:17.800 DEBUG:teuthology.orchestra.console.trial139:check power output: Chassis Power is off
2026-02-24T07:08:17.800 INFO:teuthology.orchestra.console.trial139:Power off completed
2026-02-24T07:08:17.891 INFO:teuthology.orchestra.console.trial109:Power on
2026-02-24T07:08:17.891 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-24T07:08:17.901 INFO:teuthology.orchestra.console.trial139:Power on
2026-02-24T07:08:17.901 DEBUG:teuthology.orchestra.console.trial139:pexpect command: ipmitool -H trial139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-24T07:08:17.932 DEBUG:teuthology.orchestra.console.trial109:power on output: Chassis Power Control: Up/On
2026-02-24T07:08:17.947 DEBUG:teuthology.orchestra.console.trial139:power on output: Chassis Power Control: Up/On
2026-02-24T07:08:21.938 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T07:08:21.947 DEBUG:teuthology.orchestra.console.trial139:pexpect command: ipmitool -H trial139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T07:08:22.048 DEBUG:teuthology.orchestra.console.trial109:check power output: Chassis Power is on
2026-02-24T07:08:22.049 INFO:teuthology.orchestra.console.trial109:Power on completed
2026-02-24T07:08:22.056 DEBUG:teuthology.orchestra.console.trial139:check power output: Chassis Power is on
2026-02-24T07:08:22.056 INFO:teuthology.orchestra.console.trial139:Power on completed
2026-02-24T07:08:22.150 INFO:teuthology.provision.fog.trial109:Waiting for deploy to finish
2026-02-24T07:08:22.156 INFO:teuthology.provision.fog.trial139:Waiting for deploy to finish
2026-02-24T07:10:10.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T07:10:10.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T07:10:10.400 ERROR:teuthology.orchestra.connection:Error authenticating with trial139.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-24T07:10:49.216 WARNING:teuthology.provision.fog.trial109:[Errno None] Unable to connect to port 22 on 10.20.193.109
2026-02-24T07:10:53.312 WARNING:teuthology.provision.fog.trial139:[Errno None] Unable to connect to port 22 on 10.20.193.139
2026-02-24T07:10:55.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T07:10:59.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T07:11:31.318 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-24T07:11:31.318 DEBUG:teuthology.orchestra.run.trial109:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-24T07:11:31.537 INFO:teuthology.provision.fog.trial109:Node is ready
2026-02-24T07:11:31.538 DEBUG:teuthology.orchestra.run.trial109:> hostname
2026-02-24T07:11:31.597 INFO:teuthology.orchestra.run.trial109.stdout:trial109.front.sepia.ceph.com
2026-02-24T07:11:31.598 DEBUG:teuthology.orchestra.run.trial109:> grep trial109.front.sepia.ceph.com /etc/hosts
2026-02-24T07:11:31.659 INFO:teuthology.orchestra.run.trial109.stdout:10.20.193.109 trial109.front.sepia.ceph.com trial109
2026-02-24T07:11:31.659 DEBUG:teuthology.orchestra.run.trial109:> sudo hostname trial109
2026-02-24T07:11:31.733 DEBUG:teuthology.orchestra.run.trial109:> sudo sed -i -e 's/trial109.front.sepia.ceph.com/trial109/g' /etc/hosts
2026-02-24T07:11:31.802 DEBUG:teuthology.orchestra.run.trial109:> sudo sed -i -e 's/10.20.193.109/10.20.193.109/g' /etc/hosts
2026-02-24T07:11:31.870 DEBUG:teuthology.orchestra.run.trial109:> sudo sed -i -e 's/trial109.front.sepia.ceph.com/trial109/g' /etc/hostname
2026-02-24T07:11:31.939 DEBUG:teuthology.orchestra.run.trial109:> sudo hostname trial109
2026-02-24T07:11:32.005 DEBUG:teuthology.orchestra.run.trial109:> cat /etc/os-release
2026-02-24T07:11:32.064 INFO:teuthology.orchestra.run.trial109.stdout:NAME="CentOS Stream"
2026-02-24T07:11:32.065 INFO:teuthology.orchestra.run.trial109.stdout:VERSION="9"
2026-02-24T07:11:32.065 INFO:teuthology.orchestra.run.trial109.stdout:ID="centos"
2026-02-24T07:11:32.065 INFO:teuthology.orchestra.run.trial109.stdout:ID_LIKE="rhel fedora"
2026-02-24T07:11:32.065 INFO:teuthology.orchestra.run.trial109.stdout:VERSION_ID="9"
2026-02-24T07:11:32.065 INFO:teuthology.orchestra.run.trial109.stdout:PLATFORM_ID="platform:el9"
2026-02-24T07:11:32.065 INFO:teuthology.orchestra.run.trial109.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T07:11:32.065 INFO:teuthology.orchestra.run.trial109.stdout:ANSI_COLOR="0;31"
2026-02-24T07:11:32.065 INFO:teuthology.orchestra.run.trial109.stdout:LOGO="fedora-logo-icon"
2026-02-24T07:11:32.065 INFO:teuthology.orchestra.run.trial109.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T07:11:32.065 INFO:teuthology.orchestra.run.trial109.stdout:HOME_URL="https://centos.org/"
2026-02-24T07:11:32.066 INFO:teuthology.orchestra.run.trial109.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T07:11:32.066 INFO:teuthology.orchestra.run.trial109.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T07:11:32.066 INFO:teuthology.orchestra.run.trial109.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T07:11:32.067 INFO:teuthology.provision.fog.trial109:Deploy complete!
2026-02-24T07:11:32.068 DEBUG:teuthology.parallel:result is None
2026-02-24T07:11:35.408 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-24T07:11:35.408 DEBUG:teuthology.orchestra.run.trial139:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-24T07:11:35.618 INFO:teuthology.provision.fog.trial139:Node is ready
2026-02-24T07:11:35.619 DEBUG:teuthology.orchestra.run.trial139:> hostname
2026-02-24T07:11:35.674 INFO:teuthology.orchestra.run.trial139.stdout:trial139.front.sepia.ceph.com
2026-02-24T07:11:35.675 DEBUG:teuthology.orchestra.run.trial139:> grep trial139.front.sepia.ceph.com /etc/hosts
2026-02-24T07:11:35.732 INFO:teuthology.orchestra.run.trial139.stdout:10.20.193.139 trial139.front.sepia.ceph.com trial139
2026-02-24T07:11:35.732 DEBUG:teuthology.orchestra.run.trial139:> sudo hostname trial139
2026-02-24T07:11:35.802 DEBUG:teuthology.orchestra.run.trial139:> sudo sed -i -e 's/trial139.front.sepia.ceph.com/trial139/g' /etc/hosts
2026-02-24T07:11:35.883 DEBUG:teuthology.orchestra.run.trial139:> sudo sed -i -e 's/10.20.193.139/10.20.193.139/g' /etc/hosts
2026-02-24T07:11:36.031 DEBUG:teuthology.orchestra.run.trial139:> sudo sed -i -e 's/trial139.front.sepia.ceph.com/trial139/g' /etc/hostname
2026-02-24T07:11:36.061 DEBUG:teuthology.orchestra.run.trial139:> sudo hostname trial139
2026-02-24T07:11:36.128 DEBUG:teuthology.orchestra.run.trial139:> cat /etc/os-release
2026-02-24T07:11:36.191 INFO:teuthology.orchestra.run.trial139.stdout:NAME="CentOS Stream"
2026-02-24T07:11:36.192 INFO:teuthology.orchestra.run.trial139.stdout:VERSION="9"
2026-02-24T07:11:36.192 INFO:teuthology.orchestra.run.trial139.stdout:ID="centos"
2026-02-24T07:11:36.192 INFO:teuthology.orchestra.run.trial139.stdout:ID_LIKE="rhel fedora"
2026-02-24T07:11:36.192 INFO:teuthology.orchestra.run.trial139.stdout:VERSION_ID="9"
2026-02-24T07:11:36.192 INFO:teuthology.orchestra.run.trial139.stdout:PLATFORM_ID="platform:el9"
2026-02-24T07:11:36.193 INFO:teuthology.orchestra.run.trial139.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T07:11:36.193 INFO:teuthology.orchestra.run.trial139.stdout:ANSI_COLOR="0;31"
2026-02-24T07:11:36.193 INFO:teuthology.orchestra.run.trial139.stdout:LOGO="fedora-logo-icon"
2026-02-24T07:11:36.193 INFO:teuthology.orchestra.run.trial139.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T07:11:36.193 INFO:teuthology.orchestra.run.trial139.stdout:HOME_URL="https://centos.org/"
2026-02-24T07:11:36.193 INFO:teuthology.orchestra.run.trial139.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T07:11:36.193 INFO:teuthology.orchestra.run.trial139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T07:11:36.193 INFO:teuthology.orchestra.run.trial139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T07:11:36.195 INFO:teuthology.provision.fog.trial139:Deploy complete!
2026-02-24T07:11:36.198 DEBUG:teuthology.parallel:result is None
2026-02-24T07:11:36.599 INFO:teuthology.lock.ops:Checking trial109.front.sepia.ceph.com
2026-02-24T07:11:36.599 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-24T07:11:36.697 INFO:teuthology.lock.ops:Checking trial139.front.sepia.ceph.com
2026-02-24T07:11:36.697 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-24T07:11:36.758 INFO:teuthology.lock.ops:Updating [trial109.front.sepia.ceph.com]: set os type and version on server
2026-02-24T07:11:36.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com'
2026-02-24T07:11:36.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T07:11:36.819 DEBUG:teuthology.orchestra.run.trial109:> true
2026-02-24T07:11:36.894 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com'
2026-02-24T07:11:36.895 DEBUG:teuthology.orchestra.run.trial109:> uname -m
2026-02-24T07:11:36.950 INFO:teuthology.orchestra.run.trial109.stdout:x86_64
2026-02-24T07:11:36.951 DEBUG:teuthology.orchestra.run.trial109:> cat /etc/os-release
2026-02-24T07:11:37.006 INFO:teuthology.orchestra.run.trial109.stdout:NAME="CentOS Stream"
2026-02-24T07:11:37.007 INFO:teuthology.orchestra.run.trial109.stdout:VERSION="9"
2026-02-24T07:11:37.007 INFO:teuthology.orchestra.run.trial109.stdout:ID="centos"
2026-02-24T07:11:37.007 INFO:teuthology.orchestra.run.trial109.stdout:ID_LIKE="rhel fedora"
2026-02-24T07:11:37.007 INFO:teuthology.orchestra.run.trial109.stdout:VERSION_ID="9"
2026-02-24T07:11:37.007 INFO:teuthology.orchestra.run.trial109.stdout:PLATFORM_ID="platform:el9"
2026-02-24T07:11:37.007 INFO:teuthology.orchestra.run.trial109.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T07:11:37.007 INFO:teuthology.orchestra.run.trial109.stdout:ANSI_COLOR="0;31"
2026-02-24T07:11:37.007 INFO:teuthology.orchestra.run.trial109.stdout:LOGO="fedora-logo-icon"
2026-02-24T07:11:37.007 INFO:teuthology.orchestra.run.trial109.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T07:11:37.007 INFO:teuthology.orchestra.run.trial109.stdout:HOME_URL="https://centos.org/"
2026-02-24T07:11:37.008 INFO:teuthology.orchestra.run.trial109.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T07:11:37.008 INFO:teuthology.orchestra.run.trial109.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T07:11:37.008 INFO:teuthology.orchestra.run.trial109.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T07:11:37.009 INFO:teuthology.lock.ops:Updating trial109.front.sepia.ceph.com on lock server
2026-02-24T07:11:37.109 INFO:teuthology.lock.ops:Updating [trial139.front.sepia.ceph.com]: set os type and version on server
2026-02-24T07:11:37.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial139.front.sepia.ceph.com'
2026-02-24T07:11:37.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T07:11:37.182 DEBUG:teuthology.orchestra.run.trial139:> true
2026-02-24T07:11:37.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial139.front.sepia.ceph.com'
2026-02-24T07:11:37.256 DEBUG:teuthology.orchestra.run.trial139:> uname -m
2026-02-24T07:11:37.311 INFO:teuthology.orchestra.run.trial139.stdout:x86_64
2026-02-24T07:11:37.312 DEBUG:teuthology.orchestra.run.trial139:> cat /etc/os-release
2026-02-24T07:11:37.367 INFO:teuthology.orchestra.run.trial139.stdout:NAME="CentOS Stream"
2026-02-24T07:11:37.368 INFO:teuthology.orchestra.run.trial139.stdout:VERSION="9"
2026-02-24T07:11:37.368 INFO:teuthology.orchestra.run.trial139.stdout:ID="centos"
2026-02-24T07:11:37.368 INFO:teuthology.orchestra.run.trial139.stdout:ID_LIKE="rhel fedora"
2026-02-24T07:11:37.368 INFO:teuthology.orchestra.run.trial139.stdout:VERSION_ID="9"
2026-02-24T07:11:37.368 INFO:teuthology.orchestra.run.trial139.stdout:PLATFORM_ID="platform:el9"
2026-02-24T07:11:37.368 INFO:teuthology.orchestra.run.trial139.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T07:11:37.368 INFO:teuthology.orchestra.run.trial139.stdout:ANSI_COLOR="0;31"
2026-02-24T07:11:37.368 INFO:teuthology.orchestra.run.trial139.stdout:LOGO="fedora-logo-icon"
2026-02-24T07:11:37.368 INFO:teuthology.orchestra.run.trial139.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T07:11:37.368 INFO:teuthology.orchestra.run.trial139.stdout:HOME_URL="https://centos.org/"
2026-02-24T07:11:37.369 INFO:teuthology.orchestra.run.trial139.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T07:11:37.369 INFO:teuthology.orchestra.run.trial139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T07:11:37.369 INFO:teuthology.orchestra.run.trial139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T07:11:37.369 INFO:teuthology.lock.ops:Updating trial139.front.sepia.ceph.com on lock server
2026-02-24T07:11:37.472 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:11:37.568 INFO:teuthology.dispatcher.supervisor:Running job 67576
2026-02-24T07:11:37.568 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_shraddhaag@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67576 --name shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/cephadm objectstore/crimson_bluestore thrashers/{default} thrashosds-health workloads/admin_socket_objecter_requests} -- /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67576/orig.config.yaml
2026-02-24T07:11:37.568 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67576
2026-02-24T07:11:37.568 INFO:teuthology.dispatcher.supervisor:Job PID: 2731156
2026-02-24T07:11:37.568 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-24T07:13:37.569 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:15:37.695 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:17:37.949 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:19:38.071 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:21:38.194 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:23:40.054 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:25:40.175 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:27:40.296 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:29:40.418 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:31:40.540 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:33:40.623 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:35:40.742 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:37:40.862 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:39:40.967 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:41:41.047 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:43:41.136 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:45:41.233 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:47:41.318 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:49:41.422 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:51:41.540 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:53:41.646 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:55:41.766 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:57:41.886 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T07:59:42.016 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:01:42.138 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:03:42.215 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:05:42.337 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:07:42.427 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:09:42.549 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:11:42.621 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:13:42.744 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:15:42.867 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:17:42.981 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:19:43.073 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:21:43.229 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:23:43.350 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:25:43.471 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:27:43.591 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:29:43.715 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:31:43.837 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:33:43.958 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:35:44.078 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:37:44.646 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:39:44.769 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:41:44.877 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:43:44.984 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:45:45.105 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:47:45.226 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:49:45.342 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:51:45.464 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:53:45.585 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:55:45.712 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:57:45.836 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T08:59:45.956 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:01:46.122 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:03:46.243 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:05:46.366 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:07:46.487 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:09:46.573 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:11:46.696 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:13:46.820 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:15:46.941 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:17:47.068 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:19:47.193 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:21:47.323 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:23:47.447 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:25:47.570 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:27:47.693 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:29:47.809 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:31:47.937 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:33:48.064 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:35:48.240 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:37:48.367 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:39:48.484 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:41:48.607 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:43:48.729 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:45:48.850 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:47:48.963 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:49:49.084 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:51:49.212 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:53:49.289 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:55:49.419 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:57:49.493 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:59:49.611 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:01:49.694 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:03:49.815 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:05:49.939 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:07:50.064 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:09:50.137 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:11:50.228 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:13:50.368 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:15:50.488 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:17:50.588 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:19:50.716 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:21:50.814 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:23:50.940 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:25:51.060 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:27:51.159 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:29:51.278 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:31:51.381 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:33:51.503 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:35:52.170 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:37:52.286 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:39:52.413 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:41:52.531 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:43:52.660 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:45:52.794 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:47:52.916 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:49:52.996 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:51:53.119 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:53:53.245 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:55:53.322 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:57:53.462 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:59:53.583 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:01:53.703 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:03:53.829 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:05:53.949 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:07:54.078 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:09:54.201 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:11:54.324 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:13:54.449 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:15:54.574 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:17:54.697 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:19:54.821 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:21:54.946 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:23:55.068 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:25:55.190 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:27:55.311 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:29:55.400 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:31:55.520 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:33:55.642 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:35:55.807 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:37:55.929 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:39:56.539 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:41:56.731 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:43:56.852 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:45:56.972 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:47:57.093 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:49:57.216 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:51:57.343 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:53:57.447 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:55:57.526 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:57:57.651 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:59:57.782 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:01:57.913 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:03:58.038 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:05:58.161 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:07:58.287 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:09:58.406 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:11:58.541 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:13:58.661 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:15:58.771 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:17:58.892 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:19:59.018 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:21:59.125 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:23:59.575 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:26:01.149 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:28:03.641 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:30:03.763 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:32:03.888 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:34:04.013 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:36:04.137 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:38:04.248 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:40:04.347 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:42:04.467 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:44:04.584 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:46:04.700 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:48:04.773 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:50:04.893 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:52:05.014 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:54:05.141 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:56:05.262 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T12:58:05.383 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:00:05.503 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:02:05.586 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:04:05.716 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:06:05.800 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:08:05.917 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:10:06.042 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:12:06.162 WARNING:teuthology.dispatcher.supervisor:Job shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67576 ran longer than 21600s. Killing...
2026-02-24T13:12:06.300 INFO:teuthology.kill:Killing Pids: {2731156}
2026-02-24T13:12:06.302 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:12:06.416 INFO:teuthology.task.internal:roles: ubuntu@trial109.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a']
2026-02-24T13:12:06.416 INFO:teuthology.task.internal:roles: ubuntu@trial139.front.sepia.ceph.com - ['osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']
2026-02-24T13:12:06.417 INFO:teuthology.misc:Compressing logs...
2026-02-24T13:12:06.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com'
2026-02-24T13:12:06.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:12:06.485 DEBUG:teuthology.orchestra.run.trial109:> true
2026-02-24T13:12:06.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com'
2026-02-24T13:12:06.568 DEBUG:teuthology.orchestra.run.trial109:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2026-02-24T13:12:06.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial139.front.sepia.ceph.com'
2026-02-24T13:12:06.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:12:06.716 DEBUG:teuthology.orchestra.run.trial139:> true
2026-02-24T13:12:06.790 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial139.front.sepia.ceph.com'
2026-02-24T13:12:06.791 DEBUG:teuthology.orchestra.run.trial139:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2026-02-24T13:12:06.861 DEBUG:teuthology.misc:Transferring archived files from trial109:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67576/remote/trial109/crash
2026-02-24T13:12:06.862 DEBUG:teuthology.orchestra.run.trial109:> sudo tar c -f - -C /var/lib/ceph/crash -- .
2026-02-24T13:12:06.888 DEBUG:teuthology.misc:Transferring archived files from trial139:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67576/remote/trial139/crash
2026-02-24T13:12:06.889 DEBUG:teuthology.orchestra.run.trial139:> sudo tar c -f - -C /var/lib/ceph/crash -- .
2026-02-24T13:12:06.924 INFO:teuthology.misc:Compressing logs...
2026-02-24T13:12:06.924 DEBUG:teuthology.orchestra.run.trial109:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2026-02-24T13:12:06.933 DEBUG:teuthology.orchestra.run.trial139:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2026-02-24T13:12:06.953 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2026-02-24T13:12:06.954 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2026-02-24T13:12:06.954 INFO:teuthology.orchestra.run.trial109.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:	/home/ubuntu/cephtest/archive/syslog/kern.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2026-02-24T13:12:06.954 INFO:teuthology.orchestra.run.trial109.stderr:  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2026-02-24T13:12:06.989 INFO:teuthology.orchestra.run.trial139.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2026-02-24T13:12:06.989 INFO:teuthology.orchestra.run.trial139.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2026-02-24T13:12:06.990 INFO:teuthology.orchestra.run.trial139.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2026-02-24T13:12:06.990 INFO:teuthology.orchestra.run.trial139.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2026-02-24T13:12:06.991 DEBUG:teuthology.misc:Transferring archived files from trial109:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67576/remote/trial109/
2026-02-24T13:12:06.992 DEBUG:teuthology.orchestra.run.trial109:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- .
2026-02-24T13:12:07.023 DEBUG:teuthology.misc:Transferring archived files from trial139:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67576/remote/trial139/
2026-02-24T13:12:07.023 DEBUG:teuthology.orchestra.run.trial139:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- .
2026-02-24T13:12:07.057 INFO:teuthology.misc:Compressing logs...
2026-02-24T13:12:07.057 DEBUG:teuthology.orchestra.run.trial109:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2026-02-24T13:12:07.066 DEBUG:teuthology.orchestra.run.trial139:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2026-02-24T13:12:07.087 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph-mon.a.log
2026-02-24T13:12:07.088 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph.cephadm.log
2026-02-24T13:12:07.088 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph.audit.log
2026-02-24T13:12:07.088 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph-mon.a.log:	/var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph.cephadm.log:	gzip -5 --verbose -- /var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph-volume.log
2026-02-24T13:12:07.088 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph.audit.log:	 82.0% -- replaced with /var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph.cephadm.log.gz
2026-02-24T13:12:07.088 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph-mgr.x.log
2026-02-24T13:12:07.089 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph-volume.log:	gzip -5 --verbose -- /var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph.log
2026-02-24T13:12:07.089 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph-mgr.x.log:	gzip -5 --verbose -- /var/log/ceph/cephadm.log
2026-02-24T13:12:07.099 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph.log:	/var/log/ceph/cephadm.log:	 89.7% -- replaced with /var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph.audit.log.gz
2026-02-24T13:12:07.102 INFO:teuthology.orchestra.run.trial109.stderr: 92.5% -- replaced with /var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph-volume.log.gz
2026-02-24T13:12:07.105 INFO:teuthology.orchestra.run.trial109.stderr: 92.7% -- replaced with /var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph.log.gz
2026-02-24T13:12:07.121 INFO:teuthology.orchestra.run.trial139.stderr:gzip -5 --verbose -- /var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph-volume.log
2026-02-24T13:12:07.122 INFO:teuthology.orchestra.run.trial139.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log
2026-02-24T13:12:07.124 INFO:teuthology.orchestra.run.trial139.stderr:/var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph-volume.log:	/var/log/ceph/cephadm.log:	 86.9% -- replaced with /var/log/ceph/cephadm.log.gz
2026-02-24T13:12:07.137 INFO:teuthology.orchestra.run.trial139.stderr: 92.5% -- replaced with /var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph-volume.log.gz
2026-02-24T13:12:07.151 INFO:teuthology.orchestra.run.trial109.stderr: 96.9% -- replaced with /var/log/ceph/cephadm.log.gz
2026-02-24T13:12:08.096 INFO:teuthology.orchestra.run.trial109.stderr:gzip: /var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph-mgr.x.log: file size changed while zipping
2026-02-24T13:12:08.096 INFO:teuthology.orchestra.run.trial109.stderr: 93.0% -- replaced with /var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph-mgr.x.log.gz
2026-02-24T13:12:12.102 INFO:teuthology.orchestra.run.trial109.stderr:gzip: /var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph-mon.a.log: file size changed while zipping
2026-02-24T13:12:12.102 INFO:teuthology.orchestra.run.trial109.stderr: 88.6% -- replaced with /var/log/ceph/543f49c6-1151-11f1-aa48-d404e6e7d460/ceph-mon.a.log.gz
2026-02-24T13:12:12.105 DEBUG:teuthology.misc:Transferring archived files from trial109:/var/log/ceph to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67576/remote/trial109/log
2026-02-24T13:12:12.106 DEBUG:teuthology.orchestra.run.trial109:> sudo tar c -f - -C /var/log/ceph -- .
2026-02-24T13:12:12.795 DEBUG:teuthology.misc:Transferring archived files from trial139:/var/log/ceph to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67576/remote/trial139/log
2026-02-24T13:12:12.796 DEBUG:teuthology.orchestra.run.trial139:> sudo tar c -f - -C /var/log/ceph -- .
2026-02-24T13:12:12.904 INFO:teuthology.kill:No teuthology processes running
2026-02-24T13:12:12.904 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:12:13.574 INFO:teuthology.orchestra.console.trial109:Power off
2026-02-24T13:12:13.574 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:12:13.586 INFO:teuthology.orchestra.console.trial139:Power off
2026-02-24T13:12:13.586 DEBUG:teuthology.orchestra.console.trial139:pexpect command: ipmitool -H trial139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:12:13.615 DEBUG:teuthology.orchestra.console.trial109:power off output: Chassis Power Control: Down/Off
2026-02-24T13:12:13.628 DEBUG:teuthology.orchestra.console.trial139:power off output: Chassis Power Control: Down/Off
2026-02-24T13:12:17.615 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:12:17.628 DEBUG:teuthology.orchestra.console.trial139:pexpect command: ipmitool -H trial139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:12:17.725 DEBUG:teuthology.orchestra.console.trial109:check power output: Chassis Power is on
2026-02-24T13:12:17.736 DEBUG:teuthology.orchestra.console.trial139:check power output: Chassis Power is on
2026-02-24T13:12:21.726 DEBUG:teuthology.orchestra.console.trial109:pexpect command: ipmitool -H trial109.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:12:21.737 DEBUG:teuthology.orchestra.console.trial139:pexpect command: ipmitool -H trial139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:12:21.836 DEBUG:teuthology.orchestra.console.trial109:check power output: Chassis Power is off
2026-02-24T13:12:21.837 INFO:teuthology.orchestra.console.trial109:Power off completed
2026-02-24T13:12:21.848 DEBUG:teuthology.orchestra.console.trial139:check power output: Chassis Power is off
2026-02-24T13:12:21.848 INFO:teuthology.orchestra.console.trial139:Power off completed
2026-02-24T13:12:22.087 INFO:teuthology.lock.ops:unlocked: trial109.front.sepia.ceph.com
2026-02-24T13:12:22.099 INFO:teuthology.lock.ops:unlocked: trial139.front.sepia.ceph.com
2026-02-24T13:12:22.100 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:14:22.170 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:14:22.246 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2026-02-24T13:14:22.361 WARNING:teuthology.dispatcher.supervisor:Was going to unlock trial109 but it was locked by another job: /home/teuthworker/mnt/teuthology/cjames-2026-02-24_10:01:51-rados-main-distro-default-trial/67804
2026-02-24T13:14:22.361 WARNING:teuthology.dispatcher.supervisor:Was going to unlock trial139 but it was locked by another job: /home/teuthworker/mnt/teuthology/cjames-2026-02-24_10:01:51-rados-main-distro-default-trial/67804