2023-12-04T12:45:51.125 INFO:root:teuthology version: 0.0.1.dev214+gf2de108
2023-12-04T12:45:51.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T12:45:51.219 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f26cd06ce50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f26ce143550>, signals=[15])
2023-12-04T12:45:51.219 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging
2023-12-04T12:45:51.219 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server
2023-12-04T12:45:51.220 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2023-12-04T12:45:51.351 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_centos_9.stream (ID 10)
2023-12-04T12:45:51.403 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 9.stream
2023-12-04T12:45:51.647 INFO:teuthology.orchestra.console.smithi040:Power off
2023-12-04T12:45:51.647 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-04T12:45:51.668 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off
2023-12-04T12:45:51.668 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-04T12:45:51.689 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2023-12-04T12:45:55.690 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-04T12:45:55.802 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2023-12-04T12:45:59.807 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-04T12:45:59.917 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2023-12-04T12:46:00.017 INFO:teuthology.orchestra.console.smithi040:Power off completed
2023-12-04T12:46:00.118 INFO:teuthology.orchestra.console.smithi040:Power on
2023-12-04T12:46:00.118 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-04T12:46:00.138 DEBUG:teuthology.orchestra.console.smithi040:power on output: Chassis Power Control: Up/On
2023-12-04T12:46:00.139 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-04T12:46:00.159 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2023-12-04T12:46:04.162 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-04T12:46:04.271 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2023-12-04T12:46:08.274 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-04T12:46:08.382 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2023-12-04T12:46:08.483 INFO:teuthology.orchestra.console.smithi040:Power on completed
2023-12-04T12:46:08.583 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish
2023-12-04T12:48:40.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-04T12:48:58.722 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2023-12-04T12:49:04.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-04T12:49:07.778 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2023-12-04T12:49:13.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-04T12:49:16.870 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2023-12-04T12:49:22.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-04T12:49:25.958 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2023-12-04T12:49:31.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-04T12:50:32.009 WARNING:teuthology.provision.fog.smithi040:timed out
2023-12-04T12:50:38.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-04T12:50:38.248 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-04T12:50:38.249 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-04T12:50:38.618 INFO:teuthology.provision.fog.smithi040:Node is ready
2023-12-04T12:50:38.618 DEBUG:teuthology.orchestra.run.smithi040:> hostname
2023-12-04T12:50:38.633 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com
2023-12-04T12:50:38.633 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts
2023-12-04T12:50:38.689 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040
2023-12-04T12:50:38.689 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040
2023-12-04T12:50:38.802 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts
2023-12-04T12:50:38.834 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts
2023-12-04T12:50:38.906 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname
2023-12-04T12:50:38.977 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040
2023-12-04T12:50:39.047 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release
2023-12-04T12:50:39.102 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream"
2023-12-04T12:50:39.102 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9"
2023-12-04T12:50:39.102 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos"
2023-12-04T12:50:39.102 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora"
2023-12-04T12:50:39.102 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9"
2023-12-04T12:50:39.103 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9"
2023-12-04T12:50:39.103 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-04T12:50:39.103 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31"
2023-12-04T12:50:39.103 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon"
2023-12-04T12:50:39.103 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-04T12:50:39.103 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/"
2023-12-04T12:50:39.103 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-04T12:50:39.103 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-04T12:50:39.103 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-04T12:50:39.104 INFO:teuthology.provision.fog.smithi040:Deploy complete!
2023-12-04T12:50:39.105 DEBUG:teuthology.parallel:result is None
2023-12-04T12:50:39.255 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com
2023-12-04T12:50:39.255 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-04T12:50:39.281 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server
2023-12-04T12:50:39.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com'
2023-12-04T12:50:39.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-04T12:50:39.376 DEBUG:teuthology.orchestra.run.smithi040:> true
2023-12-04T12:50:39.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com'
2023-12-04T12:50:39.440 DEBUG:teuthology.orchestra.run.smithi040:> uname -m
2023-12-04T12:50:39.495 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64
2023-12-04T12:50:39.495 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release
2023-12-04T12:50:39.550 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream"
2023-12-04T12:50:39.550 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9"
2023-12-04T12:50:39.550 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos"
2023-12-04T12:50:39.550 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora"
2023-12-04T12:50:39.550 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9"
2023-12-04T12:50:39.550 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9"
2023-12-04T12:50:39.550 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-04T12:50:39.550 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31"
2023-12-04T12:50:39.551 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon"
2023-12-04T12:50:39.551 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-04T12:50:39.551 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/"
2023-12-04T12:50:39.551 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-04T12:50:39.551 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-04T12:50:39.551 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-04T12:50:39.551 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2023-12-04T12:50:39.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T12:50:39.670 INFO:teuthology.dispatcher.supervisor:Running job 7477109
2023-12-04T12:50:39.670 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-12-04_12:43:05-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7477109 --name matan-2023-12-04_12:43:05-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi --description crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/fio_4K_rand_read} -- /home/teuthworker/archive/matan-2023-12-04_12:43:05-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7477109/orig.config.yaml
2023-12-04T12:50:39.673 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-12-04_12:43:05-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7477109
2023-12-04T12:50:39.673 INFO:teuthology.dispatcher.supervisor:Job PID: 501011
2023-12-04T12:50:39.674 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-04T12:52:39.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T12:54:39.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T12:56:40.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T12:58:40.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:00:40.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:02:40.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:04:40.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:06:40.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:08:41.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:10:41.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:12:41.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:14:41.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:16:41.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:18:41.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:20:41.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:22:42.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:24:42.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:26:42.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:28:42.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:30:42.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:32:42.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:34:43.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:36:43.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:38:43.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:40:43.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:42:43.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:44:43.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:46:43.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:48:44.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:50:44.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:52:44.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:54:44.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:56:44.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T13:58:44.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:00:45.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:02:45.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:04:45.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:06:45.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:08:45.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:10:45.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:12:46.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:14:46.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:16:46.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:18:46.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:20:46.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:22:46.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:24:47.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:26:47.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:28:47.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:30:47.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:32:47.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:34:47.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:36:47.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:38:48.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:40:48.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:42:48.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:44:48.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:46:48.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:48:48.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:50:49.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:52:49.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:54:49.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:56:49.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T14:58:49.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:00:49.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:02:50.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:04:50.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:06:50.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:08:50.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:10:50.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:12:50.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:14:51.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:16:51.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:18:51.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:20:51.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:22:51.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:24:51.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:26:51.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:28:52.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:30:52.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:32:52.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:34:52.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:36:52.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:38:52.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:40:53.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:42:53.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:44:53.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:46:53.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:48:53.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:50:53.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:52:54.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:54:54.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:56:54.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T15:58:54.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:00:54.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:02:54.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:04:55.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:06:55.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:08:55.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:10:55.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:12:55.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:14:55.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:16:56.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:18:56.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:20:56.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:22:56.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:24:56.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:26:56.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:28:57.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:30:57.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:32:57.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:34:57.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:36:57.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:38:57.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:40:57.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:42:58.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:44:58.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:46:58.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:48:58.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:50:58.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:52:58.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:54:59.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:56:59.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T16:58:59.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:00:59.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:02:59.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:04:59.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:07:00.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:09:00.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:11:00.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:13:00.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:15:00.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:17:00.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:19:00.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:21:00.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:23:01.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:25:01.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:27:01.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:29:01.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:31:01.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:33:01.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:35:02.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:37:02.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:39:02.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:41:02.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:43:02.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:45:02.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:47:03.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:49:03.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:51:03.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:53:03.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:55:03.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:57:03.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T17:59:04.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:01:04.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:03:04.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:05:04.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:07:04.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:09:04.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:11:05.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:13:05.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:15:05.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:17:05.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:19:05.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:21:05.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:23:06.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:25:06.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:27:06.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:29:06.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:31:06.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:33:06.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:35:07.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:37:07.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:39:07.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:41:07.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:43:07.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:45:07.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:47:07.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:49:08.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:51:08.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:53:08.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:55:08.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:57:08.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T18:59:08.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:01:09.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:03:09.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:05:09.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:07:09.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:09:09.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:11:09.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:13:10.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:15:10.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:17:10.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:19:10.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:21:10.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:23:10.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:25:18.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:27:18.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:29:28.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:31:28.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:33:29.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:35:30.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:37:35.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:39:41.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:41:42.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:43:47.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:45:53.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:47:53.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:49:58.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:52:03.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:54:08.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:56:13.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T19:58:13.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:00:15.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:02:20.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:04:25.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:06:30.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:08:31.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:10:31.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:12:36.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:14:41.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:16:46.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:18:51.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:20:56.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:22:57.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:25:02.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:27:03.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:29:03.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:31:03.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:33:03.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:35:03.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:37:09.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:39:14.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:41:14.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:43:19.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:45:24.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:47:29.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:49:29.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:51:34.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:53:39.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:55:44.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:57:44.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T20:59:49.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:01:54.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:03:54.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:05:59.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:08:05.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:10:10.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:12:14.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:14:20.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:16:20.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:18:25.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:20:25.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:22:30.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:24:30.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:26:35.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:28:40.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:30:45.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:32:45.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:34:46.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:36:51.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:38:51.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:40:51.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:42:56.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:44:56.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:47:01.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:49:06.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:51:06.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:53:11.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:55:16.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:57:16.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T21:59:21.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:01:21.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:03:24.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:05:29.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:07:29.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:09:29.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:11:29.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:13:34.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:15:34.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:17:35.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:19:40.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:21:40.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:23:40.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:25:45.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:27:50.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:29:55.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:32:00.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:34:00.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:36:00.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:38:05.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:40:06.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:42:06.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:44:10.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:46:13.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:48:13.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:50:19.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:52:24.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:54:29.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:56:34.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T22:58:34.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:00:34.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:02:39.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:04:45.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:06:45.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:08:45.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:10:45.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:12:50.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:14:55.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:17:00.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:19:00.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:21:00.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:23:01.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:25:01.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:27:06.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:29:06.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:31:06.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:33:06.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:35:12.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:37:12.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:39:13.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:41:13.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:43:14.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:45:14.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:47:14.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:49:19.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:51:19.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:53:24.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:55:29.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:57:29.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-04T23:59:29.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:01:30.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:03:30.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:05:30.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:07:30.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:09:30.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:11:31.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:13:31.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:15:31.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:17:31.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:19:31.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:21:31.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:23:32.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:25:32.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:27:32.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:29:32.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:31:32.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:33:32.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:35:33.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:37:33.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:39:33.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:41:33.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:43:33.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:45:34.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:47:34.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:49:34.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:51:34.663 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-12-05T00:51:34.773 INFO:teuthology.kill:Killing Pids: {501011}
2023-12-05T00:51:35.552 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']
2023-12-05T00:51:35.552 INFO:teuthology.misc:Compressing logs...
2023-12-05T00:51:35.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com'
2023-12-05T00:51:35.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-05T00:51:35.711 DEBUG:teuthology.orchestra.run.smithi040:> true
2023-12-05T00:51:35.783 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com'
2023-12-05T00:51:35.783 DEBUG:teuthology.orchestra.run.smithi040:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-12-05T00:51:35.863 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2023-12-04_12:43:05-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7477109/remote/smithi040/crash
2023-12-05T00:51:35.864 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/lib/ceph/crash -- .
2023-12-05T00:51:35.933 INFO:teuthology.misc:Compressing logs...
2023-12-05T00:51:35.934 DEBUG:teuthology.orchestra.run.smithi040:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-12-05T00:51:36.006 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2023-12-05T00:51:36.006 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2023-12-05T00:51:36.006 INFO:teuthology.orchestra.run.smithi040.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2023-12-05T00:51:36.006 INFO:teuthology.orchestra.run.smithi040.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2023-12-05T00:51:36.008 DEBUG:teuthology.misc:Transferring archived files from smithi040:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2023-12-04_12:43:05-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7477109/remote/smithi040/
2023-12-05T00:51:36.008 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- .
2023-12-05T00:51:36.090 INFO:teuthology.misc:Compressing logs...
2023-12-05T00:51:36.090 DEBUG:teuthology.orchestra.run.smithi040:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2023-12-05T00:51:36.158 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86920.log
2023-12-05T00:51:36.159 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log
2023-12-05T00:51:36.174 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83022.log
2023-12-05T00:51:36.174 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.86920.log:	 50.0%/var/log/ceph/ceph-mon.a.log:	 -- replaced with /var/log/ceph/ceph-client.admin.86920.log.gz
2023-12-05T00:51:36.174 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82795.log
2023-12-05T00:51:36.175 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.83022.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81912.log
2023-12-05T00:51:36.175 INFO:teuthology.orchestra.run.smithi040.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.83022.log.gz
2023-12-05T00:51:36.175 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.82795.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82940.log
2023-12-05T00:51:36.175 INFO:teuthology.orchestra.run.smithi040.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.82795.log.gz
2023-12-05T00:51:36.175 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.81912.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82837.log
2023-12-05T00:51:36.175 INFO:teuthology.orchestra.run.smithi040.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz
2023-12-05T00:51:36.175 INFO:teuthology.orchestra.run.smithi040.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.81912.log.gz
2023-12-05T00:51:36.175 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.82940.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86818.log
2023-12-05T00:51:36.175 INFO:teuthology.orchestra.run.smithi040.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.82940.log.gz
2023-12-05T00:51:36.175 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.82837.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83020.log
2023-12-05T00:51:36.176 INFO:teuthology.orchestra.run.smithi040.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.82837.log.gz
2023-12-05T00:51:36.176 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.86818.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82062.log
2023-12-05T00:51:36.176 INFO:teuthology.orchestra.run.smithi040.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.86818.log.gz
2023-12-05T00:51:36.176 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.83020.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82753.log
2023-12-05T00:51:36.176 INFO:teuthology.orchestra.run.smithi040.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.83020.log.gz
2023-12-05T00:51:36.176 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83108.log
2023-12-05T00:51:36.176 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.82062.log:	 49.6% -- replaced with /var/log/ceph/ceph-client.admin.82062.log.gz
2023-12-05T00:51:36.176 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.82753.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86943.log
2023-12-05T00:51:36.176 INFO:teuthology.orchestra.run.smithi040.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.82753.log.gz
2023-12-05T00:51:36.176 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.83108.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86756.log
2023-12-05T00:51:36.176 INFO:teuthology.orchestra.run.smithi040.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.83108.log.gz
2023-12-05T00:51:36.177 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.86943.log:	gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.80451.log
2023-12-05T00:51:36.177 INFO:teuthology.orchestra.run.smithi040.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.86943.log.gz
2023-12-05T00:51:36.177 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82880.log
2023-12-05T00:51:36.177 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.86756.log:	 49.6% -- replaced with /var/log/ceph/ceph-client.admin.86756.log.gz
2023-12-05T00:51:36.177 INFO:teuthology.orchestra.run.smithi040.stderr:gzip/var/log/ceph/ceph.tmp-client.admin.80451.log:	 -5 --verbose -- /var/log/ceph/ceph-client.admin.82022.log
2023-12-05T00:51:36.177 INFO:teuthology.orchestra.run.smithi040.stderr: 67.5% -- replaced with /var/log/ceph/ceph.tmp-client.admin.80451.log.gz
2023-12-05T00:51:36.177 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.82880.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83318.log
2023-12-05T00:51:36.177 INFO:teuthology.orchestra.run.smithi040.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.82880.log.gz
2023-12-05T00:51:36.178 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.82022.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82102.log
2023-12-05T00:51:36.178 INFO:teuthology.orchestra.run.smithi040.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.82022.log.gz
2023-12-05T00:51:36.178 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.83318.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83234.log
2023-12-05T00:51:36.178 INFO:teuthology.orchestra.run.smithi040.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.83318.log.gz
2023-12-05T00:51:36.178 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.82102.log:	gzip -5 --verbose -- /var/log/ceph/ceph.audit.log
2023-12-05T00:51:36.178 INFO:teuthology.orchestra.run.smithi040.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.82102.log.gz
2023-12-05T00:51:36.178 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.83234.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82287.log
2023-12-05T00:51:36.178 INFO:teuthology.orchestra.run.smithi040.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.83234.log.gz
2023-12-05T00:51:36.178 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.audit.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86872.log
2023-12-05T00:51:36.179 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.82287.log:	gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log
2023-12-05T00:51:36.179 INFO:teuthology.orchestra.run.smithi040.stderr: 85.9% -- replaced with /var/log/ceph/ceph.audit.log.gz
2023-12-05T00:51:36.179 INFO:teuthology.orchestra.run.smithi040.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.82287.log.gz
2023-12-05T00:51:36.179 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.86872.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86967.log
2023-12-05T00:51:36.179 INFO:teuthology.orchestra.run.smithi040.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.86872.log.gz
2023-12-05T00:51:36.179 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83148.log
2023-12-05T00:51:36.179 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.1.log:	/var/log/ceph/ceph-client.admin.86967.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83021.log
2023-12-05T00:51:36.179 INFO:teuthology.orchestra.run.smithi040.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.86967.log.gz
2023-12-05T00:51:36.179 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.83148.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86897.log
2023-12-05T00:51:36.179 INFO:teuthology.orchestra.run.smithi040.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.83148.log.gz
2023-12-05T00:51:36.179 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.83021.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82260.log
2023-12-05T00:51:36.180 INFO:teuthology.orchestra.run.smithi040.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.83021.log.gz
2023-12-05T00:51:36.180 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.86897.log:	gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log
2023-12-05T00:51:36.180 INFO:teuthology.orchestra.run.smithi040.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.86897.log.gz
2023-12-05T00:51:36.180 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.82260.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83147.log
2023-12-05T00:51:36.180 INFO:teuthology.orchestra.run.smithi040.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.82260.log.gz
2023-12-05T00:51:36.180 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mgr.x.log:	gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log
2023-12-05T00:51:36.180 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.83147.log:	gzip -5 --verbose -- /var/log/ceph/ceph.log
2023-12-05T00:51:36.180 INFO:teuthology.orchestra.run.smithi040.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.83147.log.gz
2023-12-05T00:51:36.181 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.0.log:	gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log
2023-12-05T00:51:36.181 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86847.log
2023-12-05T00:51:36.181 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.2.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83276.log
2023-12-05T00:51:36.181 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph.log.gz
2023-12-05T00:51:36.181 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.86847.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81824.log
2023-12-05T00:51:36.181 INFO:teuthology.orchestra.run.smithi040.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.86847.log.gz
2023-12-05T00:51:36.181 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82697.log
2023-12-05T00:51:36.182 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.83276.log:	 49.6% -- replaced with /var/log/ceph/ceph-client.admin.83276.log.gz
2023-12-05T00:51:36.182 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.81824.log:	 49.6% -- replaced with /var/log/ceph/ceph-client.admin.81824.log.gz
2023-12-05T00:51:36.182 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.82697.log:	 50.0% -- replaced with /var/log/ceph/ceph-client.admin.82697.log.gz
2023-12-05T00:51:36.196 INFO:teuthology.orchestra.run.smithi040.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz
2023-12-05T00:51:36.249 INFO:teuthology.orchestra.run.smithi040.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz
2023-12-05T00:51:36.250 INFO:teuthology.orchestra.run.smithi040.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz
2023-12-05T00:51:36.252 INFO:teuthology.orchestra.run.smithi040.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz
2023-12-05T00:51:36.254 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/log/ceph to /home/teuthworker/archive/matan-2023-12-04_12:43:05-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7477109/remote/smithi040/log
2023-12-05T00:51:36.255 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/log/ceph -- .
2023-12-05T00:51:36.482 INFO:teuthology.kill:No teuthology processes running
2023-12-05T00:51:36.482 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 331, in run_with_watchdog
    kill.kill_job(
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/kill.py", line 89, in kill_job
    if kill_processes(run_name, [job_info.get('pid')]):
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/kill.py", line 210, in kill_processes
    if survivors:
UnboundLocalError: local variable 'survivors' referenced before assignment
2023-12-05T00:51:36.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:53:36.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-05T00:53:36.756 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-12-05T00:53:36.845 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-05T00:53:36.846 INFO:teuthology.nuke:Checking targets against current locks
2023-12-05T00:53:36.908 DEBUG:teuthology.nuke:shortname: smithi040
2023-12-05T00:53:36.909 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-05T00:53:36.949 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-12-04_12:43:05-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7477109', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-04 12:45:50.331990', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBALmz7M56/tTHLM9D8yWcVGhdYVpSIzC8bBnhpC7Qnw6a1JZ+aY79d+N8SN7XaXqAtimaQvR8W0oVhuF1zM9LmQ='}
2023-12-05T00:53:37.012 INFO:teuthology.orchestra.console.smithi040:Power off
2023-12-05T00:53:37.012 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-05T00:53:37.065 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off
2023-12-05T00:53:37.065 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T00:53:37.116 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2023-12-05T00:53:41.121 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T00:53:41.232 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2023-12-05T00:53:45.237 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-05T00:53:45.348 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2023-12-05T00:53:45.449 INFO:teuthology.orchestra.console.smithi040:Power off completed
2023-12-05T00:53:45.622 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com