2023-12-04T12:45:55.683 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-04T12:45:55.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T12:45:55.787 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7cd18b2550>, signals=[15]) 2023-12-04T12:45:55.788 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging 2023-12-04T12:45:55.788 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server 2023-12-04T12:45:55.788 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-12-04T12:45:55.932 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_centos_9.stream (ID 10) 2023-12-04T12:45:55.972 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of centos 9.stream 2023-12-04T12:45:56.249 INFO:teuthology.orchestra.console.smithi174:Power off 2023-12-04T12:45:56.249 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T12:45:56.269 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-12-04T12:45:56.269 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T12:45:56.290 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-04T12:45:56.391 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-12-04T12:45:56.491 INFO:teuthology.orchestra.console.smithi174:Power on 2023-12-04T12:45:56.492 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-04T12:45:56.514 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On 2023-12-04T12:45:56.515 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T12:45:56.537 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-04T12:46:00.539 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T12:46:00.648 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-04T12:46:04.650 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T12:46:04.758 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-12-04T12:46:04.859 INFO:teuthology.orchestra.console.smithi174:Power on completed 2023-12-04T12:46:04.959 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2023-12-04T12:48:36.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T12:48:36.821 ERROR:teuthology.orchestra.connection:Error authenticating with smithi174.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-04T12:49:40.825 WARNING:teuthology.provision.fog.smithi174:timed out 2023-12-04T12:49:46.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T12:50:05.285 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-04T12:50:11.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T12:50:14.338 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-04T12:50:20.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T12:50:21.714 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-04T12:50:21.715 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-04T12:50:42.067 INFO:teuthology.provision.fog.smithi174:Node is ready 2023-12-04T12:50:42.068 DEBUG:teuthology.orchestra.run.smithi174:> hostname 2023-12-04T12:50:42.086 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com 2023-12-04T12:50:42.087 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi174.front.sepia.ceph.com /etc/hosts 2023-12-04T12:50:42.143 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2023-12-04T12:50:42.143 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-12-04T12:50:42.275 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hosts 2023-12-04T12:50:42.307 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts 2023-12-04T12:50:42.377 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hostname 2023-12-04T12:50:42.447 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-12-04T12:50:42.513 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-12-04T12:50:42.568 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2023-12-04T12:50:42.568 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2023-12-04T12:50:42.568 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2023-12-04T12:50:42.568 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2023-12-04T12:50:42.569 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2023-12-04T12:50:42.569 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2023-12-04T12:50:42.569 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-04T12:50:42.569 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-12-04T12:50:42.569 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2023-12-04T12:50:42.569 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-04T12:50:42.569 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2023-12-04T12:50:42.569 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T12:50:42.569 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-04T12:50:42.569 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-04T12:50:42.570 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2023-12-04T12:50:42.571 DEBUG:teuthology.parallel:result is None 2023-12-04T12:50:42.692 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com 2023-12-04T12:50:42.692 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-04T12:50:42.715 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server 2023-12-04T12:50:42.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-12-04T12:50:42.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T12:50:42.795 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-12-04T12:50:42.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-12-04T12:50:42.860 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2023-12-04T12:50:42.914 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2023-12-04T12:50:42.915 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-12-04T12:50:42.969 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2023-12-04T12:50:42.969 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2023-12-04T12:50:42.969 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2023-12-04T12:50:42.970 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2023-12-04T12:50:42.970 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2023-12-04T12:50:42.970 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2023-12-04T12:50:42.970 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-04T12:50:42.970 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-12-04T12:50:42.971 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2023-12-04T12:50:42.971 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-04T12:50:42.971 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2023-12-04T12:50:42.971 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T12:50:42.971 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-04T12:50:42.971 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-04T12:50:42.972 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-12-04T12:50:42.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T12:50:43.084 INFO:teuthology.dispatcher.supervisor:Running job 7477118 2023-12-04T12:50:43.084 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-12-04_12:43:05-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7477118 --name matan-2023-12-04_12:43:05-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi --description crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/fio_4M_rand_rw} -- /home/teuthworker/archive/matan-2023-12-04_12:43:05-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7477118/orig.config.yaml 2023-12-04T12:50:43.087 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-12-04_12:43:05-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7477118 2023-12-04T12:50:43.088 INFO:teuthology.dispatcher.supervisor:Job PID: 501121 2023-12-04T12:50:43.088 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-04T12:52:43.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T12:54:43.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T12:56:43.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T12:58:43.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:00:43.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:02:43.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:04:43.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:06:43.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:08:43.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:10:43.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:12:43.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:14:43.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:16:43.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:18:43.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:20:44.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:22:44.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:24:44.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:26:44.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:28:44.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:30:44.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:32:44.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:34:44.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:36:44.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:38:44.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:40:44.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:42:44.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:44:44.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:46:44.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:48:44.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:50:45.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:52:45.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:54:45.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:56:45.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T13:58:45.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:00:45.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:02:45.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:04:45.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:06:45.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:08:45.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:10:45.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:12:45.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:14:45.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:16:45.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:18:45.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:20:46.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:22:46.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:24:46.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:26:46.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:28:46.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:30:46.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:32:46.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:34:46.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:36:46.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:38:46.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:40:46.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:42:46.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:44:46.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:46:47.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:48:47.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:50:47.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:52:47.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:54:47.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:56:47.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T14:58:47.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:00:47.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:02:47.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:04:47.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:06:47.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:08:47.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:10:47.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:12:47.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:14:48.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:16:48.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:18:48.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:20:48.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:22:48.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:24:48.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:26:48.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:28:48.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:30:48.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:32:48.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:34:48.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:36:48.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:38:48.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:40:48.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:42:48.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:44:49.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:46:49.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:48:49.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:50:49.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:52:49.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:54:49.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:56:49.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T15:58:49.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:00:49.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:02:49.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:04:49.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:06:49.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:08:49.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:10:49.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:12:50.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:14:50.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:16:50.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:18:50.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:20:50.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:22:50.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:24:50.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:26:50.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:28:50.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:30:50.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:32:50.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:34:50.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:36:50.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:38:51.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:40:51.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:42:51.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:44:51.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:46:51.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:48:51.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:50:51.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:52:51.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:54:51.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:56:51.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T16:58:51.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:00:51.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:02:51.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:04:51.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:06:52.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:08:52.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:10:52.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:12:52.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:14:52.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:16:52.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:18:52.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:20:52.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:22:52.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:24:52.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:26:52.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:28:53.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:30:53.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:32:53.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:34:53.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:36:53.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:38:53.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:40:53.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:42:53.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:44:53.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:46:53.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:48:53.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:50:53.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:52:54.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:54:54.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:56:54.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T17:58:54.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:00:54.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:02:54.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:04:54.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:06:54.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:08:54.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:10:54.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:12:54.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:14:54.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:16:54.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:18:54.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:20:54.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:22:55.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:24:55.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:26:55.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:28:55.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:30:55.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:32:55.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:34:55.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:36:55.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:38:55.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:40:55.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:42:55.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:44:55.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:46:55.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:48:55.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:50:55.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:52:56.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:54:56.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:56:56.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T18:58:56.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:00:56.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:02:56.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:04:56.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:06:56.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:08:56.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:10:56.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:12:56.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:14:56.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:16:56.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:18:56.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:20:57.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:22:57.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:25:09.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:27:09.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:29:14.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:31:19.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:33:23.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:35:29.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:37:34.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:39:39.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:41:42.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:43:47.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:45:52.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:47:52.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:49:57.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:52:03.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:54:03.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:56:04.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T19:58:10.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:00:15.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:02:15.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:04:15.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:06:20.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:08:25.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:10:30.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:12:35.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:14:40.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:16:45.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:18:50.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:20:55.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:22:57.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:25:02.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:27:03.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:29:03.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:31:03.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:33:03.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:35:03.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:37:08.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:39:13.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:41:13.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:43:18.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:45:23.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:47:29.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:49:29.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:51:34.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:53:39.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:55:44.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:57:44.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T20:59:49.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:01:54.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:03:54.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:05:59.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:08:04.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:10:09.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:12:14.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:14:19.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:16:19.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:18:25.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:20:25.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:22:30.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:24:30.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:26:35.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:28:40.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:30:45.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:32:45.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:34:45.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:36:45.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:38:45.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:40:45.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:42:50.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:44:56.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:47:01.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:49:06.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:51:06.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:53:11.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:55:16.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:57:16.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T21:59:21.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:01:21.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:03:24.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:05:29.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:07:29.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:09:29.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:11:29.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:13:34.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:15:34.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:17:34.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:19:39.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:21:39.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:23:39.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:25:44.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:27:49.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:29:55.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:32:00.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:34:00.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:36:00.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:38:05.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:40:05.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:42:05.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:44:10.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:46:13.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:48:13.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:50:18.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:52:24.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:54:24.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:56:29.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T22:58:29.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:00:29.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:02:29.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:04:34.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:06:34.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:08:34.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:10:39.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:12:44.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:14:44.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:16:44.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:18:45.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:20:50.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:22:50.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:24:50.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:26:55.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:28:55.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:30:55.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:33:00.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:35:05.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:37:10.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:39:13.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:41:13.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:43:13.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:45:13.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:47:14.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:49:19.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:51:19.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:53:24.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:55:29.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:57:29.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T23:59:29.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:01:29.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:03:29.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:05:29.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:07:30.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:09:30.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:11:30.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:13:30.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:15:30.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:17:30.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:19:30.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:21:30.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:23:30.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:25:30.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:27:31.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:29:31.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:31:31.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:33:31.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:35:31.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:37:31.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:39:31.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:41:31.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:43:31.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:45:31.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:47:32.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:49:32.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:51:32.338 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-12-05T00:51:32.436 INFO:teuthology.kill:Killing Pids: {501121} 2023-12-05T00:51:33.214 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2023-12-05T00:51:33.214 INFO:teuthology.misc:Compressing logs... 2023-12-05T00:51:33.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-12-05T00:51:33.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T00:51:33.359 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-12-05T00:51:33.431 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-12-05T00:51:33.431 DEBUG:teuthology.orchestra.run.smithi174:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-05T00:51:33.509 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2023-12-04_12:43:05-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7477118/remote/smithi174/crash 2023-12-05T00:51:33.509 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-05T00:51:33.574 INFO:teuthology.misc:Compressing logs... 2023-12-05T00:51:33.575 DEBUG:teuthology.orchestra.run.smithi174:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-05T00:51:33.643 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-05T00:51:33.643 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-05T00:51:33.643 INFO:teuthology.orchestra.run.smithi174.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-05T00:51:33.643 INFO:teuthology.orchestra.run.smithi174.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-05T00:51:33.645 DEBUG:teuthology.misc:Transferring archived files from smithi174:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2023-12-04_12:43:05-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7477118/remote/smithi174/ 2023-12-05T00:51:33.645 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-05T00:51:33.723 INFO:teuthology.misc:Compressing logs... 2023-12-05T00:51:33.723 DEBUG:teuthology.orchestra.run.smithi174:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-05T00:51:33.794 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82424.log 2023-12-05T00:51:33.794 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82508.log 2023-12-05T00:51:33.794 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-05T00:51:33.794 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.82424.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.82424.log.gz 2023-12-05T00:51:33.794 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.82508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86509.log 2023-12-05T00:51:33.794 INFO:teuthology.orchestra.run.smithi174.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.82508.log.gz 2023-12-05T00:51:33.794 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81480.log 2023-12-05T00:51:33.794 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.86509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81828.log 2023-12-05T00:51:33.794 INFO:teuthology.orchestra.run.smithi174.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.86509.log.gz 2023-12-05T00:51:33.794 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.81480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81858.log 2023-12-05T00:51:33.795 INFO:teuthology.orchestra.run.smithi174.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.81480.log.gz 2023-12-05T00:51:33.795 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.81828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82715.log 2023-12-05T00:51:33.795 INFO:teuthology.orchestra.run.smithi174.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.81828.log.gz 2023-12-05T00:51:33.795 INFO:teuthology.orchestra.run.smithi174.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-05T00:51:33.795 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.81858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82802.log 2023-12-05T00:51:33.795 INFO:teuthology.orchestra.run.smithi174.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.81858.log.gz 2023-12-05T00:51:33.795 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.82715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86439.log 2023-12-05T00:51:33.795 INFO:teuthology.orchestra.run.smithi174.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.82715.log.gz 2023-12-05T00:51:33.795 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.82802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86556.log 2023-12-05T00:51:33.795 INFO:teuthology.orchestra.run.smithi174.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.82802.log.gz 2023-12-05T00:51:33.795 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.86439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82676.log 2023-12-05T00:51:33.795 INFO:teuthology.orchestra.run.smithi174.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.86439.log.gz 2023-12-05T00:51:33.796 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.86556.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.80021.log 2023-12-05T00:51:33.796 INFO:teuthology.orchestra.run.smithi174.stderr: 65.9% -- replaced with /var/log/ceph/ceph-client.admin.86556.log.gz 2023-12-05T00:51:33.796 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.82676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86414.log 2023-12-05T00:51:33.796 INFO:teuthology.orchestra.run.smithi174.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.82676.log.gz 2023-12-05T00:51:33.796 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph.tmp-client.admin.80021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82588.log 2023-12-05T00:51:33.796 INFO:teuthology.orchestra.run.smithi174.stderr: 68.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.80021.log.gz 2023-12-05T00:51:33.796 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.86414.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-05T00:51:33.796 INFO:teuthology.orchestra.run.smithi174.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.86414.log.gz 2023-12-05T00:51:33.796 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.82588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82716.log 2023-12-05T00:51:33.796 INFO:teuthology.orchestra.run.smithi174.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.82588.log.gz 2023-12-05T00:51:33.796 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81670.log 2023-12-05T00:51:33.796 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.82716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82589.log 2023-12-05T00:51:33.796 INFO:teuthology.orchestra.run.smithi174.stderr: 86.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-05T00:51:33.797 INFO:teuthology.orchestra.run.smithi174.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.82716.log.gz 2023-12-05T00:51:33.797 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.81670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81590.log 2023-12-05T00:51:33.797 INFO:teuthology.orchestra.run.smithi174.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.81670.log.gz 2023-12-05T00:51:33.797 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.82589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82265.log 2023-12-05T00:51:33.797 INFO:teuthology.orchestra.run.smithi174.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.82589.log.gz 2023-12-05T00:51:33.797 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.81590.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-05T00:51:33.797 INFO:teuthology.orchestra.run.smithi174.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.81590.log.gz 2023-12-05T00:51:33.797 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.82265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86389.log 2023-12-05T00:51:33.797 INFO:teuthology.orchestra.run.smithi174.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.82265.log.gz 2023-12-05T00:51:33.797 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81630.log 2023-12-05T00:51:33.797 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.86389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82363.log 2023-12-05T00:51:33.797 INFO:teuthology.orchestra.run.smithi174.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.86389.log.gz 2023-12-05T00:51:33.798 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.81630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81392.log 2023-12-05T00:51:33.798 INFO:teuthology.orchestra.run.smithi174.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.81630.log.gz 2023-12-05T00:51:33.798 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.82363.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-05T00:51:33.798 INFO:teuthology.orchestra.run.smithi174.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.82363.log.gz 2023-12-05T00:51:33.798 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.81392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82466.log 2023-12-05T00:51:33.798 INFO:teuthology.orchestra.run.smithi174.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.81392.log.gz 2023-12-05T00:51:33.798 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86298.log 2023-12-05T00:51:33.798 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.82466.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-05T00:51:33.798 INFO:teuthology.orchestra.run.smithi174.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.82466.log.gz 2023-12-05T00:51:33.798 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.86298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82590.log 2023-12-05T00:51:33.798 INFO:teuthology.orchestra.run.smithi174.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.86298.log.gz 2023-12-05T00:51:33.799 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-05T00:51:33.799 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.82590.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-05T00:51:33.799 INFO:teuthology.orchestra.run.smithi174.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.82590.log.gz 2023-12-05T00:51:33.799 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82321.log 2023-12-05T00:51:33.799 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82886.log 2023-12-05T00:51:33.799 INFO:teuthology.orchestra.run.smithi174.stderr: 89.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-05T00:51:33.799 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.82321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86360.log 2023-12-05T00:51:33.799 INFO:teuthology.orchestra.run.smithi174.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.82321.log.gz 2023-12-05T00:51:33.799 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.82886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82844.log 2023-12-05T00:51:33.799 INFO:teuthology.orchestra.run.smithi174.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.82886.log.gz 2023-12-05T00:51:33.799 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.86360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86486.log 2023-12-05T00:51:33.799 INFO:teuthology.orchestra.run.smithi174.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.86360.log.gz 2023-12-05T00:51:33.799 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.82844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86532.log 2023-12-05T00:51:33.800 INFO:teuthology.orchestra.run.smithi174.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.82844.log.gz 2023-12-05T00:51:33.800 INFO:teuthology.orchestra.run.smithi174.stderr:gzip/var/log/ceph/ceph-client.admin.86486.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.86462.log 2023-12-05T00:51:33.800 INFO:teuthology.orchestra.run.smithi174.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.86486.log.gz 2023-12-05T00:51:33.800 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.86532.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.86532.log.gz 2023-12-05T00:51:33.800 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.86462.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.86462.log.gz 2023-12-05T00:51:33.814 INFO:teuthology.orchestra.run.smithi174.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-05T00:51:33.872 INFO:teuthology.orchestra.run.smithi174.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-05T00:51:33.879 INFO:teuthology.orchestra.run.smithi174.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-05T00:51:33.886 INFO:teuthology.orchestra.run.smithi174.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-05T00:51:33.889 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/log/ceph to /home/teuthworker/archive/matan-2023-12-04_12:43:05-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7477118/remote/smithi174/log 2023-12-05T00:51:33.889 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-05T00:51:34.109 INFO:teuthology.kill:No teuthology processes running 2023-12-05T00:51:34.110 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 331, in run_with_watchdog kill.kill_job( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/kill.py", line 89, in kill_job if kill_processes(run_name, [job_info.get('pid')]): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/kill.py", line 210, in kill_processes if survivors: UnboundLocalError: local variable 'survivors' referenced before assignment 2023-12-05T00:51:34.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:53:34.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T00:53:34.281 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-12-05T00:53:34.367 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-05T00:53:34.367 INFO:teuthology.nuke:Checking targets against current locks 2023-12-05T00:53:34.437 DEBUG:teuthology.nuke:shortname: smithi174 2023-12-05T00:53:34.438 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T00:53:34.472 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-12-04_12:43:05-crimson-rados-wip-matanb-crimson-snaptrimevent-lifetime-v2-distro-crimson-smithi/7477118', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-04 12:45:54.887512', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCHYqT3vNkGTUyGrCINEo3NvXm+7XMTd0nArfZq+imgp5FoZmW8OybZgNzfz1Z0v49AGlrGryF80/WPpY5dtMuE='} 2023-12-05T00:53:34.549 INFO:teuthology.orchestra.console.smithi174:Power off 2023-12-05T00:53:34.549 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T00:53:34.603 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-12-05T00:53:34.603 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T00:53:34.654 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-12-05T00:53:38.656 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T00:53:38.771 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-12-05T00:53:42.773 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T00:53:42.885 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-12-05T00:53:46.886 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T00:53:46.996 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-05T00:53:47.097 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-12-05T00:53:47.280 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com