2023-12-22T20:24:55.343 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a 2023-12-22T20:24:55.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:24:55.508 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb60e172940>, signals=[15]) 2023-12-22T20:24:55.508 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging 2023-12-22T20:24:55.508 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server 2023-12-22T20:24:55.508 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-12-22T20:24:55.536 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2023-12-22T20:24:55.536 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2023-12-22T20:24:55.536 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-12-22T20:24:55.652 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-22T20:24:55.658 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-22T20:24:55.704 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of rhel 8.6 2023-12-22T20:24:55.708 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of rhel 8.6 2023-12-22T20:24:55.915 INFO:teuthology.orchestra.console.smithi081:Power off 2023-12-22T20:24:55.916 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T20:24:55.933 INFO:teuthology.orchestra.console.smithi190:Power off 2023-12-22T20:24:55.933 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T20:24:55.944 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-12-22T20:24:55.945 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T20:24:55.958 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-12-22T20:24:55.958 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T20:24:55.969 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-12-22T20:24:55.982 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-12-22T20:24:56.070 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-12-22T20:24:56.171 INFO:teuthology.orchestra.console.smithi081:Power on 2023-12-22T20:24:56.171 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-22T20:24:56.204 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On 2023-12-22T20:24:56.205 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T20:24:56.232 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-12-22T20:24:59.985 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T20:25:00.096 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-12-22T20:25:00.234 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T20:25:00.348 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-12-22T20:25:00.449 INFO:teuthology.orchestra.console.smithi081:Power on completed 2023-12-22T20:25:00.550 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2023-12-22T20:25:04.101 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T20:25:04.209 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-12-22T20:25:08.213 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T20:25:08.322 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-12-22T20:25:08.423 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-12-22T20:25:08.523 INFO:teuthology.orchestra.console.smithi190:Power on 2023-12-22T20:25:08.524 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-22T20:25:08.546 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On 2023-12-22T20:25:08.546 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T20:25:08.570 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-12-22T20:25:12.575 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T20:25:12.687 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-12-22T20:25:16.689 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T20:25:16.803 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-12-22T20:25:16.904 INFO:teuthology.orchestra.console.smithi190:Power on completed 2023-12-22T20:25:17.005 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2023-12-22T20:27:46.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T20:27:49.366 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-12-22T20:27:55.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T20:27:58.449 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-12-22T20:28:02.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T20:28:04.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T20:28:05.685 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-22T20:28:07.505 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-12-22T20:28:11.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T20:28:13.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T20:28:14.770 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-22T20:28:16.565 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-12-22T20:28:20.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T20:28:22.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T20:28:23.825 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-22T20:28:25.653 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-12-22T20:28:29.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T20:28:31.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T20:28:32.881 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-22T20:28:34.737 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-12-22T20:28:38.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T20:28:40.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T20:28:41.969 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-22T20:28:43.793 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-12-22T20:28:47.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T20:28:49.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T20:29:48.034 WARNING:teuthology.provision.fog.smithi190:timed out 2023-12-22T20:29:49.801 WARNING:teuthology.provision.fog.smithi081:timed out 2023-12-22T20:29:54.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T20:29:54.241 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-22T20:29:54.241 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-22T20:29:54.505 INFO:teuthology.provision.fog.smithi190:Node is ready 2023-12-22T20:29:54.505 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2023-12-22T20:29:54.522 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2023-12-22T20:29:54.522 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts 2023-12-22T20:29:54.580 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2023-12-22T20:29:54.580 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-12-22T20:29:54.692 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hosts 2023-12-22T20:29:54.721 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2023-12-22T20:29:54.788 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hostname 2023-12-22T20:29:54.856 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-12-22T20:29:54.922 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-12-22T20:29:54.979 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-12-22T20:29:54.979 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2023-12-22T20:29:54.979 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-12-22T20:29:54.979 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-12-22T20:29:54.980 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2023-12-22T20:29:54.980 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-12-22T20:29:54.980 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-22T20:29:54.980 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-12-22T20:29:54.980 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-22T20:29:54.980 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-12-22T20:29:54.980 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-22T20:29:54.980 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T20:29:54.980 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-22T20:29:54.980 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T20:29:54.980 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-22T20:29:54.980 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-22T20:29:54.980 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-22T20:29:54.981 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2023-12-22T20:29:54.982 DEBUG:teuthology.parallel:result is None 2023-12-22T20:29:55.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T20:29:56.067 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-22T20:29:56.067 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-22T20:29:56.326 INFO:teuthology.provision.fog.smithi081:Node is ready 2023-12-22T20:29:56.326 DEBUG:teuthology.orchestra.run.smithi081:> hostname 2023-12-22T20:29:56.344 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081 2023-12-22T20:29:56.344 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081 /etc/hosts 2023-12-22T20:29:56.403 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2023-12-22T20:29:56.403 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-12-22T20:29:56.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081/smithi081/g' /etc/hosts 2023-12-22T20:29:56.538 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts 2023-12-22T20:29:56.606 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081/smithi081/g' /etc/hostname 2023-12-22T20:29:56.677 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-12-22T20:29:56.740 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-12-22T20:29:56.796 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux" 2023-12-22T20:29:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)" 2023-12-22T20:29:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel" 2023-12-22T20:29:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora" 2023-12-22T20:29:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6" 2023-12-22T20:29:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-12-22T20:29:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-22T20:29:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-12-22T20:29:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-22T20:29:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/" 2023-12-22T20:29:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-22T20:29:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T20:29:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T20:29:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T20:29:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-22T20:29:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-22T20:29:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-22T20:29:56.798 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2023-12-22T20:29:56.798 DEBUG:teuthology.parallel:result is None 2023-12-22T20:29:56.959 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2023-12-22T20:29:56.959 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-22T20:29:56.983 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2023-12-22T20:29:56.983 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-22T20:29:57.009 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2023-12-22T20:29:57.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-22T20:29:57.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T20:29:57.078 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-12-22T20:29:57.142 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-22T20:29:57.142 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-12-22T20:29:57.199 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-12-22T20:29:57.199 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-12-22T20:29:57.255 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux" 2023-12-22T20:29:57.255 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)" 2023-12-22T20:29:57.256 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel" 2023-12-22T20:29:57.256 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora" 2023-12-22T20:29:57.256 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6" 2023-12-22T20:29:57.256 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-12-22T20:29:57.256 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-22T20:29:57.256 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-12-22T20:29:57.256 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-22T20:29:57.256 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/" 2023-12-22T20:29:57.256 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-22T20:29:57.256 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T20:29:57.256 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T20:29:57.256 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T20:29:57.257 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-22T20:29:57.257 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-22T20:29:57.257 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-22T20:29:57.257 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-12-22T20:29:57.284 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2023-12-22T20:29:57.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-12-22T20:29:57.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T20:29:57.354 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-12-22T20:29:57.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-12-22T20:29:57.383 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-12-22T20:29:57.442 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-12-22T20:29:57.442 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-12-22T20:29:57.502 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-12-22T20:29:57.503 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2023-12-22T20:29:57.503 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-12-22T20:29:57.503 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-12-22T20:29:57.503 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2023-12-22T20:29:57.503 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-12-22T20:29:57.503 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-22T20:29:57.503 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-12-22T20:29:57.503 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-22T20:29:57.503 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-12-22T20:29:57.503 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-22T20:29:57.504 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T20:29:57.504 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-22T20:29:57.504 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T20:29:57.504 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-22T20:29:57.504 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-22T20:29:57.504 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-22T20:29:57.504 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-12-22T20:29:57.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:29:57.618 INFO:teuthology.dispatcher.supervisor:Running job 7499823 2023-12-22T20:29:57.619 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2023-12-22_20:18:10-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7499823 --name lflores-2023-12-22_20:18:10-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} -- /home/teuthworker/archive/lflores-2023-12-22_20:18:10-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7499823/orig.config.yaml 2023-12-22T20:29:57.623 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2023-12-22_20:18:10-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7499823 2023-12-22T20:29:57.624 INFO:teuthology.dispatcher.supervisor:Job PID: 667206 2023-12-22T20:29:57.624 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-22T20:31:57.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:33:57.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:35:58.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:37:58.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:39:58.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:41:58.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:43:58.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:45:58.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:47:59.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:49:59.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:51:59.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:53:59.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:55:59.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:57:59.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:00:00.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:02:00.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:04:00.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:06:00.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:08:00.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:10:00.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:12:00.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:14:01.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:16:01.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:18:01.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:20:01.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:22:01.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:24:02.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:26:02.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:28:02.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:30:02.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:32:02.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:34:02.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:36:02.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:38:03.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:40:03.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:42:03.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:44:03.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:46:03.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:48:04.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:50:04.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:52:04.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:54:04.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:56:04.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T21:58:04.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:00:05.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:02:05.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:04:05.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:06:05.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:08:05.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:10:05.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:12:06.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:14:06.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:16:06.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:18:06.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:20:06.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:22:06.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:24:07.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:26:07.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:28:07.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:30:07.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:32:07.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:34:07.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:36:08.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:38:08.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:40:08.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:42:08.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:44:08.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:46:08.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:48:09.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:50:09.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:52:09.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:54:09.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:56:09.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T22:58:09.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:00:10.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:02:10.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:04:10.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:06:10.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:08:10.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:10:10.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:12:10.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:14:11.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:16:11.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:18:11.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:20:11.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:22:11.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:24:11.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:26:12.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:28:12.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:30:12.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:32:12.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:34:12.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:36:12.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:38:13.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:40:13.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:42:13.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:44:13.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:46:13.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:48:13.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:50:14.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:52:14.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:54:14.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:56:14.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T23:58:14.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:00:14.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:02:15.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:04:15.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:06:15.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:08:15.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:10:15.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:12:15.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:14:16.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:16:16.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:18:16.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:20:16.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:22:16.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:24:16.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:26:17.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:28:17.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:30:17.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:32:17.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:34:17.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:36:17.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:38:18.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:40:18.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:42:18.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:44:18.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:46:18.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:48:18.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:50:19.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:52:19.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:54:19.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:56:19.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T00:58:19.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:00:19.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:02:20.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:04:20.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:06:20.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:08:20.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:10:20.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:12:20.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:14:21.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:16:21.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:18:21.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:20:21.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:22:21.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:24:22.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:26:22.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:28:22.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:30:22.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:32:22.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:34:22.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:36:22.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:38:23.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:40:23.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:42:23.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:44:23.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:46:23.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:48:24.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:50:24.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:52:24.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:54:24.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:56:24.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T01:58:24.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:00:24.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:02:25.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:04:25.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:06:25.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:08:25.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:10:25.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:12:25.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:14:26.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:16:26.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:18:26.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:20:26.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:22:26.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:24:26.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:26:26.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:28:27.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:30:27.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:32:27.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:34:27.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:36:27.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:38:27.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:40:28.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:42:28.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:44:28.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:46:28.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:48:28.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:50:29.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:52:29.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:54:29.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:56:29.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T02:58:29.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:00:29.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:02:29.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:04:29.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:06:30.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:08:30.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:10:30.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:12:30.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:14:30.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:16:30.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:18:31.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:20:31.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:22:31.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:24:31.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:26:31.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:28:31.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:30:31.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:32:32.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:34:32.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:36:32.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:38:32.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:40:32.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:42:32.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:44:33.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:46:33.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:48:33.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:50:33.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:52:33.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:54:33.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:56:33.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T03:58:34.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:00:34.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:02:34.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:04:34.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:06:35.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:08:35.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:10:35.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:12:35.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:14:35.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:16:35.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:18:36.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:20:36.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:22:36.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:24:36.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:26:36.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:28:36.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:30:37.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:32:37.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:34:37.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:36:37.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:38:37.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:40:37.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:42:37.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:44:38.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:46:38.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:48:38.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:50:38.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:52:38.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:54:38.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:56:39.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T04:58:39.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:00:39.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:02:39.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:04:39.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:06:39.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:08:39.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:10:40.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:12:40.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:14:40.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:16:40.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:18:40.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:20:40.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:22:41.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:24:41.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:26:41.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:28:41.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:30:41.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:32:41.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:34:42.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:36:42.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:38:42.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:40:42.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:42:42.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:44:42.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:46:42.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:48:42.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:50:43.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:52:43.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:54:43.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:56:43.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T05:58:43.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:00:43.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:02:43.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:04:44.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:06:44.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:08:44.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:10:44.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:12:44.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:14:45.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:16:45.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:18:45.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:20:45.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:22:45.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:24:45.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:26:45.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:28:46.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:30:46.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:32:46.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:34:46.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:36:46.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:38:46.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:40:47.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:42:47.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:44:47.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:46:47.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:48:47.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:50:47.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:52:47.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:54:48.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:56:48.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T06:58:48.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:00:48.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:02:48.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:04:48.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:06:49.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:08:49.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:10:49.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:12:49.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:14:49.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:16:49.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:18:50.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:20:50.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:22:50.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:24:50.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:26:50.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:28:50.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:30:51.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:32:51.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:34:51.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:36:51.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:38:51.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:40:51.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:42:51.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:44:52.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:46:52.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:48:52.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:50:52.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:52:52.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:54:52.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:56:52.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T07:58:52.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T08:00:53.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T08:02:53.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T08:04:53.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T08:06:53.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T08:08:53.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T08:10:53.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T08:12:53.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T08:14:54.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T08:16:54.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T08:18:54.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T08:20:54.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T08:22:54.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T08:24:54.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T08:26:55.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T08:28:55.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T08:30:55.329 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-12-23T08:30:55.478 INFO:teuthology.kill:Killing Pids: {667206} 2023-12-23T08:30:56.250 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2023-12-23T08:30:56.251 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2023-12-23T08:30:56.251 INFO:teuthology.misc:Compressing logs... 2023-12-23T08:30:56.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-23T08:30:56.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-23T08:30:56.444 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-12-23T08:30:56.559 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-23T08:30:56.560 DEBUG:teuthology.orchestra.run.smithi081:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-23T08:30:56.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-12-23T08:30:56.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-23T08:30:57.728 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-12-23T08:30:57.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-12-23T08:30:57.834 DEBUG:teuthology.orchestra.run.smithi190:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-23T08:30:58.103 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/lflores-2023-12-22_20:18:10-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7499823/remote/smithi081/crash 2023-12-23T08:30:58.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-23T08:30:58.155 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/crash to /home/teuthworker/archive/lflores-2023-12-22_20:18:10-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7499823/remote/smithi190/crash 2023-12-23T08:30:58.156 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-23T08:30:58.207 INFO:teuthology.misc:Compressing logs... 2023-12-23T08:30:58.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-23T08:30:58.210 DEBUG:teuthology.orchestra.run.smithi190:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-23T08:30:58.249 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-23T08:30:58.262 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-23T08:30:58.284 INFO:teuthology.orchestra.run.smithi081.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 77.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-23T08:30:58.297 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-23T08:30:58.312 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-23T08:30:58.332 INFO:teuthology.orchestra.run.smithi190.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 79.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-23T08:31:00.259 INFO:teuthology.orchestra.run.smithi081.stderr: 96.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-23T08:31:01.217 INFO:teuthology.orchestra.run.smithi190.stderr: 95.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-23T08:31:01.219 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/lflores-2023-12-22_20:18:10-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7499823/remote/smithi081/ 2023-12-23T08:31:01.219 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-23T08:31:01.456 DEBUG:teuthology.misc:Transferring archived files from smithi190:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/lflores-2023-12-22_20:18:10-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7499823/remote/smithi190/ 2023-12-23T08:31:01.456 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-23T08:31:01.752 INFO:teuthology.misc:Compressing logs... 2023-12-23T08:31:01.752 DEBUG:teuthology.orchestra.run.smithi081:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-23T08:31:01.754 DEBUG:teuthology.orchestra.run.smithi190:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-23T08:31:01.797 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-23T08:31:01.803 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mon.a.log 2023-12-23T08:31:01.803 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mds.foo.smithi081.qqzndv.log 2023-12-23T08:31:01.803 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.1.log 2023-12-23T08:31:01.803 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.3.log 2023-12-23T08:31:01.804 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.2.log 2023-12-23T08:31:01.804 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-23T08:31:01.804 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.0.log 2023-12-23T08:31:01.804 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mon.c.log 2023-12-23T08:31:01.804 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mgr.y.log 2023-12-23T08:31:01.807 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.3.log: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.0.log: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mds.foo.smithi081.qqzndv.log: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mon.a.log: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.2.log: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-volume.log: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.1.log: 0.0% -- replaced with /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mds.foo.smithi081.qqzndv.log.gz 2023-12-23T08:31:01.807 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mon.c.log: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mgr.y.log: 92.9% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-23T08:31:01.833 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-23T08:31:01.844 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.5.log 2023-12-23T08:31:01.845 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mds.foo.smithi190.nllvgt.log 2023-12-23T08:31:01.845 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.7.log 2023-12-23T08:31:01.846 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-23T08:31:01.847 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mds.foo.smithi190.nllvgt.log: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.6.log 2023-12-23T08:31:01.847 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mon.b.log 2023-12-23T08:31:01.847 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.6.log: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mgr.x.log 2023-12-23T08:31:01.847 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.4.log 2023-12-23T08:31:01.850 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.4.log: 0.0% -- replaced with /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mds.foo.smithi190.nllvgt.log.gz 2023-12-23T08:31:01.931 INFO:teuthology.orchestra.run.smithi190.stderr: 92.8% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-23T08:31:01.931 INFO:teuthology.orchestra.run.smithi190.stderr: 94.5% -- replaced with /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-23T08:31:02.768 INFO:teuthology.orchestra.run.smithi081.stderr: 94.7% -- replaced with /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-23T08:31:18.681 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.5.log: file size changed while zipping 2023-12-23T08:31:18.707 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.2.log: file size changed while zipping 2023-12-23T08:31:18.707 INFO:teuthology.orchestra.run.smithi081.stderr: 92.3% -- replaced with /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.2.log.gz 2023-12-23T08:31:18.865 INFO:teuthology.orchestra.run.smithi190.stderr: 92.9% -- replaced with /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.5.log.gz 2023-12-23T08:31:19.544 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.6.log: file size changed while zipping 2023-12-23T08:31:20.136 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.7.log: file size changed while zipping 2023-12-23T08:31:20.833 INFO:teuthology.orchestra.run.smithi190.stderr: 92.8% -- replaced with /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.6.log.gz 2023-12-23T08:31:20.938 INFO:teuthology.orchestra.run.smithi190.stderr: 93.1% -- replaced with /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.7.log.gz 2023-12-23T08:31:23.615 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.0.log: file size changed while zipping 2023-12-23T08:31:23.615 INFO:teuthology.orchestra.run.smithi081.stderr: 93.2% -- replaced with /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.0.log.gz 2023-12-23T08:31:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mgr.y.log: file size changed while zipping 2023-12-23T08:31:23.880 INFO:teuthology.orchestra.run.smithi081.stderr: 91.7% -- replaced with /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mgr.y.log.gz 2023-12-23T08:31:24.454 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.3.log: file size changed while zipping 2023-12-23T08:31:24.454 INFO:teuthology.orchestra.run.smithi081.stderr: 93.4% -- replaced with /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.3.log.gz 2023-12-23T08:31:25.676 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.1.log: file size changed while zipping 2023-12-23T08:31:25.676 INFO:teuthology.orchestra.run.smithi081.stderr: 93.1% -- replaced with /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.1.log.gz 2023-12-23T08:31:28.919 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.4.log: file size changed while zipping 2023-12-23T08:31:29.148 INFO:teuthology.orchestra.run.smithi190.stderr: 93.5% -- replaced with /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-osd.4.log.gz 2023-12-23T08:44:04.103 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mon.c.log: file size changed while zipping 2023-12-23T08:44:04.104 INFO:teuthology.orchestra.run.smithi081.stderr: 94.6% -- replaced with /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mon.c.log.gz 2023-12-23T08:45:21.060 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mon.a.log: file size changed while zipping 2023-12-23T08:45:21.061 INFO:teuthology.orchestra.run.smithi081.stderr: 94.4% -- replaced with /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mon.a.log.gz 2023-12-23T09:47:45.064 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mgr.x.log: file size changed while zipping 2023-12-23T09:47:45.861 INFO:teuthology.orchestra.run.smithi190.stderr: 96.3% -- replaced with /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mgr.x.log.gz 2023-12-23T11:08:41.549 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mon.b.log: file size changed while zipping 2023-12-23T11:08:41.570 INFO:teuthology.orchestra.run.smithi190.stderr: 94.9% -- replaced with /var/log/ceph/f0e103d4-a10a-11ee-95a5-87774f69a715/ceph-mon.b.log.gz 2023-12-23T11:08:41.610 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/lflores-2023-12-22_20:18:10-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7499823/remote/smithi081/log 2023-12-23T11:08:41.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-23T11:12:24.717 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/log/ceph to /home/teuthworker/archive/lflores-2023-12-22_20:18:10-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7499823/remote/smithi190/log 2023-12-23T11:12:24.718 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-23T11:36:48.130 INFO:teuthology.orchestra.run.smithi190.stderr:tar: ./f0e103d4-a10a-11ee-95a5-87774f69a715: file changed as we read it 2023-12-23T11:36:48.275 INFO:teuthology.kill:No teuthology processes running 2023-12-23T11:36:48.276 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/dispatcher/supervisor.py", line 331, in run_with_watchdog kill.kill_job( File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/kill.py", line 89, in kill_job if kill_processes(run_name, [job_info.get('pid')]): File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/kill.py", line 210, in kill_processes if survivors: UnboundLocalError: local variable 'survivors' referenced before assignment 2023-12-23T11:36:48.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T11:38:48.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-23T11:38:48.526 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-12-23T11:38:48.648 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-23T11:38:48.648 INFO:teuthology.nuke:Checking targets against current locks 2023-12-23T11:38:48.697 DEBUG:teuthology.nuke:shortname: smithi081 2023-12-23T11:38:48.698 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-23T11:38:48.716 DEBUG:teuthology.nuke:shortname: smithi190 2023-12-23T11:38:48.716 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-23T11:38:48.719 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-12-22_20:18:10-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7499823', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 20:24:54.431825', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAIoPBty/iGBz5q25EQzWsUMdOwmuO0C5Nl0wuvgKr26XI50vB/XkHeJawyE5t1O664whL174eWPDOG7GRMte7Q='} 2023-12-23T11:38:48.736 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-12-22_20:18:10-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7499823', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 20:24:54.433630', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKeh0Mvjfs91gGsnYbNxj2Sp41UD+H62xoPhIGo8m7GgLLgurOZj+C0wF2rXym2joQzbbdlx/ICznxm2jQi+BNU='} 2023-12-23T11:38:48.766 INFO:teuthology.orchestra.console.smithi081:Power off 2023-12-23T11:38:48.766 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-23T11:38:48.782 INFO:teuthology.orchestra.console.smithi190:Power off 2023-12-23T11:38:48.782 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-23T11:38:48.790 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-12-23T11:38:48.791 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-23T11:38:48.803 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-12-23T11:38:48.803 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-23T11:38:48.812 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-12-23T11:38:48.826 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-12-23T11:38:52.816 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-23T11:38:52.827 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-23T11:38:52.926 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-12-23T11:38:52.936 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-12-23T11:38:56.931 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-23T11:38:56.940 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-23T11:38:57.042 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-12-23T11:38:57.054 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-12-23T11:38:57.143 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-12-23T11:38:57.308 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com 2023-12-23T11:39:01.058 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-23T11:39:01.167 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-12-23T11:39:01.267 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-12-23T11:39:01.422 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com