2023-12-09T00:53:52.488 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-09T00:53:52.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T00:53:52.638 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f855ad9eee0>, signals=[15]) 2023-12-09T00:53:52.639 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2023-12-09T00:53:52.639 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2023-12-09T00:53:52.639 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-12-09T00:53:52.660 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2023-12-09T00:53:52.660 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2023-12-09T00:53:52.660 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-12-09T00:53:52.768 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-09T00:53:52.796 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-09T00:53:52.822 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of rhel 8.6 2023-12-09T00:53:52.842 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of rhel 8.6 2023-12-09T00:53:53.070 INFO:teuthology.orchestra.console.smithi123:Power off 2023-12-09T00:53:53.071 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-09T00:53:53.084 INFO:teuthology.orchestra.console.smithi059:Power off 2023-12-09T00:53:53.085 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-09T00:53:53.094 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-12-09T00:53:53.095 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T00:53:53.108 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-12-09T00:53:53.108 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T00:53:53.116 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-12-09T00:53:53.129 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-12-09T00:53:57.118 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T00:53:57.130 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T00:53:57.228 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-12-09T00:53:57.239 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-12-09T00:54:01.231 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T00:54:01.240 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T00:54:01.340 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-12-09T00:54:01.350 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-12-09T00:54:01.453 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-12-09T00:54:01.554 INFO:teuthology.orchestra.console.smithi059:Power on 2023-12-09T00:54:01.554 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-09T00:54:01.578 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On 2023-12-09T00:54:01.579 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T00:54:01.606 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-12-09T00:54:05.342 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T00:54:05.451 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-12-09T00:54:05.552 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-12-09T00:54:05.607 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T00:54:05.653 INFO:teuthology.orchestra.console.smithi123:Power on 2023-12-09T00:54:05.654 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-09T00:54:05.677 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On 2023-12-09T00:54:05.678 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T00:54:05.699 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-12-09T00:54:05.717 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-12-09T00:54:09.702 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T00:54:10.303 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T00:54:10.406 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-12-09T00:54:10.413 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-12-09T00:54:10.507 INFO:teuthology.orchestra.console.smithi123:Power on completed 2023-12-09T00:54:10.514 INFO:teuthology.orchestra.console.smithi059:Power on completed 2023-12-09T00:54:10.608 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2023-12-09T00:54:10.614 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2023-12-09T00:56:41.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T00:56:56.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T00:57:00.002 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-12-09T00:57:06.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T00:57:09.058 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-12-09T00:57:15.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T00:57:15.106 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-12-09T00:57:18.118 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-12-09T00:57:21.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T00:57:24.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T00:57:24.166 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-12-09T00:57:30.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T00:57:33.250 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-12-09T00:57:39.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T00:57:42.306 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-12-09T00:57:48.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T00:57:51.398 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-12-09T00:57:57.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T00:58:24.151 WARNING:teuthology.provision.fog.smithi059:timed out 2023-12-09T00:58:30.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T00:58:30.402 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-09T00:58:30.402 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-09T00:58:30.708 INFO:teuthology.provision.fog.smithi059:Node is ready 2023-12-09T00:58:30.708 DEBUG:teuthology.orchestra.run.smithi059:> hostname 2023-12-09T00:58:30.728 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2023-12-09T00:58:30.728 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts 2023-12-09T00:58:30.787 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2023-12-09T00:58:30.788 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-12-09T00:58:30.911 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts 2023-12-09T00:58:30.942 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts 2023-12-09T00:58:31.012 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname 2023-12-09T00:58:31.082 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-12-09T00:58:31.150 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-12-09T00:58:31.208 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Red Hat Enterprise Linux" 2023-12-09T00:58:31.208 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8.6 (Ootpa)" 2023-12-09T00:58:31.208 INFO:teuthology.orchestra.run.smithi059.stdout:ID="rhel" 2023-12-09T00:58:31.208 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="fedora" 2023-12-09T00:58:31.208 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8.6" 2023-12-09T00:58:31.208 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2023-12-09T00:58:31.208 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-09T00:58:31.208 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-12-09T00:58:31.208 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-09T00:58:31.209 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.redhat.com/" 2023-12-09T00:58:31.209 INFO:teuthology.orchestra.run.smithi059.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-09T00:58:31.209 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-09T00:58:31.209 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-12-09T00:58:31.209 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-09T00:58:31.209 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-09T00:58:31.209 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-09T00:58:31.209 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-09T00:58:31.210 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2023-12-09T00:58:31.211 DEBUG:teuthology.parallel:result is None 2023-12-09T00:58:57.430 WARNING:teuthology.provision.fog.smithi123:timed out 2023-12-09T00:59:03.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T00:59:03.769 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-09T00:59:03.769 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-09T00:59:04.067 INFO:teuthology.provision.fog.smithi123:Node is ready 2023-12-09T00:59:04.067 DEBUG:teuthology.orchestra.run.smithi123:> hostname 2023-12-09T00:59:04.085 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123 2023-12-09T00:59:04.085 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123 /etc/hosts 2023-12-09T00:59:04.141 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2023-12-09T00:59:04.142 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-12-09T00:59:04.255 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123/smithi123/g' /etc/hosts 2023-12-09T00:59:04.286 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts 2023-12-09T00:59:04.353 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123/smithi123/g' /etc/hostname 2023-12-09T00:59:04.419 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-12-09T00:59:04.485 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-12-09T00:59:04.541 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux" 2023-12-09T00:59:04.541 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.6 (Ootpa)" 2023-12-09T00:59:04.542 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel" 2023-12-09T00:59:04.542 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora" 2023-12-09T00:59:04.542 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.6" 2023-12-09T00:59:04.542 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-12-09T00:59:04.542 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-09T00:59:04.542 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-12-09T00:59:04.542 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-09T00:59:04.542 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/" 2023-12-09T00:59:04.542 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-09T00:59:04.542 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-09T00:59:04.542 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-09T00:59:04.543 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-09T00:59:04.543 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-09T00:59:04.543 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-09T00:59:04.543 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-09T00:59:04.543 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2023-12-09T00:59:04.544 DEBUG:teuthology.parallel:result is None 2023-12-09T00:59:04.697 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2023-12-09T00:59:04.697 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-09T00:59:04.718 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2023-12-09T00:59:04.719 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-09T00:59:04.736 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2023-12-09T00:59:04.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-12-09T00:59:04.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T00:59:04.804 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-12-09T00:59:04.936 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-12-09T00:59:04.936 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2023-12-09T00:59:04.994 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2023-12-09T00:59:04.994 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-12-09T00:59:05.052 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Red Hat Enterprise Linux" 2023-12-09T00:59:05.052 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8.6 (Ootpa)" 2023-12-09T00:59:05.052 INFO:teuthology.orchestra.run.smithi059.stdout:ID="rhel" 2023-12-09T00:59:05.052 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="fedora" 2023-12-09T00:59:05.052 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8.6" 2023-12-09T00:59:05.052 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2023-12-09T00:59:05.052 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-09T00:59:05.052 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-12-09T00:59:05.053 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-09T00:59:05.053 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.redhat.com/" 2023-12-09T00:59:05.053 INFO:teuthology.orchestra.run.smithi059.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-09T00:59:05.053 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-09T00:59:05.053 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-12-09T00:59:05.053 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-09T00:59:05.053 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-09T00:59:05.053 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-09T00:59:05.053 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-09T00:59:05.054 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-12-09T00:59:05.077 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2023-12-09T00:59:05.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-12-09T00:59:05.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T00:59:05.144 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-12-09T00:59:05.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-12-09T00:59:05.214 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-12-09T00:59:05.273 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-12-09T00:59:05.273 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-12-09T00:59:05.328 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux" 2023-12-09T00:59:05.329 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.6 (Ootpa)" 2023-12-09T00:59:05.329 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel" 2023-12-09T00:59:05.329 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora" 2023-12-09T00:59:05.329 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.6" 2023-12-09T00:59:05.329 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-12-09T00:59:05.329 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-09T00:59:05.330 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-12-09T00:59:05.330 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-09T00:59:05.330 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/" 2023-12-09T00:59:05.330 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-09T00:59:05.330 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-09T00:59:05.330 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-12-09T00:59:05.330 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-09T00:59:05.331 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-09T00:59:05.331 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-09T00:59:05.331 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-09T00:59:05.331 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-12-09T00:59:05.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T00:59:05.454 INFO:teuthology.dispatcher.supervisor:Running job 7484550 2023-12-09T00:59:05.454 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-08_19:37:45-upgrade:quincy-x-main-distro-default-smithi/7484550 --name yuriw-2023-12-08_19:37:45-upgrade:quincy-x-main-distro-default-smithi --description upgrade:quincy-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} -- /home/teuthworker/archive/yuriw-2023-12-08_19:37:45-upgrade:quincy-x-main-distro-default-smithi/7484550/orig.config.yaml 2023-12-09T00:59:05.457 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-08_19:37:45-upgrade:quincy-x-main-distro-default-smithi/7484550 2023-12-09T00:59:05.458 INFO:teuthology.dispatcher.supervisor:Job PID: 706715 2023-12-09T00:59:05.458 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-09T01:01:05.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:03:05.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:05:05.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:07:06.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:09:06.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:11:06.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:13:06.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:15:06.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:17:06.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:19:07.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:21:07.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:23:07.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:25:07.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:27:07.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:29:07.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:31:08.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:33:08.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:35:08.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:37:08.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:39:08.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:41:08.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:43:09.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:45:09.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:47:09.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:49:09.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:51:09.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:53:09.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:55:10.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:57:10.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T01:59:10.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:01:10.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:03:10.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:05:10.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:07:11.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:09:11.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:11:11.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:13:11.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:15:11.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:17:11.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:19:12.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:21:12.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:23:12.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:25:12.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:27:12.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:29:12.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:31:13.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:33:13.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:35:13.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:37:13.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:39:13.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:41:13.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:43:14.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:45:14.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:47:14.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:49:14.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:51:14.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:53:14.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:55:15.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:57:15.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T02:59:15.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:01:15.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:03:15.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:05:16.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:07:16.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:09:16.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:11:16.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:13:16.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:15:16.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:17:17.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:19:17.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:21:17.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:23:17.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:25:17.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:27:17.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:29:18.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:31:18.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:33:18.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:35:18.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:37:18.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:39:18.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:41:19.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:43:19.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:45:19.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:47:19.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:49:19.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:51:20.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:53:20.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:55:20.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:57:20.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T03:59:20.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:01:20.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:03:21.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:05:21.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:07:21.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:09:21.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:11:21.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:13:21.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:15:22.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:17:22.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:19:22.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:21:22.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:23:22.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:25:22.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:27:23.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:29:23.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:31:23.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:33:23.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:35:23.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:37:23.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:39:24.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:41:24.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:43:24.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:45:24.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:47:24.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:49:24.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:51:25.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:53:25.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:55:25.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:57:25.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T04:59:25.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:01:25.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:03:26.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:05:26.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:07:26.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:09:26.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:11:26.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:13:26.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:15:27.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:17:27.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:19:27.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:21:27.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:23:27.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:25:27.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:27:28.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:29:28.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:31:28.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:33:28.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:35:28.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:37:28.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:39:29.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:41:29.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:43:29.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:45:29.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:47:29.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:49:29.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:51:30.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:53:30.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:55:30.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:57:30.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T05:59:30.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:01:30.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:03:31.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:05:31.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:07:31.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:09:31.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:11:31.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:13:31.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:15:32.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:17:32.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:19:32.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:21:32.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:23:32.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:25:33.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:27:33.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:29:33.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:31:33.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:33:33.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:35:34.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:37:34.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:39:34.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:41:34.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:43:34.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:45:34.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:47:35.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:49:35.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:51:35.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:53:35.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:55:35.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:57:35.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T06:59:36.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:01:36.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:03:36.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:05:36.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:07:36.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:09:36.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:11:37.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:13:37.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:15:37.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:17:37.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:19:37.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:21:37.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:23:38.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:25:38.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:27:38.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:29:38.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:31:38.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:33:38.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:35:39.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:37:39.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:39:39.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:41:39.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:43:39.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:45:39.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:47:40.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:49:40.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:51:40.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:53:40.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:55:40.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:57:41.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T07:59:41.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:01:41.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:03:41.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:05:41.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:07:41.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:09:41.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:11:42.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:13:42.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:15:42.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:17:42.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:19:42.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:21:42.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:23:43.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:25:43.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:27:43.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:29:43.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:31:43.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:33:43.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:35:44.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:37:44.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:39:44.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:41:44.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:43:44.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:45:44.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:47:45.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:49:45.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:51:45.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:53:45.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:55:45.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:57:46.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T08:59:46.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:01:46.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:03:46.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:05:46.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:07:46.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:09:46.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:11:47.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:13:47.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:15:47.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:17:47.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:19:47.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:21:48.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:23:48.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:25:48.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:27:48.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:29:48.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:31:48.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:33:48.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:35:49.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:37:49.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:39:49.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:41:49.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:43:49.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:45:49.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:47:50.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:49:50.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:51:50.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:53:50.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:55:50.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:57:50.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T09:59:51.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:01:51.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:03:51.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:05:51.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:07:51.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:09:51.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:11:52.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:13:52.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:15:52.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:17:52.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:19:52.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:21:52.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:23:52.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:25:53.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:27:53.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:29:53.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:31:53.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:33:53.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:35:53.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:37:53.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:39:54.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:41:54.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:43:54.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:45:54.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:47:54.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:49:54.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:51:54.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:53:54.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:55:55.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:57:55.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T10:59:55.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:01:55.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:03:55.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:05:55.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:07:56.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:09:56.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:11:56.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:13:56.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:15:56.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:17:56.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:19:57.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:21:57.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:23:57.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:25:57.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:27:57.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:29:57.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:31:58.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:33:58.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:35:58.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:37:58.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:39:58.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:41:58.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:43:58.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:45:59.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:47:59.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:49:59.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:51:59.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:53:59.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:55:59.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T11:58:00.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:00:00.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:02:00.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:04:00.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:06:00.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:08:01.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:10:01.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:12:01.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:14:01.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:16:01.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:18:01.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:20:02.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:22:02.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:24:02.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:26:02.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:28:02.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:30:02.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:32:03.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:34:03.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:36:03.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:38:03.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:40:03.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:42:03.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:44:03.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:46:04.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:48:04.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:50:04.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:52:04.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:54:04.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:56:04.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T12:58:05.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T13:00:05.270 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-12-09T13:00:05.390 INFO:teuthology.kill:Killing Pids: {706715} 2023-12-09T13:00:06.183 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2023-12-09T13:00:06.183 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2023-12-09T13:00:06.183 INFO:teuthology.misc:Compressing logs... 2023-12-09T13:00:06.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-12-09T13:00:06.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T13:00:06.299 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-12-09T13:00:06.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-12-09T13:00:06.340 DEBUG:teuthology.orchestra.run.smithi059:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-09T13:00:06.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-12-09T13:00:06.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-09T13:00:06.501 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-12-09T13:00:06.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-12-09T13:00:06.574 DEBUG:teuthology.orchestra.run.smithi123:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-09T13:00:06.774 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-08_19:37:45-upgrade:quincy-x-main-distro-default-smithi/7484550/remote/smithi059/crash 2023-12-09T13:00:06.775 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-09T13:00:06.819 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-08_19:37:45-upgrade:quincy-x-main-distro-default-smithi/7484550/remote/smithi123/crash 2023-12-09T13:00:06.820 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-09T13:00:06.869 INFO:teuthology.misc:Compressing logs... 2023-12-09T13:00:06.869 DEBUG:teuthology.orchestra.run.smithi059:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-09T13:00:06.872 DEBUG:teuthology.orchestra.run.smithi123:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-09T13:00:06.906 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-09T13:00:06.913 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-09T13:00:06.923 INFO:teuthology.orchestra.run.smithi123.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 77.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-09T13:00:06.930 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-09T13:00:06.971 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-09T13:00:06.971 INFO:teuthology.orchestra.run.smithi059.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 77.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-09T13:00:07.102 INFO:teuthology.orchestra.run.smithi123.stderr: 90.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-09T13:00:07.368 INFO:teuthology.orchestra.run.smithi059.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2023-12-09T13:00:07.368 INFO:teuthology.orchestra.run.smithi059.stderr: 90.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-09T13:00:07.370 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-08_19:37:45-upgrade:quincy-x-main-distro-default-smithi/7484550/remote/smithi059/ 2023-12-09T13:00:07.370 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-09T13:00:07.454 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-08_19:37:45-upgrade:quincy-x-main-distro-default-smithi/7484550/remote/smithi123/ 2023-12-09T13:00:07.455 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-09T13:00:07.511 INFO:teuthology.misc:Compressing logs... 2023-12-09T13:00:07.511 DEBUG:teuthology.orchestra.run.smithi059:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-09T13:00:07.513 DEBUG:teuthology.orchestra.run.smithi123:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-09T13:00:07.540 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-09T13:00:07.540 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.2.log 2023-12-09T13:00:07.540 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.0.log 2023-12-09T13:00:07.542 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.3.log 2023-12-09T13:00:07.542 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.1.log 2023-12-09T13:00:07.542 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mds.foo.smithi059.hklehv.log 2023-12-09T13:00:07.542 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mon.c.log 2023-12-09T13:00:07.542 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-volume.log 2023-12-09T13:00:07.542 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mon.a.log 2023-12-09T13:00:07.543 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mgr.y.log 2023-12-09T13:00:07.567 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-09T13:00:07.568 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mds.foo.smithi123.sbygfd.log 2023-12-09T13:00:07.568 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.5.log 2023-12-09T13:00:07.569 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.6.log 2023-12-09T13:00:07.569 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mds.foo.smithi123.sbygfd.log: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.5.log: 61.7% -- replaced with /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mds.foo.smithi123.sbygfd.log.gz 2023-12-09T13:00:07.569 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.4.log 2023-12-09T13:00:07.569 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mgr.x.log 2023-12-09T13:00:07.570 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-volume.log 2023-12-09T13:00:07.570 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.7.log 2023-12-09T13:00:07.570 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mon.b.log 2023-12-09T13:00:07.619 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.2.log: /var/log/ceph/cephadm.log: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.0.log: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.3.log: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.1.log: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mds.foo.smithi059.hklehv.log: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mon.c.log: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-volume.log: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mon.a.log: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mgr.y.log: 80.8% -- replaced with /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mds.foo.smithi059.hklehv.log.gz 2023-12-09T13:00:07.819 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.7.log: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mon.b.log: /var/log/ceph/cephadm.log: 91.5% -- replaced with /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-volume.log.gz 2023-12-09T13:00:07.944 INFO:teuthology.orchestra.run.smithi059.stderr: 95.8% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-09T13:00:07.989 INFO:teuthology.orchestra.run.smithi123.stderr: 93.3% -- replaced with /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mgr.x.log.gz 2023-12-09T13:00:08.441 INFO:teuthology.orchestra.run.smithi123.stderr: 94.4% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-09T13:00:09.256 INFO:teuthology.orchestra.run.smithi059.stderr: 91.5% -- replaced with /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-volume.log.gz 2023-12-09T13:00:20.443 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mgr.y.log: file size changed while zipping 2023-12-09T13:00:20.444 INFO:teuthology.orchestra.run.smithi059.stderr: 89.9% -- replaced with /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mgr.y.log.gz 2023-12-09T13:00:26.963 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mon.b.log: file size changed while zipping 2023-12-09T13:00:26.963 INFO:teuthology.orchestra.run.smithi123.stderr: 92.8% -- replaced with /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mon.b.log.gz 2023-12-09T13:00:31.615 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mon.c.log: file size changed while zipping 2023-12-09T13:00:31.615 INFO:teuthology.orchestra.run.smithi059.stderr: 92.7% -- replaced with /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mon.c.log.gz 2023-12-09T13:01:24.446 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mon.a.log: file size changed while zipping 2023-12-09T13:01:24.446 INFO:teuthology.orchestra.run.smithi059.stderr: 90.2% -- replaced with /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-mon.a.log.gz 2023-12-09T13:07:56.106 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.7.log: file size changed while zipping 2023-12-09T13:07:56.106 INFO:teuthology.orchestra.run.smithi123.stderr: 93.5% -- replaced with /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.7.log.gz 2023-12-09T13:08:20.401 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.5.log: file size changed while zipping 2023-12-09T13:08:20.401 INFO:teuthology.orchestra.run.smithi123.stderr: 93.3% -- replaced with /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.5.log.gz 2023-12-09T13:09:25.505 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.4.log: file size changed while zipping 2023-12-09T13:09:25.505 INFO:teuthology.orchestra.run.smithi123.stderr: 93.1% -- replaced with /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.4.log.gz 2023-12-09T13:09:43.150 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.6.log: file size changed while zipping 2023-12-09T13:09:43.150 INFO:teuthology.orchestra.run.smithi123.stderr: 92.8% -- replaced with /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.6.log.gz 2023-12-09T13:09:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.2.log: file size changed while zipping 2023-12-09T13:09:59.818 INFO:teuthology.orchestra.run.smithi059.stderr: 92.2% -- replaced with /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.2.log.gz 2023-12-09T13:11:36.112 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.1.log: file size changed while zipping 2023-12-09T13:11:36.113 INFO:teuthology.orchestra.run.smithi059.stderr: 93.0% -- replaced with /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.1.log.gz 2023-12-09T13:11:58.478 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.3.log: file size changed while zipping 2023-12-09T13:11:58.479 INFO:teuthology.orchestra.run.smithi059.stderr: 93.0% -- replaced with /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.3.log.gz 2023-12-09T13:12:43.772 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.0.log: file size changed while zipping 2023-12-09T13:12:43.773 INFO:teuthology.orchestra.run.smithi059.stderr: 92.3% -- replaced with /var/log/ceph/8c313d76-9630-11ee-95a3-87774f69a715/ceph-osd.0.log.gz 2023-12-09T13:12:43.779 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-08_19:37:45-upgrade:quincy-x-main-distro-default-smithi/7484550/remote/smithi059/log 2023-12-09T13:12:43.780 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-09T13:15:03.167 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-08_19:37:45-upgrade:quincy-x-main-distro-default-smithi/7484550/remote/smithi123/log 2023-12-09T13:15:03.168 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-09T13:16:47.196 INFO:teuthology.kill:No teuthology processes running 2023-12-09T13:16:47.219 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 331, in run_with_watchdog kill.kill_job( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/kill.py", line 89, in kill_job if kill_processes(run_name, [job_info.get('pid')]): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/kill.py", line 210, in kill_processes if survivors: UnboundLocalError: local variable 'survivors' referenced before assignment 2023-12-09T13:16:47.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T13:18:47.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-09T13:18:47.409 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-12-09T13:18:47.526 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-09T13:18:47.526 INFO:teuthology.nuke:Checking targets against current locks 2023-12-09T13:18:47.576 DEBUG:teuthology.nuke:shortname: smithi059 2023-12-09T13:18:47.577 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-09T13:18:47.596 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-08_19:37:45-upgrade:quincy-x-main-distro-default-smithi/7484550', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-09 00:53:51.628995', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-09T13:18:47.597 DEBUG:teuthology.nuke:shortname: smithi123 2023-12-09T13:18:47.597 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-09T13:18:47.618 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-08_19:37:45-upgrade:quincy-x-main-distro-default-smithi/7484550', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-09 00:53:51.630161', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-09T13:18:47.642 INFO:teuthology.orchestra.console.smithi059:Power off 2023-12-09T13:18:47.642 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-09T13:18:47.663 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-12-09T13:18:47.663 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T13:18:47.678 INFO:teuthology.orchestra.console.smithi123:Power off 2023-12-09T13:18:47.678 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-09T13:18:47.693 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-12-09T13:18:47.698 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-12-09T13:18:47.698 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T13:18:47.719 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-12-09T13:18:51.694 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T13:18:51.720 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T13:18:51.804 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-12-09T13:18:51.828 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-12-09T13:18:55.809 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T13:18:55.829 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-09T13:18:55.917 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-12-09T13:18:55.937 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-12-09T13:18:56.018 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-12-09T13:18:56.038 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-12-09T13:18:56.166 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com 2023-12-09T13:18:56.182 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com