2023-12-16T00:36:15.518 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-16T00:36:15.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:36:15.651 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f92faae0940>, signals=[15]) 2023-12-16T00:36:15.652 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging 2023-12-16T00:36:15.652 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server 2023-12-16T00:36:15.652 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-12-16T00:36:15.674 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2023-12-16T00:36:15.674 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2023-12-16T00:36:15.675 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-12-16T00:36:15.792 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-16T00:36:15.798 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-16T00:36:15.836 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of rhel 8.6 2023-12-16T00:36:15.847 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of rhel 8.6 2023-12-16T00:36:16.066 INFO:teuthology.orchestra.console.smithi046:Power off 2023-12-16T00:36:16.066 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T00:36:16.079 INFO:teuthology.orchestra.console.smithi181:Power off 2023-12-16T00:36:16.079 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T00:36:16.087 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2023-12-16T00:36:16.087 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:36:16.099 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2023-12-16T00:36:16.099 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:36:16.107 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-12-16T00:36:16.121 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-12-16T00:36:16.208 INFO:teuthology.orchestra.console.smithi046:Power off completed 2023-12-16T00:36:16.221 INFO:teuthology.orchestra.console.smithi181:Power off completed 2023-12-16T00:36:16.309 INFO:teuthology.orchestra.console.smithi046:Power on 2023-12-16T00:36:16.309 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-16T00:36:16.322 INFO:teuthology.orchestra.console.smithi181:Power on 2023-12-16T00:36:16.322 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-16T00:36:16.330 DEBUG:teuthology.orchestra.console.smithi046:power on output: Chassis Power Control: Up/On 2023-12-16T00:36:16.331 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:36:16.343 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On 2023-12-16T00:36:16.343 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:36:16.351 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-12-16T00:36:16.363 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-12-16T00:36:20.356 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:36:20.364 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:36:20.465 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-12-16T00:36:20.471 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-12-16T00:36:20.572 INFO:teuthology.orchestra.console.smithi181:Power on completed 2023-12-16T00:36:20.672 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2023-12-16T00:36:24.468 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:36:24.577 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-12-16T00:36:24.678 INFO:teuthology.orchestra.console.smithi046:Power on completed 2023-12-16T00:36:24.778 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish 2023-12-16T00:39:06.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:39:09.458 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-12-16T00:39:10.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:39:13.493 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-12-16T00:39:15.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:39:18.517 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-12-16T00:39:19.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:39:22.545 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-12-16T00:39:24.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:39:27.602 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-12-16T00:39:28.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:39:31.601 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-12-16T00:39:33.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:39:36.657 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-12-16T00:39:37.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:39:40.661 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-12-16T00:39:42.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:39:45.713 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-12-16T00:39:46.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:39:49.717 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-12-16T00:39:51.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:39:54.769 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-12-16T00:39:55.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:39:58.769 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-12-16T00:40:00.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:40:03.825 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-12-16T00:40:04.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:40:09.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:41:04.809 WARNING:teuthology.provision.fog.smithi046:timed out 2023-12-16T00:41:09.838 WARNING:teuthology.provision.fog.smithi181:timed out 2023-12-16T00:41:10.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:41:11.030 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-16T00:41:11.031 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-16T00:41:11.310 INFO:teuthology.provision.fog.smithi046:Node is ready 2023-12-16T00:41:11.311 DEBUG:teuthology.orchestra.run.smithi046:> hostname 2023-12-16T00:41:11.332 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com 2023-12-16T00:41:11.332 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts 2023-12-16T00:41:11.393 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2023-12-16T00:41:11.393 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2023-12-16T00:41:11.524 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts 2023-12-16T00:41:11.558 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts 2023-12-16T00:41:11.632 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname 2023-12-16T00:41:11.706 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2023-12-16T00:41:11.780 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-12-16T00:41:11.841 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Red Hat Enterprise Linux" 2023-12-16T00:41:11.841 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8.6 (Ootpa)" 2023-12-16T00:41:11.841 INFO:teuthology.orchestra.run.smithi046.stdout:ID="rhel" 2023-12-16T00:41:11.841 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="fedora" 2023-12-16T00:41:11.841 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8.6" 2023-12-16T00:41:11.842 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:41:11.842 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-16T00:41:11.842 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2023-12-16T00:41:11.842 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-16T00:41:11.842 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.redhat.com/" 2023-12-16T00:41:11.842 INFO:teuthology.orchestra.run.smithi046.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-16T00:41:11.842 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:41:11.842 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-12-16T00:41:11.842 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:41:11.842 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-16T00:41:11.842 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-16T00:41:11.842 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-16T00:41:11.843 INFO:teuthology.provision.fog.smithi046:Deploy complete! 2023-12-16T00:41:11.845 DEBUG:teuthology.parallel:result is None 2023-12-16T00:41:15.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:41:16.070 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-16T00:41:16.071 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-16T00:41:16.330 INFO:teuthology.provision.fog.smithi181:Node is ready 2023-12-16T00:41:16.331 DEBUG:teuthology.orchestra.run.smithi181:> hostname 2023-12-16T00:41:16.389 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181 2023-12-16T00:41:16.390 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181 /etc/hosts 2023-12-16T00:41:16.448 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181 2023-12-16T00:41:16.449 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2023-12-16T00:41:16.568 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181/smithi181/g' /etc/hosts 2023-12-16T00:41:16.597 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts 2023-12-16T00:41:16.668 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181/smithi181/g' /etc/hostname 2023-12-16T00:41:16.739 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2023-12-16T00:41:16.809 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2023-12-16T00:41:16.869 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Red Hat Enterprise Linux" 2023-12-16T00:41:16.869 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8.6 (Ootpa)" 2023-12-16T00:41:16.869 INFO:teuthology.orchestra.run.smithi181.stdout:ID="rhel" 2023-12-16T00:41:16.869 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="fedora" 2023-12-16T00:41:16.869 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8.6" 2023-12-16T00:41:16.869 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:41:16.869 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-16T00:41:16.869 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2023-12-16T00:41:16.869 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-16T00:41:16.869 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.redhat.com/" 2023-12-16T00:41:16.870 INFO:teuthology.orchestra.run.smithi181.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-16T00:41:16.870 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:41:16.870 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-12-16T00:41:16.870 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:41:16.870 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-16T00:41:16.870 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-16T00:41:16.870 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-16T00:41:16.870 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2023-12-16T00:41:16.871 DEBUG:teuthology.parallel:result is None 2023-12-16T00:41:17.050 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com 2023-12-16T00:41:17.050 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-16T00:41:17.071 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2023-12-16T00:41:17.071 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-16T00:41:17.089 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server 2023-12-16T00:41:17.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-12-16T00:41:17.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:41:17.157 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-12-16T00:41:17.235 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-12-16T00:41:17.235 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2023-12-16T00:41:17.296 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2023-12-16T00:41:17.296 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-12-16T00:41:17.357 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Red Hat Enterprise Linux" 2023-12-16T00:41:17.357 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8.6 (Ootpa)" 2023-12-16T00:41:17.357 INFO:teuthology.orchestra.run.smithi046.stdout:ID="rhel" 2023-12-16T00:41:17.357 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="fedora" 2023-12-16T00:41:17.358 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8.6" 2023-12-16T00:41:17.358 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:41:17.358 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-16T00:41:17.358 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2023-12-16T00:41:17.358 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-16T00:41:17.358 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.redhat.com/" 2023-12-16T00:41:17.358 INFO:teuthology.orchestra.run.smithi046.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-16T00:41:17.358 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:41:17.358 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-12-16T00:41:17.358 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:41:17.358 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-16T00:41:17.358 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-16T00:41:17.358 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-16T00:41:17.359 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-12-16T00:41:17.379 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2023-12-16T00:41:17.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-12-16T00:41:17.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:41:17.449 DEBUG:teuthology.orchestra.run.smithi181:> true 2023-12-16T00:41:17.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-12-16T00:41:17.514 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2023-12-16T00:41:17.575 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2023-12-16T00:41:17.575 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2023-12-16T00:41:17.635 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Red Hat Enterprise Linux" 2023-12-16T00:41:17.636 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8.6 (Ootpa)" 2023-12-16T00:41:17.636 INFO:teuthology.orchestra.run.smithi181.stdout:ID="rhel" 2023-12-16T00:41:17.636 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="fedora" 2023-12-16T00:41:17.636 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8.6" 2023-12-16T00:41:17.636 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:41:17.636 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-16T00:41:17.636 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2023-12-16T00:41:17.636 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-16T00:41:17.636 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.redhat.com/" 2023-12-16T00:41:17.636 INFO:teuthology.orchestra.run.smithi181.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-16T00:41:17.636 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:41:17.636 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-12-16T00:41:17.637 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:41:17.637 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-16T00:41:17.637 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-16T00:41:17.637 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-16T00:41:17.637 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-12-16T00:41:17.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:41:17.760 INFO:teuthology.dispatcher.supervisor:Running job 7493395 2023-12-16T00:41:17.760 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493395 --name yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493395/orig.config.yaml 2023-12-16T00:41:17.763 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493395 2023-12-16T00:41:17.763 INFO:teuthology.dispatcher.supervisor:Job PID: 2475646 2023-12-16T00:41:17.763 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-16T00:43:17.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:45:18.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:47:18.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:49:18.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:51:18.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:53:18.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:55:18.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:57:19.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:59:19.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:01:19.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:03:19.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:05:19.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:07:19.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:09:20.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:11:20.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:13:20.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:15:20.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:17:20.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:19:20.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:21:20.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:23:21.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:25:21.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:27:21.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:29:21.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:31:21.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:33:21.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:35:22.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:37:22.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:39:22.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:41:22.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:43:22.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:45:23.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:47:23.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:49:23.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:51:23.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:53:23.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:55:23.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:57:24.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:59:24.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:01:24.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:03:24.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:05:24.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:07:24.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:09:25.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:11:25.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:13:25.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:15:25.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:17:25.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:19:25.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:21:26.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:23:26.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:25:26.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:27:26.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:29:26.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:31:26.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:33:27.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:35:27.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:37:27.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:39:27.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:41:27.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:43:27.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:45:28.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:47:28.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:49:28.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:51:28.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:53:28.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:55:28.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:57:29.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:59:29.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:01:29.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:03:29.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:05:29.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:07:29.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:09:29.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:11:30.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:13:30.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:15:30.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:17:30.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:19:30.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:21:31.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:23:31.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:25:31.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:27:31.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:29:31.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:31:31.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:33:32.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:35:32.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:37:32.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:39:32.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:41:32.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:43:33.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:45:33.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:47:33.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:49:33.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:51:33.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:53:33.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:55:33.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:57:34.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:59:34.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:01:34.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:03:34.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:05:34.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:07:34.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:09:35.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:11:35.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:13:35.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:15:35.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:17:35.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:19:35.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:21:36.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:23:36.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:25:36.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:27:36.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:29:36.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:31:36.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:33:37.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:35:37.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:37:37.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:39:37.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:41:37.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:43:37.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:45:38.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:47:38.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:49:38.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:51:38.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:53:38.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:55:38.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:57:39.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:59:39.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:01:39.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:03:39.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:05:39.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:07:39.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:09:40.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:11:40.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:13:40.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:15:40.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:17:40.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:19:40.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:21:41.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:23:41.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:25:41.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:27:41.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:29:41.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:31:41.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:33:42.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:35:42.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:37:42.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:39:42.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:41:42.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:43:42.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:45:43.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:47:43.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:49:43.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:51:43.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:53:43.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:55:43.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:57:44.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:59:44.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:01:44.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:03:44.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:05:44.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:07:44.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:09:45.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:11:45.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:13:45.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:15:45.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:17:45.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:19:45.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:21:46.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:23:46.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:25:46.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:27:47.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:29:47.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:31:47.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:33:47.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:35:47.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:37:47.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:39:48.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:41:48.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:43:48.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:45:48.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:47:48.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:49:49.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:51:49.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:53:49.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:55:49.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:57:49.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:59:49.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:01:50.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:03:50.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:05:50.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:07:50.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:09:50.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:11:50.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:13:51.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:15:51.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:17:51.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:19:51.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:21:51.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:23:52.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:25:52.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:27:52.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:29:52.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:31:52.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:33:52.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:35:53.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:37:53.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:39:53.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:41:53.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:43:53.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:45:54.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:47:54.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:49:54.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:51:54.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:53:54.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:55:54.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:57:55.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:59:55.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:01:55.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:03:55.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:05:55.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:07:55.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:09:56.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:11:56.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:13:56.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:15:56.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:17:56.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:19:56.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:21:57.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:23:57.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:25:57.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:27:57.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:29:57.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:31:58.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:33:58.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:35:58.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:37:58.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:39:58.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:41:58.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:43:59.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:45:59.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:47:59.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:49:59.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:51:59.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:54:00.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:56:00.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:58:00.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:00:00.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:02:00.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:04:00.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:06:01.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:08:01.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:10:01.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:12:01.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:14:01.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:16:02.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:18:02.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:20:02.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:22:02.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:24:02.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:26:02.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:28:03.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:30:03.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:32:03.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:34:03.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:36:03.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:38:04.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:40:04.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:42:04.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:44:04.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:46:04.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:48:04.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:50:05.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:52:05.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:54:05.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:56:05.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:58:05.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:00:06.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:02:06.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:04:06.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:06:06.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:08:06.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:10:06.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:12:07.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:14:07.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:16:07.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:18:07.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:20:07.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:22:07.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:24:08.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:26:08.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:28:08.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:30:08.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:32:08.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:34:09.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:36:09.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:38:09.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:40:09.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:42:09.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:44:09.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:46:10.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:48:10.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:50:10.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:52:10.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:54:10.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:56:10.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:58:11.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:00:11.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:02:11.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:04:11.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:06:11.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:08:12.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:10:12.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:12:12.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:14:12.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:16:12.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:18:12.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:20:13.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:22:13.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:24:13.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:26:13.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:28:13.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:30:13.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:32:14.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:34:14.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:36:14.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:38:14.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:40:14.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:42:14.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:44:15.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:46:15.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:48:15.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:50:15.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:52:15.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:54:15.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:56:16.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:58:16.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:00:16.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:02:16.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:04:16.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:06:16.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:08:17.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:10:17.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:12:17.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:14:17.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:16:17.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:18:17.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:20:18.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:22:18.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:24:18.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:26:18.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:28:18.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:30:18.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:32:19.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:34:19.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:36:19.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:38:19.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:40:19.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:42:19.934 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-12-16T12:42:20.165 INFO:teuthology.kill:Killing Pids: {2475646} 2023-12-16T12:42:21.121 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2023-12-16T12:42:21.121 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2023-12-16T12:42:21.122 INFO:teuthology.misc:Compressing logs... 2023-12-16T12:42:21.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-12-16T12:42:21.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T12:42:21.203 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-12-16T12:42:21.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-12-16T12:42:21.281 DEBUG:teuthology.orchestra.run.smithi046:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T12:42:21.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-12-16T12:42:21.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T12:42:21.394 DEBUG:teuthology.orchestra.run.smithi181:> true 2023-12-16T12:42:21.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-12-16T12:42:21.470 DEBUG:teuthology.orchestra.run.smithi181:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T12:42:21.572 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493395/remote/smithi046/crash 2023-12-16T12:42:21.573 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T12:42:21.653 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493395/remote/smithi181/crash 2023-12-16T12:42:21.654 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T12:42:21.696 INFO:teuthology.misc:Compressing logs... 2023-12-16T12:42:21.697 DEBUG:teuthology.orchestra.run.smithi046:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T12:42:21.700 DEBUG:teuthology.orchestra.run.smithi181:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T12:42:21.733 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T12:42:21.733 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T12:42:21.734 INFO:teuthology.orchestra.run.smithi046.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 80.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-16T12:42:21.766 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T12:42:21.766 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T12:42:21.767 INFO:teuthology.orchestra.run.smithi181.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 82.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-16T12:42:21.897 INFO:teuthology.orchestra.run.smithi181.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2023-12-16T12:42:21.897 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-16T12:42:22.008 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2023-12-16T12:42:22.008 INFO:teuthology.orchestra.run.smithi046.stderr: 90.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-16T12:42:22.010 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493395/remote/smithi046/ 2023-12-16T12:42:22.011 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T12:42:22.132 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493395/remote/smithi181/ 2023-12-16T12:42:22.132 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T12:42:22.184 INFO:teuthology.misc:Compressing logs... 2023-12-16T12:42:22.185 DEBUG:teuthology.orchestra.run.smithi046:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T12:42:22.187 DEBUG:teuthology.orchestra.run.smithi181:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T12:42:22.218 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-16T12:42:22.219 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mon.a.log 2023-12-16T12:42:22.219 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.1.log /var/log/ceph/cephadm.log: 2023-12-16T12:42:22.220 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.3.log 2023-12-16T12:42:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mon.a.log: /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.1.log: /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.2.log 2023-12-16T12:42:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-16T12:42:22.229 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.2.log: /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.0.log 2023-12-16T12:42:22.240 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.0.log: 94.1% -- replaced with /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-16T12:42:22.240 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mon.c.log 2023-12-16T12:42:22.240 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mds.foo.smithi046.cbptnz.log 2023-12-16T12:42:22.241 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-16T12:42:22.242 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.5.log 2023-12-16T12:42:22.242 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.7.log 2023-12-16T12:42:22.242 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-16T12:42:22.242 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.5.log: /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mds.foo.smithi181.jjwhej.log 2023-12-16T12:42:22.243 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.6.log 2023-12-16T12:42:22.243 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mds.foo.smithi181.jjwhej.log: gzip -5 --verbose -- /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mon.b.log 2023-12-16T12:42:22.243 INFO:teuthology.orchestra.run.smithi181.stderr: 58.2% -- replaced with /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mds.foo.smithi181.jjwhej.log.gz 2023-12-16T12:42:22.243 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mgr.x.log 2023-12-16T12:42:22.248 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mon.b.log: /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.4.log 2023-12-16T12:42:22.252 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.4.log: 94.0% -- replaced with /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-16T12:42:22.261 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mds.foo.smithi046.cbptnz.log: 79.2% -- replaced with /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mds.foo.smithi046.cbptnz.log.gz 2023-12-16T12:42:22.261 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mgr.y.log 2023-12-16T12:42:22.338 INFO:teuthology.orchestra.run.smithi181.stderr: 94.3% -- replaced with /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mgr.x.log.gz 2023-12-16T12:42:22.357 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mgr.y.log: 93.7% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-16T12:42:22.366 INFO:teuthology.orchestra.run.smithi181.stderr: 93.8% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-16T12:42:29.507 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mgr.y.log: file size changed while zipping 2023-12-16T12:42:29.507 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mgr.y.log.gz 2023-12-16T12:42:30.305 INFO:teuthology.orchestra.run.smithi181.stderr:gzip: /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mon.b.log: file size changed while zipping 2023-12-16T12:42:30.305 INFO:teuthology.orchestra.run.smithi181.stderr: 92.1% -- replaced with /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mon.b.log.gz 2023-12-16T12:42:31.958 INFO:teuthology.orchestra.run.smithi181.stderr:gzip: /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.6.log: file size changed while zipping 2023-12-16T12:42:31.958 INFO:teuthology.orchestra.run.smithi181.stderr: 92.8% -- replaced with /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.6.log.gz 2023-12-16T12:42:33.606 INFO:teuthology.orchestra.run.smithi181.stderr:gzip: /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.4.log: file size changed while zipping 2023-12-16T12:42:33.607 INFO:teuthology.orchestra.run.smithi181.stderr: 93.5% -- replaced with /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.4.log.gz 2023-12-16T12:42:34.082 INFO:teuthology.orchestra.run.smithi181.stderr:gzip: /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.5.log: file size changed while zipping 2023-12-16T12:42:34.082 INFO:teuthology.orchestra.run.smithi181.stderr: 92.8% -- replaced with /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.5.log.gz 2023-12-16T12:42:34.164 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.2.log: file size changed while zipping 2023-12-16T12:42:34.164 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.2.log.gz 2023-12-16T12:42:34.965 INFO:teuthology.orchestra.run.smithi181.stderr:gzip: /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.7.log: file size changed while zipping 2023-12-16T12:42:34.965 INFO:teuthology.orchestra.run.smithi181.stderr: 93.2% -- replaced with /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.7.log.gz 2023-12-16T12:42:35.909 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mon.c.log: file size changed while zipping 2023-12-16T12:42:35.909 INFO:teuthology.orchestra.run.smithi046.stderr: 91.4% -- replaced with /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mon.c.log.gz 2023-12-16T12:42:36.254 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.0.log: file size changed while zipping 2023-12-16T12:42:36.254 INFO:teuthology.orchestra.run.smithi046.stderr: 93.1% -- replaced with /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.0.log.gz 2023-12-16T12:42:37.372 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.1.log: file size changed while zipping 2023-12-16T12:42:37.372 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.1.log.gz 2023-12-16T12:42:38.140 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.3.log: file size changed while zipping 2023-12-16T12:42:38.140 INFO:teuthology.orchestra.run.smithi046.stderr: 93.4% -- replaced with /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-osd.3.log.gz 2023-12-16T12:42:50.439 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mon.a.log: file size changed while zipping 2023-12-16T12:42:50.439 INFO:teuthology.orchestra.run.smithi046.stderr: 89.7% -- replaced with /var/log/ceph/967305d0-9bad-11ee-95a5-87774f69a715/ceph-mon.a.log.gz 2023-12-16T12:42:50.441 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493395/remote/smithi046/log 2023-12-16T12:42:50.442 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T12:43:03.710 INFO:teuthology.orchestra.run.smithi046.stderr:tar: .: file changed as we read it 2023-12-16T12:43:03.713 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493395/remote/smithi181/log 2023-12-16T12:43:03.714 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T12:43:11.408 INFO:teuthology.kill:No teuthology processes running 2023-12-16T12:43:11.408 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 331, in run_with_watchdog kill.kill_job( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/kill.py", line 89, in kill_job if kill_processes(run_name, [job_info.get('pid')]): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/kill.py", line 210, in kill_processes if survivors: UnboundLocalError: local variable 'survivors' referenced before assignment 2023-12-16T12:43:11.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:45:11.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:45:11.636 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-12-16T12:45:11.756 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-16T12:45:11.756 INFO:teuthology.nuke:Checking targets against current locks 2023-12-16T12:45:11.798 DEBUG:teuthology.nuke:shortname: smithi046 2023-12-16T12:45:11.798 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T12:45:11.824 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493395', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 00:36:14.727132', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN2NJXRFR8L5Z5g+TjC07j33Y8H4Vsuvm1iiJRYC4nU9M96YeoSyH71jxMu1f+OpgsfqKb6qcpiwxu9xR0HfDWw='} 2023-12-16T12:45:11.827 DEBUG:teuthology.nuke:shortname: smithi181 2023-12-16T12:45:11.827 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T12:45:11.850 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493395', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 00:36:14.728711', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNfn7sIgE5Bh5B5diowH8uZBN7qlaZP9ecrS4vkRj6cfoGr6xeAVO12chYdkkxAblbTvKo1xVZY0PpJQJO43vG8='} 2023-12-16T12:45:11.881 INFO:teuthology.orchestra.console.smithi046:Power off 2023-12-16T12:45:11.881 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T12:45:11.909 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2023-12-16T12:45:11.909 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T12:45:11.922 INFO:teuthology.orchestra.console.smithi181:Power off 2023-12-16T12:45:11.922 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T12:45:11.931 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-12-16T12:45:11.942 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2023-12-16T12:45:11.942 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T12:45:11.965 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-12-16T12:45:15.935 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T12:45:15.965 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T12:45:16.044 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-12-16T12:45:16.073 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-12-16T12:45:20.050 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T12:45:20.075 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T12:45:20.158 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-12-16T12:45:20.182 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-12-16T12:45:20.260 INFO:teuthology.orchestra.console.smithi046:Power off completed 2023-12-16T12:45:20.418 INFO:teuthology.lock.ops:unlocked: smithi046.front.sepia.ceph.com 2023-12-16T12:45:24.185 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T12:45:24.294 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-12-16T12:45:24.395 INFO:teuthology.orchestra.console.smithi181:Power off completed 2023-12-16T12:45:24.542 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com