2023-12-01T04:15:24.721 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-01T04:15:24.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:15:24.874 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc396717ee0>, signals=[15]) 2023-12-01T04:15:24.875 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging 2023-12-01T04:15:24.875 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server 2023-12-01T04:15:24.875 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-12-01T04:15:24.902 INFO:teuthology.lock.ops:Start node 'smithi135.front.sepia.ceph.com' reimaging 2023-12-01T04:15:24.903 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: reset os type and version on server 2023-12-01T04:15:24.903 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-12-01T04:15:25.054 DEBUG:teuthology.provision.fog.smithi135:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-01T04:15:25.057 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-01T04:15:25.100 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of rhel 8.6 2023-12-01T04:15:25.107 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of rhel 8.6 2023-12-01T04:15:25.361 INFO:teuthology.orchestra.console.smithi135:Power off 2023-12-01T04:15:25.361 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T04:15:25.384 INFO:teuthology.orchestra.console.smithi046:Power off 2023-12-01T04:15:25.384 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T04:15:25.396 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-12-01T04:15:25.397 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T04:15:25.411 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2023-12-01T04:15:25.411 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T04:15:25.431 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-12-01T04:15:25.445 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-12-01T04:15:29.434 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T04:15:29.446 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T04:15:29.547 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-12-01T04:15:29.559 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-12-01T04:15:33.550 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T04:15:33.560 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T04:15:33.660 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-12-01T04:15:33.670 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-12-01T04:15:33.771 INFO:teuthology.orchestra.console.smithi046:Power off completed 2023-12-01T04:15:33.872 INFO:teuthology.orchestra.console.smithi046:Power on 2023-12-01T04:15:33.872 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-01T04:15:33.897 DEBUG:teuthology.orchestra.console.smithi046:power on output: Chassis Power Control: Up/On 2023-12-01T04:15:33.897 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T04:15:33.925 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-12-01T04:15:37.662 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T04:15:37.771 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-12-01T04:15:37.872 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-12-01T04:15:37.926 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T04:15:37.972 INFO:teuthology.orchestra.console.smithi135:Power on 2023-12-01T04:15:37.973 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-01T04:15:37.994 DEBUG:teuthology.orchestra.console.smithi135:power on output: Chassis Power Control: Up/On 2023-12-01T04:15:37.994 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T04:15:38.021 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-12-01T04:15:38.035 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-12-01T04:15:42.026 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T04:15:42.036 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T04:15:42.138 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-12-01T04:15:42.148 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-12-01T04:15:42.240 INFO:teuthology.orchestra.console.smithi135:Power on completed 2023-12-01T04:15:42.249 INFO:teuthology.orchestra.console.smithi046:Power on completed 2023-12-01T04:15:42.341 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish 2023-12-01T04:15:42.351 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish 2023-12-01T04:18:28.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T04:18:28.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T04:18:31.650 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-12-01T04:18:31.651 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-12-01T04:18:37.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T04:18:37.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T04:18:40.706 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-12-01T04:18:40.706 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-12-01T04:18:46.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T04:18:46.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T04:18:49.762 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-12-01T04:18:49.794 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-12-01T04:18:55.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T04:18:55.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T04:18:58.850 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-12-01T04:18:58.851 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-12-01T04:19:04.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T04:19:04.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T04:19:07.942 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-12-01T04:19:07.942 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-12-01T04:19:13.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T04:19:13.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T04:19:17.030 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-12-01T04:19:17.030 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-12-01T04:19:23.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T04:19:23.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T04:19:54.920 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-01T04:19:54.920 DEBUG:teuthology.orchestra.run.smithi135:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-01T04:19:55.228 INFO:teuthology.provision.fog.smithi135:Node is ready 2023-12-01T04:19:55.228 DEBUG:teuthology.orchestra.run.smithi135:> hostname 2023-12-01T04:19:55.244 INFO:teuthology.orchestra.run.smithi135.stdout:smithi022 2023-12-01T04:19:55.244 DEBUG:teuthology.orchestra.run.smithi135:> grep smithi022 /etc/hosts 2023-12-01T04:19:55.301 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-12-01T04:19:55.301 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-12-01T04:19:55.405 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi022/smithi135/g' /etc/hosts 2023-12-01T04:19:55.433 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/172.21.15.22/172.21.15.135/g' /etc/hosts 2023-12-01T04:19:55.500 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi022/smithi135/g' /etc/hostname 2023-12-01T04:19:55.568 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-12-01T04:19:55.635 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-12-01T04:19:55.691 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T04:19:55.692 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T04:19:55.692 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel" 2023-12-01T04:19:55.692 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora" 2023-12-01T04:19:55.693 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.6" 2023-12-01T04:19:55.693 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-12-01T04:19:55.693 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T04:19:55.693 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-12-01T04:19:55.693 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T04:19:55.693 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T04:19:55.693 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T04:19:55.693 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T04:19:55.693 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-12-01T04:19:55.693 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T04:19:55.693 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T04:19:55.693 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T04:19:55.693 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T04:19:55.694 INFO:teuthology.provision.fog.smithi135:Deploy complete! 2023-12-01T04:19:55.771 DEBUG:teuthology.parallel:result is None 2023-12-01T04:20:23.062 WARNING:teuthology.provision.fog.smithi046:timed out 2023-12-01T04:20:29.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T04:20:29.480 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-01T04:20:29.480 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-01T04:20:29.799 INFO:teuthology.provision.fog.smithi046:Node is ready 2023-12-01T04:20:29.799 DEBUG:teuthology.orchestra.run.smithi046:> hostname 2023-12-01T04:20:29.819 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com 2023-12-01T04:20:29.820 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts 2023-12-01T04:20:29.879 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2023-12-01T04:20:29.879 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2023-12-01T04:20:29.996 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts 2023-12-01T04:20:30.026 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts 2023-12-01T04:20:30.095 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname 2023-12-01T04:20:30.164 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2023-12-01T04:20:30.232 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-12-01T04:20:30.289 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T04:20:30.289 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T04:20:30.289 INFO:teuthology.orchestra.run.smithi046.stdout:ID="rhel" 2023-12-01T04:20:30.289 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="fedora" 2023-12-01T04:20:30.290 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8.6" 2023-12-01T04:20:30.290 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2023-12-01T04:20:30.290 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T04:20:30.290 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2023-12-01T04:20:30.290 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T04:20:30.290 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T04:20:30.290 INFO:teuthology.orchestra.run.smithi046.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T04:20:30.290 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T04:20:30.290 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-12-01T04:20:30.290 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T04:20:30.290 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T04:20:30.290 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T04:20:30.291 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T04:20:30.291 INFO:teuthology.provision.fog.smithi046:Deploy complete! 2023-12-01T04:20:30.292 DEBUG:teuthology.parallel:result is None 2023-12-01T04:20:30.447 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com 2023-12-01T04:20:30.449 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-01T04:20:30.471 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com 2023-12-01T04:20:30.471 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-01T04:20:30.497 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server 2023-12-01T04:20:30.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-12-01T04:20:30.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T04:20:30.565 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-12-01T04:20:30.631 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-12-01T04:20:30.631 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2023-12-01T04:20:30.688 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2023-12-01T04:20:30.689 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-12-01T04:20:30.745 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T04:20:30.745 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T04:20:30.745 INFO:teuthology.orchestra.run.smithi046.stdout:ID="rhel" 2023-12-01T04:20:30.745 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="fedora" 2023-12-01T04:20:30.745 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8.6" 2023-12-01T04:20:30.745 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2023-12-01T04:20:30.745 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T04:20:30.745 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2023-12-01T04:20:30.746 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T04:20:30.746 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T04:20:30.746 INFO:teuthology.orchestra.run.smithi046.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T04:20:30.746 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T04:20:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-12-01T04:20:30.746 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T04:20:30.746 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T04:20:30.746 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T04:20:30.746 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T04:20:30.747 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-12-01T04:20:30.771 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server 2023-12-01T04:20:30.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-12-01T04:20:30.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T04:20:30.839 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-12-01T04:20:30.929 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-12-01T04:20:30.930 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2023-12-01T04:20:30.986 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2023-12-01T04:20:30.987 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-12-01T04:20:31.043 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T04:20:31.044 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T04:20:31.044 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel" 2023-12-01T04:20:31.044 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora" 2023-12-01T04:20:31.044 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.6" 2023-12-01T04:20:31.044 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-12-01T04:20:31.044 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T04:20:31.044 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-12-01T04:20:31.044 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T04:20:31.044 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T04:20:31.044 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T04:20:31.044 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T04:20:31.044 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-12-01T04:20:31.045 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T04:20:31.045 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T04:20:31.045 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T04:20:31.045 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T04:20:31.045 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-12-01T04:20:31.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:20:31.153 INFO:teuthology.dispatcher.supervisor:Running job 7473620 2023-12-01T04:20:31.153 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-01_04:14:53-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473620 --name yuriw-2023-12-01_04:14:53-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} -- /home/teuthworker/archive/yuriw-2023-12-01_04:14:53-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473620/orig.config.yaml 2023-12-01T04:20:31.156 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-01_04:14:53-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473620 2023-12-01T04:20:31.157 INFO:teuthology.dispatcher.supervisor:Job PID: 962866 2023-12-01T04:20:31.157 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-01T04:22:31.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:24:31.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:26:31.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:28:31.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:30:31.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:32:32.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:34:32.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:36:32.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:38:32.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:40:33.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:42:33.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:44:33.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:46:33.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:48:33.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:50:34.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:52:34.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:54:34.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:56:34.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T04:58:34.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:00:34.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:02:35.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:04:35.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:06:35.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:08:35.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:10:35.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:12:35.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:14:36.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:16:36.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:18:36.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:20:36.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:22:36.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:24:36.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:26:37.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:28:37.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:30:37.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:32:37.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:34:37.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:36:37.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:38:38.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:40:38.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:42:38.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:44:38.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:46:38.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:48:38.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:50:39.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:52:39.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:54:39.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:56:39.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T05:58:39.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:00:40.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:02:40.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:04:40.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:06:40.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:08:40.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:10:40.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:12:41.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:14:41.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:16:41.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:18:41.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:20:41.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:22:41.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:24:42.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:26:42.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:28:42.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:30:42.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:32:42.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:34:42.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:36:43.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:38:43.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:40:43.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:42:43.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:44:43.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:46:44.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:48:44.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:50:44.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:52:44.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:54:44.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:56:44.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T06:58:45.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:00:45.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:02:45.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:04:45.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:06:45.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:08:45.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:10:46.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:12:46.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:14:46.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:16:46.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:18:46.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:20:46.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:22:47.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:24:47.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:26:47.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:28:47.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:30:47.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:32:47.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:34:48.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:36:48.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:38:48.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:40:48.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:42:48.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:44:48.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:46:48.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:48:49.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:50:49.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:52:49.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:54:49.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:56:49.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T07:58:49.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:00:49.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:02:50.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:04:50.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:06:50.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:08:50.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:10:50.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:12:50.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:14:50.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:16:51.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:18:51.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:20:51.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:22:51.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:24:51.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:26:51.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:28:52.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:30:52.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:32:52.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:34:52.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:36:52.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:38:52.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:40:52.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:42:53.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:44:53.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:46:53.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:48:53.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:50:53.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:52:53.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:54:54.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:56:54.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T08:58:54.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:00:54.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:02:54.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:04:54.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:06:55.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:08:55.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:10:55.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:12:55.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:14:55.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:16:56.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:18:56.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:20:56.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:22:56.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:24:56.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:26:57.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:28:57.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:30:57.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:32:57.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:34:57.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:36:58.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:38:58.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:40:58.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:42:58.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:44:58.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:46:58.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:48:59.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:50:59.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:52:59.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:54:59.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:56:59.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T09:59:00.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:01:00.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:03:00.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:05:00.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:07:00.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:09:00.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:11:01.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:13:01.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:15:01.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:17:01.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:19:01.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:21:01.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:23:02.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:25:02.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:27:02.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:29:02.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:31:02.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:33:02.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:35:03.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:37:03.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:39:03.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:41:03.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:43:03.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:45:03.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:47:03.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:49:04.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:51:04.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:53:04.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:55:04.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:57:04.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T10:59:04.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:01:04.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:03:05.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:05:05.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:07:05.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:09:05.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:11:05.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:13:05.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:15:05.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:17:06.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:19:06.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:21:06.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:23:06.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:25:06.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:27:06.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:29:07.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:31:07.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:33:07.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:35:07.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:37:07.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:39:07.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:41:07.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:43:08.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:45:08.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:47:08.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:49:08.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:51:08.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:53:08.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:55:08.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:57:09.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T11:59:09.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:01:09.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:03:09.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:05:09.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:07:09.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:09:10.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:11:10.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:13:10.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:15:10.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:17:10.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:19:10.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:21:10.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:23:11.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:25:11.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:27:11.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:29:11.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:31:11.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:33:11.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:35:12.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:37:12.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:39:12.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:41:12.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:43:12.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:45:12.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:47:13.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:49:13.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:51:13.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:53:13.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:55:13.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:57:13.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T12:59:14.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:01:14.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:03:14.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:05:14.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:07:14.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:09:14.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:11:14.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:13:15.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:15:15.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:17:15.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:19:15.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:21:15.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:23:15.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:25:16.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:27:16.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:29:16.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:31:16.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:33:16.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:35:16.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:37:17.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:39:17.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:41:17.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:43:17.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:45:17.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:47:17.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:49:18.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:51:18.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:53:18.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:55:18.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:57:18.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T13:59:18.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:01:18.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:03:19.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:05:19.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:07:19.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:09:19.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:11:19.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:13:19.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:15:19.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:17:19.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:19:20.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:21:20.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:23:20.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:25:20.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:27:20.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:29:20.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:31:21.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:33:21.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:35:21.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:37:21.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:39:21.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:41:22.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:43:22.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:45:22.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:47:22.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:49:22.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:51:22.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:53:22.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:55:23.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:57:23.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T14:59:23.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:01:23.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:03:23.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:05:23.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:07:24.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:09:24.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:11:24.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:13:24.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:15:24.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:17:24.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:19:25.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:21:25.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:23:25.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:25:25.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:27:25.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:29:25.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:31:26.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:33:26.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:35:26.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:37:26.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:39:26.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:41:26.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:43:27.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:45:27.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:47:27.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:49:27.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:51:27.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:53:27.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:55:28.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:57:28.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:59:28.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:01:28.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:03:28.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:05:28.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:07:29.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:09:29.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:11:29.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:13:29.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:15:29.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:17:29.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:19:30.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:21:30.299 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-12-01T16:21:30.432 INFO:teuthology.kill:Killing Pids: {962866} 2023-12-01T16:21:31.514 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2023-12-01T16:21:31.515 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2023-12-01T16:21:31.515 INFO:teuthology.misc:Compressing logs... 2023-12-01T16:21:31.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-12-01T16:21:31.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T16:21:31.587 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-12-01T16:21:31.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-12-01T16:21:31.659 DEBUG:teuthology.orchestra.run.smithi046:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-01T16:21:31.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-12-01T16:21:31.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T16:21:31.772 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-12-01T16:21:31.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-12-01T16:21:31.803 DEBUG:teuthology.orchestra.run.smithi135:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-01T16:21:31.902 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-01_04:14:53-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473620/remote/smithi046/crash 2023-12-01T16:21:31.903 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-01T16:21:31.943 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-01_04:14:53-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473620/remote/smithi135/crash 2023-12-01T16:21:31.944 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-01T16:21:31.991 INFO:teuthology.misc:Compressing logs... 2023-12-01T16:21:31.992 DEBUG:teuthology.orchestra.run.smithi046:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-01T16:21:31.995 DEBUG:teuthology.orchestra.run.smithi135:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-01T16:21:32.023 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-01T16:21:32.023 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-01T16:21:32.023 INFO:teuthology.orchestra.run.smithi135.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 79.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-01T16:21:32.024 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-01T16:21:32.024 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-01T16:21:32.025 INFO:teuthology.orchestra.run.smithi046.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 77.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-01T16:21:32.104 INFO:teuthology.orchestra.run.smithi135.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 90.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-01T16:21:32.175 INFO:teuthology.orchestra.run.smithi046.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 92.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-01T16:21:32.177 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-01_04:14:53-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473620/remote/smithi046/ 2023-12-01T16:21:32.178 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-01T16:21:32.275 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-01_04:14:53-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473620/remote/smithi135/ 2023-12-01T16:21:32.276 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-01T16:21:32.323 INFO:teuthology.misc:Compressing logs... 2023-12-01T16:21:32.323 DEBUG:teuthology.orchestra.run.smithi046:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-01T16:21:32.326 DEBUG:teuthology.orchestra.run.smithi135:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-01T16:21:32.354 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-01T16:21:32.354 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.2.log 2023-12-01T16:21:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.0.log 2023-12-01T16:21:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.3.log 2023-12-01T16:21:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mds.foo.smithi046.nwzqfc.log 2023-12-01T16:21:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.0.log: /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.1.log 2023-12-01T16:21:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mds.foo.smithi046.nwzqfc.log: gzip -5 --verbose -- /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mon.c.log 2023-12-01T16:21:32.355 INFO:teuthology.orchestra.run.smithi046.stderr: 80.0% -- replaced with /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mds.foo.smithi046.nwzqfc.log.gz 2023-12-01T16:21:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.1.log: /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-01T16:21:32.359 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-volume.log: 92.7% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-01T16:21:32.359 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mon.a.log 2023-12-01T16:21:32.364 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mgr.y.log 2023-12-01T16:21:32.378 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mgr.y.log: 91.6% -- replaced with /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-01T16:21:32.383 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-01T16:21:32.383 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.5.log 2023-12-01T16:21:32.384 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.6.log 2023-12-01T16:21:32.384 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mds.foo.smithi135.tahiem.log 2023-12-01T16:21:32.385 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.5.log: /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.4.log 2023-12-01T16:21:32.385 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mgr.x.log 2023-12-01T16:21:32.385 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mds.foo.smithi135.tahiem.log: 61.9% -- replaced with /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mds.foo.smithi135.tahiem.log.gz 2023-12-01T16:21:32.385 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-01T16:21:32.389 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mgr.x.log: /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-volume.log: 89.9% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-01T16:21:32.396 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.7.log 2023-12-01T16:21:32.396 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mon.b.log 2023-12-01T16:21:32.406 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.7.log: /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mon.b.log: 91.6% -- replaced with /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-01T16:21:32.515 INFO:teuthology.orchestra.run.smithi135.stderr: 94.4% -- replaced with /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mgr.x.log.gz 2023-12-01T16:21:39.316 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mgr.y.log: file size changed while zipping 2023-12-01T16:21:39.316 INFO:teuthology.orchestra.run.smithi046.stderr: 89.5% -- replaced with /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mgr.y.log.gz 2023-12-01T16:21:40.158 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mon.b.log: file size changed while zipping 2023-12-01T16:21:40.159 INFO:teuthology.orchestra.run.smithi135.stderr: 91.6% -- replaced with /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mon.b.log.gz 2023-12-01T16:21:43.100 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.6.log: file size changed while zipping 2023-12-01T16:21:43.101 INFO:teuthology.orchestra.run.smithi135.stderr: 93.0% -- replaced with /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.6.log.gz 2023-12-01T16:21:45.262 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.2.log: file size changed while zipping 2023-12-01T16:21:45.262 INFO:teuthology.orchestra.run.smithi046.stderr: 92.5% -- replaced with /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.2.log.gz 2023-12-01T16:21:45.975 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.4.log: file size changed while zipping 2023-12-01T16:21:45.975 INFO:teuthology.orchestra.run.smithi135.stderr: 93.5% -- replaced with /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.4.log.gz 2023-12-01T16:21:46.143 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mon.c.log: file size changed while zipping 2023-12-01T16:21:46.143 INFO:teuthology.orchestra.run.smithi046.stderr: 91.3% -- replaced with /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mon.c.log.gz 2023-12-01T16:21:46.249 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.5.log: file size changed while zipping 2023-12-01T16:21:46.250 INFO:teuthology.orchestra.run.smithi135.stderr: 92.9% -- replaced with /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.5.log.gz 2023-12-01T16:21:47.206 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.7.log: file size changed while zipping 2023-12-01T16:21:47.206 INFO:teuthology.orchestra.run.smithi135.stderr: 93.1% -- replaced with /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.7.log.gz 2023-12-01T16:21:47.878 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.1.log: file size changed while zipping 2023-12-01T16:21:47.879 INFO:teuthology.orchestra.run.smithi046.stderr: 93.3% -- replaced with /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.1.log.gz 2023-12-01T16:21:48.998 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.3.log: file size changed while zipping 2023-12-01T16:21:48.998 INFO:teuthology.orchestra.run.smithi046.stderr: 93.3% -- replaced with /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.3.log.gz 2023-12-01T16:21:49.295 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.0.log: file size changed while zipping 2023-12-01T16:21:49.295 INFO:teuthology.orchestra.run.smithi046.stderr: 93.1% -- replaced with /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-osd.0.log.gz 2023-12-01T16:21:59.902 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mon.a.log: file size changed while zipping 2023-12-01T16:21:59.902 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/74f7eee4-9003-11ee-95a2-87774f69a715/ceph-mon.a.log.gz 2023-12-01T16:21:59.904 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-01_04:14:53-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473620/remote/smithi046/log 2023-12-01T16:21:59.905 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-01T16:22:13.976 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-01_04:14:53-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473620/remote/smithi135/log 2023-12-01T16:22:13.977 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-01T16:22:23.378 INFO:teuthology.kill:No teuthology processes running 2023-12-01T16:22:23.378 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 331, in run_with_watchdog kill.kill_job( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/kill.py", line 89, in kill_job if kill_processes(run_name, [job_info.get('pid')]): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/kill.py", line 210, in kill_processes if survivors: UnboundLocalError: local variable 'survivors' referenced before assignment 2023-12-01T16:22:23.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:24:23.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:24:23.624 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-12-01T16:24:23.745 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-01T16:24:23.745 INFO:teuthology.nuke:Checking targets against current locks 2023-12-01T16:24:23.795 DEBUG:teuthology.nuke:shortname: smithi046 2023-12-01T16:24:23.795 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T16:24:23.815 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_04:14:53-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473620', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 04:15:23.776740', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-01T16:24:23.819 DEBUG:teuthology.nuke:shortname: smithi135 2023-12-01T16:24:23.819 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T16:24:23.839 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_04:14:53-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473620', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 04:15:23.775470', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-01T16:24:23.869 INFO:teuthology.orchestra.console.smithi046:Power off 2023-12-01T16:24:23.870 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T16:24:23.886 INFO:teuthology.orchestra.console.smithi135:Power off 2023-12-01T16:24:23.886 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T16:24:23.895 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2023-12-01T16:24:23.896 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:24:23.909 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-12-01T16:24:23.910 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:24:23.921 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-12-01T16:24:23.934 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-12-01T16:24:27.926 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:24:27.938 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:24:28.036 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-12-01T16:24:28.048 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-12-01T16:24:32.038 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:24:32.050 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:24:32.148 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-12-01T16:24:32.163 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-12-01T16:24:32.251 INFO:teuthology.orchestra.console.smithi046:Power off completed 2023-12-01T16:24:32.407 INFO:teuthology.lock.ops:unlocked: smithi046.front.sepia.ceph.com 2023-12-01T16:24:36.166 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:24:36.280 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-12-01T16:24:36.381 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-12-01T16:24:36.538 INFO:teuthology.lock.ops:unlocked: smithi135.front.sepia.ceph.com