2023-12-01T15:10:05.152 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-01T15:10:05.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:10:05.277 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f20b2598f70>, signals=[15]) 2023-12-01T15:10:05.277 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging 2023-12-01T15:10:05.278 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server 2023-12-01T15:10:05.278 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-12-01T15:10:05.302 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2023-12-01T15:10:05.302 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2023-12-01T15:10:05.302 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-12-01T15:10:05.416 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-01T15:10:05.429 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-01T15:10:05.461 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of rhel 8.6 2023-12-01T15:10:05.477 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of rhel 8.6 2023-12-01T15:10:05.694 INFO:teuthology.orchestra.console.smithi027:Power off 2023-12-01T15:10:05.695 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T15:10:05.705 INFO:teuthology.orchestra.console.smithi145:Power off 2023-12-01T15:10:05.706 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T15:10:05.715 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-12-01T15:10:05.715 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:05.725 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off 2023-12-01T15:10:05.726 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:05.737 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-12-01T15:10:05.762 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2023-12-01T15:10:09.742 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:09.763 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:09.853 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-12-01T15:10:09.871 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2023-12-01T15:10:13.858 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:13.872 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:13.967 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-12-01T15:10:13.980 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-12-01T15:10:14.080 INFO:teuthology.orchestra.console.smithi145:Power off completed 2023-12-01T15:10:14.181 INFO:teuthology.orchestra.console.smithi145:Power on 2023-12-01T15:10:14.181 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-01T15:10:14.199 DEBUG:teuthology.orchestra.console.smithi145:power on output: Chassis Power Control: Up/On 2023-12-01T15:10:14.199 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:14.221 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-12-01T15:10:17.972 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:18.079 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-12-01T15:10:18.179 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-12-01T15:10:18.222 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:18.281 INFO:teuthology.orchestra.console.smithi027:Power on 2023-12-01T15:10:18.281 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-01T15:10:18.301 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On 2023-12-01T15:10:18.301 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:18.321 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-12-01T15:10:18.328 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-12-01T15:10:22.327 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:22.332 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:22.435 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-12-01T15:10:22.439 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2023-12-01T15:10:22.540 INFO:teuthology.orchestra.console.smithi145:Power on completed 2023-12-01T15:10:22.640 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2023-12-01T15:10:26.439 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T15:10:26.548 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-12-01T15:10:26.649 INFO:teuthology.orchestra.console.smithi027:Power on completed 2023-12-01T15:10:26.750 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish 2023-12-01T15:13:09.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:12.706 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-12-01T15:13:18.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:21.794 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-12-01T15:13:27.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:30.882 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-12-01T15:13:36.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:39.971 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-12-01T15:13:45.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:49.026 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-12-01T15:13:55.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:59.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:13:59.663 ERROR:teuthology.orchestra.connection:Error authenticating with smithi027.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-01T15:14:13.474 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-12-01T15:14:19.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:14:22.530 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-12-01T15:14:28.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:14:31.586 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-12-01T15:14:37.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:14:37.934 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-01T15:14:37.935 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-01T15:14:38.225 INFO:teuthology.provision.fog.smithi145:Node is ready 2023-12-01T15:14:38.225 DEBUG:teuthology.orchestra.run.smithi145:> hostname 2023-12-01T15:14:38.241 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com 2023-12-01T15:14:38.241 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145.front.sepia.ceph.com /etc/hosts 2023-12-01T15:14:38.296 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2023-12-01T15:14:38.297 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-12-01T15:14:38.405 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hosts 2023-12-01T15:14:38.431 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts 2023-12-01T15:14:38.498 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hostname 2023-12-01T15:14:38.564 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-12-01T15:14:38.630 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-12-01T15:14:38.685 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T15:14:38.685 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T15:14:38.686 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel" 2023-12-01T15:14:38.686 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora" 2023-12-01T15:14:38.686 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.6" 2023-12-01T15:14:38.686 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-12-01T15:14:38.686 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T15:14:38.686 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-12-01T15:14:38.686 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T15:14:38.686 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T15:14:38.686 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T15:14:38.686 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T15:14:38.686 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-12-01T15:14:38.686 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T15:14:38.686 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T15:14:38.687 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T15:14:38.687 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T15:14:38.687 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2023-12-01T15:14:38.688 DEBUG:teuthology.parallel:result is None 2023-12-01T15:15:03.667 WARNING:teuthology.provision.fog.smithi027:timed out 2023-12-01T15:15:09.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:15:28.226 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-01T15:15:34.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:15:37.282 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-01T15:15:43.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:16:43.286 WARNING:teuthology.provision.fog.smithi027:timed out 2023-12-01T15:16:49.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:16:49.617 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-01T15:16:49.617 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-01T15:16:49.921 INFO:teuthology.provision.fog.smithi027:Node is ready 2023-12-01T15:16:49.922 DEBUG:teuthology.orchestra.run.smithi027:> hostname 2023-12-01T15:16:49.939 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com 2023-12-01T15:16:49.940 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts 2023-12-01T15:16:49.997 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027 2023-12-01T15:16:49.998 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2023-12-01T15:16:50.110 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts 2023-12-01T15:16:50.139 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts 2023-12-01T15:16:50.208 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname 2023-12-01T15:16:50.276 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2023-12-01T15:16:50.343 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-12-01T15:16:50.400 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T15:16:50.400 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T15:16:50.400 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel" 2023-12-01T15:16:50.400 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora" 2023-12-01T15:16:50.400 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.6" 2023-12-01T15:16:50.400 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2023-12-01T15:16:50.400 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T15:16:50.401 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2023-12-01T15:16:50.401 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T15:16:50.401 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T15:16:50.401 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T15:16:50.401 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T15:16:50.401 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-12-01T15:16:50.401 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T15:16:50.401 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T15:16:50.401 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T15:16:50.401 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T15:16:50.401 INFO:teuthology.provision.fog.smithi027:Deploy complete! 2023-12-01T15:16:50.402 DEBUG:teuthology.parallel:result is None 2023-12-01T15:16:50.549 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com 2023-12-01T15:16:50.549 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-01T15:16:50.570 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2023-12-01T15:16:50.571 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-01T15:16:50.588 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server 2023-12-01T15:16:50.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-12-01T15:16:50.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:16:50.654 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-12-01T15:16:50.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-12-01T15:16:50.678 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2023-12-01T15:16:50.733 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2023-12-01T15:16:50.733 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-12-01T15:16:50.789 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T15:16:50.790 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T15:16:50.790 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel" 2023-12-01T15:16:50.790 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora" 2023-12-01T15:16:50.790 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.6" 2023-12-01T15:16:50.790 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2023-12-01T15:16:50.790 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T15:16:50.790 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2023-12-01T15:16:50.790 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T15:16:50.790 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T15:16:50.790 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T15:16:50.791 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T15:16:50.791 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-12-01T15:16:50.791 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T15:16:50.791 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T15:16:50.791 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T15:16:50.791 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T15:16:50.791 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-12-01T15:16:50.812 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2023-12-01T15:16:50.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-12-01T15:16:50.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T15:16:50.879 DEBUG:teuthology.orchestra.run.smithi145:> true 2023-12-01T15:16:51.016 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-12-01T15:16:51.016 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2023-12-01T15:16:51.073 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2023-12-01T15:16:51.073 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-12-01T15:16:51.130 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T15:16:51.131 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T15:16:51.131 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel" 2023-12-01T15:16:51.131 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora" 2023-12-01T15:16:51.131 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.6" 2023-12-01T15:16:51.131 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-12-01T15:16:51.131 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T15:16:51.131 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-12-01T15:16:51.131 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T15:16:51.131 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T15:16:51.131 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T15:16:51.132 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T15:16:51.132 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-12-01T15:16:51.132 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T15:16:51.132 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T15:16:51.132 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T15:16:51.132 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T15:16:51.132 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-12-01T15:16:51.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:16:51.247 INFO:teuthology.dispatcher.supervisor:Running job 7473644 2023-12-01T15:16:51.247 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473644 --name yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473644/orig.config.yaml 2023-12-01T15:16:51.250 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473644 2023-12-01T15:16:51.250 INFO:teuthology.dispatcher.supervisor:Job PID: 847396 2023-12-01T15:16:51.250 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-01T15:18:51.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:20:51.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:22:51.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:24:51.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:26:51.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:28:51.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:30:51.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:32:51.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:34:51.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:36:51.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:38:51.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:40:52.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:42:52.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:44:52.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:46:52.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:48:52.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:50:52.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:52:52.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:54:52.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:56:52.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T15:58:52.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:00:52.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:02:52.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:04:52.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:06:53.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:08:53.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:10:53.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:12:53.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:14:53.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:16:53.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:18:53.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:20:53.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:22:53.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:24:53.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:26:53.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:28:53.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:30:53.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:32:53.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:34:54.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:36:54.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:38:54.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:40:54.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:42:54.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:44:54.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:46:54.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:48:54.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:50:54.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:52:54.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:54:54.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:56:54.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:58:54.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:00:54.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:02:55.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:04:55.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:06:55.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:08:55.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:10:55.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:12:55.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:14:55.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:16:55.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:18:55.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:20:55.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:22:55.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:24:56.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:26:56.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:28:56.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:30:56.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:32:56.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:34:56.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:36:56.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:38:56.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:40:56.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:42:56.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:44:56.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:46:56.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:48:56.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:50:56.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:52:56.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:54:57.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:56:57.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:58:57.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:00:57.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:02:57.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:04:57.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:06:57.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:08:57.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:10:57.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:12:57.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:14:57.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:16:57.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:18:57.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:20:57.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:22:58.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:24:58.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:26:58.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:28:58.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:30:58.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:32:58.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:34:58.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:36:58.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:38:58.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:40:58.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:42:58.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:44:58.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:46:58.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:48:58.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:50:58.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:52:59.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:54:59.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:56:59.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T18:58:59.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:00:59.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:02:59.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:04:59.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:06:59.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:08:59.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:10:59.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:12:59.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:14:59.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:16:59.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:18:59.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:21:00.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:23:00.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:25:00.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:27:00.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:29:00.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:31:00.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:33:00.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:35:00.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:37:00.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:39:00.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:41:00.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:43:00.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:45:00.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:47:00.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:49:00.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:51:00.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:53:01.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:55:01.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:57:01.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T19:59:01.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:01:01.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:03:01.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:05:01.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:07:01.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:09:01.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:11:01.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:13:01.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:15:01.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:17:01.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:19:01.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:21:02.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:23:02.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:25:02.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:27:02.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:29:02.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:31:02.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:33:02.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:35:02.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:37:02.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:39:02.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:41:02.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:43:02.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:45:02.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:47:02.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:49:02.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:51:03.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:53:03.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:55:03.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:57:03.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T20:59:03.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:01:03.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:03:03.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:05:03.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:07:03.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:09:03.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:11:03.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:13:03.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:15:04.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:17:04.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:19:04.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:21:04.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:23:04.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:25:04.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:27:04.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:29:04.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:31:04.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:33:04.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:35:04.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:37:04.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:39:04.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:41:04.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:43:04.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:45:05.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:47:05.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:49:05.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:51:05.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:53:05.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:55:05.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:57:05.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:59:05.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:01:05.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:03:05.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:05:05.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:07:05.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:09:05.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:11:05.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:13:06.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:15:06.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:17:06.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:19:06.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:21:06.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:23:06.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:25:06.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:27:06.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:29:06.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:31:06.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:33:06.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:35:06.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:37:06.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:39:06.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:41:07.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:43:07.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:45:07.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:47:07.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:49:07.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:51:07.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:53:07.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:55:07.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:57:07.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:59:07.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:01:07.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:03:07.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:05:07.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:07:07.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:09:07.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:11:08.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:13:08.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:15:08.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:17:08.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:19:08.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:21:08.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:23:08.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:25:08.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:27:08.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:29:08.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:31:08.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:33:08.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:35:08.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:37:08.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:39:09.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:41:09.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:43:09.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:45:09.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:47:09.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:49:09.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:51:09.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:53:09.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:55:09.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:57:09.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:59:09.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:01:09.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:03:09.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:05:09.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:07:10.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:09:10.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:11:10.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:13:10.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:15:10.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:17:10.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:19:10.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:21:10.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:23:10.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:25:10.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:27:10.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:29:10.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:31:10.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:33:11.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:35:11.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:37:11.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:39:11.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:41:11.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:43:11.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:45:11.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:47:11.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:49:11.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:51:11.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:53:11.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:55:11.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:57:11.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T00:59:11.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:01:11.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:03:12.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:05:12.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:07:12.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:09:12.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:11:12.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:13:12.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:15:12.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:17:12.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:19:12.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:21:12.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:23:12.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:25:12.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:27:12.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:29:12.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:31:12.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:33:13.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:35:13.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:37:13.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:39:13.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:41:13.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:43:13.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:45:13.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:47:13.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:49:13.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:51:13.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:53:13.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:55:13.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:57:13.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T01:59:13.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:01:14.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:03:14.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:05:14.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:07:14.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:09:14.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:11:14.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:13:14.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:15:14.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:17:14.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:19:14.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:21:14.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:23:15.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:25:15.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:27:15.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:29:15.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:31:15.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:33:15.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:35:15.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:37:15.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:39:15.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:41:15.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:43:15.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:45:15.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:47:15.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:49:15.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:51:15.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:53:16.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:55:16.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:57:16.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T02:59:16.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:01:16.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:03:16.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:05:16.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:07:16.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:09:16.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:11:16.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:13:16.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:15:16.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:17:16.839 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-12-02T03:17:16.998 INFO:teuthology.kill:Killing Pids: {847396} 2023-12-02T03:17:17.890 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2023-12-02T03:17:17.890 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2023-12-02T03:17:17.890 INFO:teuthology.misc:Compressing logs... 2023-12-02T03:17:17.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-12-02T03:17:17.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T03:17:17.961 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-12-02T03:17:18.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-12-02T03:17:18.034 DEBUG:teuthology.orchestra.run.smithi027:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-02T03:17:18.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-12-02T03:17:18.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T03:17:18.146 DEBUG:teuthology.orchestra.run.smithi145:> true 2023-12-02T03:17:18.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-12-02T03:17:18.223 DEBUG:teuthology.orchestra.run.smithi145:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-02T03:17:18.324 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473644/remote/smithi027/crash 2023-12-02T03:17:18.325 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-02T03:17:18.366 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473644/remote/smithi145/crash 2023-12-02T03:17:18.367 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-02T03:17:18.434 INFO:teuthology.misc:Compressing logs... 2023-12-02T03:17:18.435 DEBUG:teuthology.orchestra.run.smithi027:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-02T03:17:18.437 DEBUG:teuthology.orchestra.run.smithi145:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-02T03:17:18.464 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-02T03:17:18.465 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-02T03:17:18.465 INFO:teuthology.orchestra.run.smithi027.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 79.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-02T03:17:18.466 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-02T03:17:18.466 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-02T03:17:18.467 INFO:teuthology.orchestra.run.smithi145.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 81.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-02T03:17:18.547 INFO:teuthology.orchestra.run.smithi145.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 90.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-02T03:17:18.613 INFO:teuthology.orchestra.run.smithi027.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 92.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-02T03:17:18.615 DEBUG:teuthology.misc:Transferring archived files from smithi027:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473644/remote/smithi027/ 2023-12-02T03:17:18.615 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-02T03:17:18.707 DEBUG:teuthology.misc:Transferring archived files from smithi145:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473644/remote/smithi145/ 2023-12-02T03:17:18.707 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-02T03:17:18.751 INFO:teuthology.misc:Compressing logs... 2023-12-02T03:17:18.751 DEBUG:teuthology.orchestra.run.smithi027:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-02T03:17:18.753 DEBUG:teuthology.orchestra.run.smithi145:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-02T03:17:18.784 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-02T03:17:18.784 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.2.log 2023-12-02T03:17:18.784 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.0.log 2023-12-02T03:17:18.785 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mds.foo.smithi027.kylorw.log 2023-12-02T03:17:18.785 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.3.log 2023-12-02T03:17:18.785 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.0.log: /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mds.foo.smithi027.kylorw.log: gzip -5 --verbose -- /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.1.log 2023-12-02T03:17:18.785 INFO:teuthology.orchestra.run.smithi027.stderr: 79.6% -- replaced with /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mds.foo.smithi027.kylorw.log.gz 2023-12-02T03:17:18.786 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mon.c.log 2023-12-02T03:17:18.786 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.1.log: /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-02T03:17:18.787 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-volume.log: 92.6% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-02T03:17:18.792 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mon.a.log 2023-12-02T03:17:18.800 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mgr.y.log 2023-12-02T03:17:18.806 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mgr.y.log: 91.6% -- replaced with /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-02T03:17:18.814 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-02T03:17:18.814 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mds.foo.smithi145.mqdcmv.log 2023-12-02T03:17:18.816 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.5.log 2023-12-02T03:17:18.816 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mds.foo.smithi145.mqdcmv.log: gzip -5 --verbose -- /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.6.log 2023-12-02T03:17:18.816 INFO:teuthology.orchestra.run.smithi145.stderr: 61.6% -- replaced with /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mds.foo.smithi145.mqdcmv.log.gz 2023-12-02T03:17:18.816 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.4.log 2023-12-02T03:17:18.817 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mgr.x.log 2023-12-02T03:17:18.817 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-02T03:17:18.822 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.7.log 2023-12-02T03:17:18.822 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-volume.log: /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.7.log: 90.0% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-02T03:17:18.822 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mon.b.log 2023-12-02T03:17:18.834 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mon.b.log: 91.6% -- replaced with /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-02T03:17:18.945 INFO:teuthology.orchestra.run.smithi145.stderr: 94.5% -- replaced with /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mgr.x.log.gz 2023-12-02T03:17:25.674 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mgr.y.log: file size changed while zipping 2023-12-02T03:17:25.674 INFO:teuthology.orchestra.run.smithi027.stderr: 89.5% -- replaced with /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mgr.y.log.gz 2023-12-02T03:17:29.498 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.5.log: file size changed while zipping 2023-12-02T03:17:29.498 INFO:teuthology.orchestra.run.smithi145.stderr: 92.6% -- replaced with /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.5.log.gz 2023-12-02T03:17:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mon.c.log: file size changed while zipping 2023-12-02T03:17:29.777 INFO:teuthology.orchestra.run.smithi027.stderr: 91.7% -- replaced with /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mon.c.log.gz 2023-12-02T03:17:29.925 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.6.log: file size changed while zipping 2023-12-02T03:17:29.925 INFO:teuthology.orchestra.run.smithi145.stderr: 92.6% -- replaced with /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.6.log.gz 2023-12-02T03:17:30.185 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mon.b.log: file size changed while zipping 2023-12-02T03:17:30.185 INFO:teuthology.orchestra.run.smithi145.stderr: 91.6% -- replaced with /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mon.b.log.gz 2023-12-02T03:17:31.590 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.2.log: file size changed while zipping 2023-12-02T03:17:31.590 INFO:teuthology.orchestra.run.smithi027.stderr: 92.1% -- replaced with /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.2.log.gz 2023-12-02T03:17:32.338 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.4.log: file size changed while zipping 2023-12-02T03:17:32.339 INFO:teuthology.orchestra.run.smithi145.stderr: 93.3% -- replaced with /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.4.log.gz 2023-12-02T03:17:34.463 INFO:teuthology.orchestra.run.smithi145.stderr:gzip: /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.7.log: file size changed while zipping 2023-12-02T03:17:34.463 INFO:teuthology.orchestra.run.smithi145.stderr: 92.9% -- replaced with /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.7.log.gz 2023-12-02T03:17:34.840 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.0.log: file size changed while zipping 2023-12-02T03:17:34.841 INFO:teuthology.orchestra.run.smithi027.stderr: 93.0% -- replaced with /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.0.log.gz 2023-12-02T03:17:35.157 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.3.log: file size changed while zipping 2023-12-02T03:17:35.158 INFO:teuthology.orchestra.run.smithi027.stderr: 93.2% -- replaced with /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.3.log.gz 2023-12-02T03:17:35.653 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.1.log: file size changed while zipping 2023-12-02T03:17:35.653 INFO:teuthology.orchestra.run.smithi027.stderr: 93.0% -- replaced with /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-osd.1.log.gz 2023-12-02T03:17:46.063 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mon.a.log: file size changed while zipping 2023-12-02T03:17:46.063 INFO:teuthology.orchestra.run.smithi027.stderr: 89.9% -- replaced with /var/log/ceph/44d389e2-905f-11ee-95a2-87774f69a715/ceph-mon.a.log.gz 2023-12-02T03:17:46.065 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473644/remote/smithi027/log 2023-12-02T03:17:46.066 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-02T03:18:00.622 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473644/remote/smithi145/log 2023-12-02T03:18:00.623 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-02T03:18:09.711 INFO:teuthology.kill:No teuthology processes running 2023-12-02T03:18:09.712 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 331, in run_with_watchdog kill.kill_job( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/kill.py", line 89, in kill_job if kill_processes(run_name, [job_info.get('pid')]): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/kill.py", line 210, in kill_processes if survivors: UnboundLocalError: local variable 'survivors' referenced before assignment 2023-12-02T03:18:09.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:20:09.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T03:20:09.850 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-12-02T03:20:09.973 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-02T03:20:09.974 INFO:teuthology.nuke:Checking targets against current locks 2023-12-02T03:20:10.025 DEBUG:teuthology.nuke:shortname: smithi027 2023-12-02T03:20:10.025 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-02T03:20:10.048 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473644', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 15:10:04.342377', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-02T03:20:10.051 DEBUG:teuthology.nuke:shortname: smithi145 2023-12-02T03:20:10.051 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-02T03:20:10.076 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_15:08:59-upgrade:reef-x-wip-yuri10-testing-2023-11-30-0943-distro-default-smithi/7473644', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 15:10:04.340761', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-02T03:20:10.105 INFO:teuthology.orchestra.console.smithi027:Power off 2023-12-02T03:20:10.105 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-02T03:20:10.132 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-12-02T03:20:10.132 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:20:10.145 INFO:teuthology.orchestra.console.smithi145:Power off 2023-12-02T03:20:10.145 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-02T03:20:10.158 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-12-02T03:20:10.167 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off 2023-12-02T03:20:10.167 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:20:10.201 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2023-12-02T03:20:14.159 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:20:14.202 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:20:14.271 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-12-02T03:20:14.313 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2023-12-02T03:20:18.274 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:20:18.314 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:20:18.384 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-12-02T03:20:18.423 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2023-12-02T03:20:22.386 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:20:22.424 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T03:20:22.496 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-12-02T03:20:22.534 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-12-02T03:20:22.597 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-12-02T03:20:22.636 INFO:teuthology.orchestra.console.smithi145:Power off completed 2023-12-02T03:20:22.748 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com 2023-12-02T03:20:22.788 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com