2023-12-13T21:43:12.127 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-13T21:43:12.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T21:43:12.275 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f19da780940>, signals=[15]) 2023-12-13T21:43:12.275 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging 2023-12-13T21:43:12.275 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T21:43:12.275 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-12-13T21:43:12.294 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2023-12-13T21:43:12.295 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T21:43:12.295 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-12-13T21:43:12.419 DEBUG:teuthology.provision.fog.smithi131:Requesting image smithi_centos_8.stream (ID 3) 2023-12-13T21:43:12.424 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_centos_8.stream (ID 3) 2023-12-13T21:43:12.474 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of centos 8.stream 2023-12-13T21:43:12.479 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 8.stream 2023-12-13T21:43:12.705 INFO:teuthology.orchestra.console.smithi131:Power off 2023-12-13T21:43:12.705 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T21:43:12.719 INFO:teuthology.orchestra.console.smithi169:Power off 2023-12-13T21:43:12.719 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T21:43:12.728 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2023-12-13T21:43:12.728 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T21:43:12.740 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-12-13T21:43:12.741 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T21:43:12.749 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-12-13T21:43:12.762 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-12-13T21:43:16.753 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T21:43:16.763 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T21:43:16.863 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-12-13T21:43:16.873 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-12-13T21:43:20.868 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T21:43:20.875 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T21:43:20.978 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-12-13T21:43:20.984 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-12-13T21:43:21.079 INFO:teuthology.orchestra.console.smithi131:Power off completed 2023-12-13T21:43:21.084 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-12-13T21:43:21.180 INFO:teuthology.orchestra.console.smithi131:Power on 2023-12-13T21:43:21.180 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T21:43:21.188 INFO:teuthology.orchestra.console.smithi169:Power on 2023-12-13T21:43:21.188 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T21:43:21.201 DEBUG:teuthology.orchestra.console.smithi131:power on output: Chassis Power Control: Up/On 2023-12-13T21:43:21.202 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T21:43:21.211 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2023-12-13T21:43:21.211 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T21:43:21.225 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-12-13T21:43:21.234 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-12-13T21:43:25.229 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T21:43:25.237 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T21:43:25.338 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-12-13T21:43:25.345 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-12-13T21:43:29.341 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T21:43:29.348 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T21:43:29.458 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-12-13T21:43:29.559 INFO:teuthology.orchestra.console.smithi169:Power on completed 2023-12-13T21:43:29.571 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-12-13T21:43:29.660 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2023-12-13T21:43:29.672 INFO:teuthology.orchestra.console.smithi131:Power on completed 2023-12-13T21:43:29.773 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish 2023-12-13T21:46:00.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T21:46:15.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T21:46:19.029 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-12-13T21:46:25.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T21:46:28.113 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-12-13T21:46:34.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T21:46:34.129 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-12-13T21:46:37.169 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-12-13T21:46:40.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T21:46:43.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T21:46:43.185 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-12-13T21:46:46.225 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-12-13T21:46:49.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T21:46:52.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T21:46:52.276 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-12-13T21:46:58.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T21:47:01.361 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-12-13T21:47:07.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T21:47:10.417 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-12-13T21:47:10.737 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-12-13T21:47:16.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T21:47:16.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T21:47:19.477 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-12-13T21:47:19.793 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-12-13T21:47:25.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T21:47:25.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T21:47:28.849 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-12-13T21:47:34.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T21:47:35.092 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T21:47:35.092 DEBUG:teuthology.orchestra.run.smithi131:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T21:47:44.021 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-12-13T21:47:50.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T21:47:53.077 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-12-13T21:47:54.628 INFO:teuthology.provision.fog.smithi131:Node is ready 2023-12-13T21:47:54.628 DEBUG:teuthology.orchestra.run.smithi131:> hostname 2023-12-13T21:47:54.653 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com 2023-12-13T21:47:54.653 DEBUG:teuthology.orchestra.run.smithi131:> grep smithi131.front.sepia.ceph.com /etc/hosts 2023-12-13T21:47:54.713 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131 2023-12-13T21:47:54.714 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2023-12-13T21:47:54.849 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hosts 2023-12-13T21:47:54.881 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/172.21.15.131/172.21.15.131/g' /etc/hosts 2023-12-13T21:47:54.949 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hostname 2023-12-13T21:47:55.018 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2023-12-13T21:47:55.086 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-12-13T21:47:55.144 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2023-12-13T21:47:55.145 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8" 2023-12-13T21:47:55.145 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2023-12-13T21:47:55.145 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2023-12-13T21:47:55.145 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8" 2023-12-13T21:47:55.145 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2023-12-13T21:47:55.145 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-13T21:47:55.145 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2023-12-13T21:47:55.145 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-13T21:47:55.145 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2023-12-13T21:47:55.145 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T21:47:55.146 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T21:47:55.146 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T21:47:55.146 INFO:teuthology.provision.fog.smithi131:Deploy complete! 2023-12-13T21:47:55.148 DEBUG:teuthology.parallel:result is None 2023-12-13T21:47:59.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T21:47:59.784 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T21:47:59.785 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T21:48:24.743 INFO:teuthology.provision.fog.smithi169:Node is ready 2023-12-13T21:48:24.743 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2023-12-13T21:48:24.768 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2023-12-13T21:48:24.768 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2023-12-13T21:48:24.829 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2023-12-13T21:48:24.829 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-12-13T21:48:24.937 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2023-12-13T21:48:24.969 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2023-12-13T21:48:25.038 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2023-12-13T21:48:25.106 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-12-13T21:48:25.174 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-12-13T21:48:25.233 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2023-12-13T21:48:25.234 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8" 2023-12-13T21:48:25.234 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2023-12-13T21:48:25.234 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2023-12-13T21:48:25.234 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8" 2023-12-13T21:48:25.234 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-12-13T21:48:25.234 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-13T21:48:25.234 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-12-13T21:48:25.234 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-13T21:48:25.234 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2023-12-13T21:48:25.234 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T21:48:25.234 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T21:48:25.234 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T21:48:25.235 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2023-12-13T21:48:25.235 DEBUG:teuthology.parallel:result is None 2023-12-13T21:48:25.389 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com 2023-12-13T21:48:25.390 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T21:48:25.417 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2023-12-13T21:48:25.418 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T21:48:25.443 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server 2023-12-13T21:48:25.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-12-13T21:48:25.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T21:48:25.513 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-12-13T21:48:25.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-12-13T21:48:25.654 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2023-12-13T21:48:25.714 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2023-12-13T21:48:25.714 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-12-13T21:48:25.773 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2023-12-13T21:48:25.774 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8" 2023-12-13T21:48:25.775 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2023-12-13T21:48:25.775 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2023-12-13T21:48:25.775 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8" 2023-12-13T21:48:25.776 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2023-12-13T21:48:25.776 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-13T21:48:25.777 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2023-12-13T21:48:25.777 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-13T21:48:25.777 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2023-12-13T21:48:25.778 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T21:48:25.778 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T21:48:25.778 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T21:48:25.779 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-12-13T21:48:25.809 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2023-12-13T21:48:25.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-12-13T21:48:25.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T21:48:25.875 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-12-13T21:48:25.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-12-13T21:48:25.945 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-12-13T21:48:26.004 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-12-13T21:48:26.004 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-12-13T21:48:26.062 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2023-12-13T21:48:26.063 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8" 2023-12-13T21:48:26.063 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2023-12-13T21:48:26.063 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2023-12-13T21:48:26.063 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8" 2023-12-13T21:48:26.063 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-12-13T21:48:26.063 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-13T21:48:26.063 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-12-13T21:48:26.063 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-13T21:48:26.063 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2023-12-13T21:48:26.063 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T21:48:26.063 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T21:48:26.063 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T21:48:26.064 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-12-13T21:48:26.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T21:48:26.179 INFO:teuthology.dispatcher.supervisor:Running job 7490503 2023-12-13T21:48:26.179 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-13_20:38:02-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490503 --name yuriw-2023-12-13_20:38:02-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} -- /home/teuthworker/archive/yuriw-2023-12-13_20:38:02-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490503/orig.config.yaml 2023-12-13T21:48:26.184 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-13_20:38:02-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490503 2023-12-13T21:48:26.185 INFO:teuthology.dispatcher.supervisor:Job PID: 573067 2023-12-13T21:48:26.185 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-13T21:50:26.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T21:52:26.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T21:54:26.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T21:56:26.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T21:58:26.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:00:27.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:02:27.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:04:27.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:06:27.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:08:27.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:10:27.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:12:28.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:14:28.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:16:28.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:18:28.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:20:28.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:22:28.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:24:29.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:26:29.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:28:29.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:30:29.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:32:29.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:34:29.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:36:30.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:38:30.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:40:30.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:42:30.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:44:30.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:46:31.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:48:31.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:50:31.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:52:31.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:54:31.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:56:32.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:58:32.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:00:32.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:02:32.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:04:32.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:06:32.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:08:33.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:10:33.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:12:33.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:14:33.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:16:33.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:18:33.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:20:34.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:22:34.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:24:34.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:26:34.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:28:34.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:30:34.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:32:35.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:34:35.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:36:35.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:38:35.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:40:35.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:42:35.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:44:36.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:46:36.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:48:36.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:50:36.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:52:36.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:54:37.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:56:37.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:58:37.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:00:37.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:02:38.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:04:38.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:06:38.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:08:38.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:10:38.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:12:38.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:14:39.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:16:39.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:18:39.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:20:39.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:22:39.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:24:39.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:26:40.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:28:40.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:30:40.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:32:40.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:34:40.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:36:40.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:38:41.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:40:41.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:42:41.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:44:41.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:46:41.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:48:41.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:50:42.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:52:42.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:54:42.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:56:42.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:58:42.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:00:42.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:02:43.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:04:43.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:06:43.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:08:43.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:10:43.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:12:43.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:14:44.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:16:44.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:18:44.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:20:44.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:22:44.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:24:44.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:26:45.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:28:45.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:30:45.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:32:45.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:34:45.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:36:45.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:38:46.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:40:46.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:42:46.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:44:46.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:46:46.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:48:47.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:50:47.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:52:47.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:54:47.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:56:47.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T01:58:47.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:00:48.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:02:48.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:04:48.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:06:48.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:08:48.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:10:48.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:12:49.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:14:49.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:16:49.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:18:49.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:20:49.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:22:49.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:24:50.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:26:50.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:28:50.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:30:50.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:32:50.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:34:50.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:36:51.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:38:51.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:40:51.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:42:51.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:44:51.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:46:51.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:48:52.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:50:52.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:52:52.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:54:52.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:56:52.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T02:58:53.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:00:53.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:02:53.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:04:53.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:06:53.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:08:53.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:10:54.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:12:54.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:14:54.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:16:54.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:18:54.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:20:54.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:22:55.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:24:55.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:26:55.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:28:55.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:30:55.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:32:55.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:34:56.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:36:56.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:38:56.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:40:56.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:42:56.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:44:56.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:46:57.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:48:57.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:50:57.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:52:57.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:54:57.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:56:58.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:58:58.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:00:58.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:02:58.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:04:58.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:06:58.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:08:59.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:10:59.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:12:59.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:14:59.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:16:59.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:18:59.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:21:00.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:23:00.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:25:00.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:27:00.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:29:00.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:31:00.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:33:01.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:35:01.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:37:01.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:39:01.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:41:01.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:43:01.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:45:02.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:47:02.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:49:02.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:51:02.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:53:02.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:55:02.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:57:03.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T04:59:03.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:01:03.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:03:03.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:05:03.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:07:03.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:09:03.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:11:04.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:13:04.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:15:04.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:17:04.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:19:04.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:21:04.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:23:04.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:25:05.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:27:05.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:29:05.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:31:05.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:33:05.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:35:05.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:37:06.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:39:06.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:41:06.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:43:06.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:45:06.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:47:06.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:49:06.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:51:07.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:53:07.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:55:07.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:57:07.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T05:59:07.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:01:07.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:03:08.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:05:08.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:07:08.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:09:08.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:11:08.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:13:08.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:15:08.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:17:08.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:19:09.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:21:09.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:23:09.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:25:09.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:27:09.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:29:09.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:31:09.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:33:09.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:35:09.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:37:10.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:39:10.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:41:10.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:43:10.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:45:10.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:47:10.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:49:11.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:51:11.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:53:11.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:55:11.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:57:11.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T06:59:11.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:01:11.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:03:12.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:05:12.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:07:12.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:09:12.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:11:12.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:13:12.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:15:13.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:17:13.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:19:13.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:21:13.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:23:13.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:25:13.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:27:14.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:29:14.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:31:14.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:33:14.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:35:14.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:37:14.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:39:14.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:41:14.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:43:15.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:45:15.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:47:15.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:49:15.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:51:15.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:53:15.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:55:16.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:57:16.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T07:59:16.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:01:16.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:03:16.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:05:16.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:07:16.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:09:17.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:11:17.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:13:17.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:15:17.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:17:17.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:19:17.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:21:17.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:23:18.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:25:18.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:27:18.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:29:18.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:31:18.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:33:18.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:35:19.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:37:19.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:39:19.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:41:19.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:43:19.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:45:19.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:47:20.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:49:20.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:51:20.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:53:20.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:55:20.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:57:20.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T08:59:20.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:01:21.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:03:21.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:05:21.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:07:21.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:09:21.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:11:21.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:13:22.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:15:22.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:17:22.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:19:22.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:21:22.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:23:22.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:25:23.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:27:23.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:29:23.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:31:23.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:33:23.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:35:23.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:37:23.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:39:24.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:41:24.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:43:24.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:45:24.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:47:24.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T09:49:24.859 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-12-14T09:49:24.993 INFO:teuthology.kill:Killing Pids: {573067} 2023-12-14T09:49:25.830 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2023-12-14T09:49:25.831 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2023-12-14T09:49:25.831 INFO:teuthology.misc:Compressing logs... 2023-12-14T09:49:25.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-12-14T09:49:25.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T09:49:25.939 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-12-14T09:49:26.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-12-14T09:49:26.031 DEBUG:teuthology.orchestra.run.smithi131:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-14T09:49:26.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-12-14T09:49:26.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T09:49:26.588 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-12-14T09:49:26.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-12-14T09:49:26.835 DEBUG:teuthology.orchestra.run.smithi169:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-14T09:49:27.496 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-13_20:38:02-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490503/remote/smithi131/crash 2023-12-14T09:49:27.497 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-14T09:49:27.565 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-13_20:38:02-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490503/remote/smithi169/crash 2023-12-14T09:49:27.566 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-14T09:49:28.615 INFO:teuthology.misc:Compressing logs... 2023-12-14T09:49:28.615 DEBUG:teuthology.orchestra.run.smithi131:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-14T09:49:28.617 DEBUG:teuthology.orchestra.run.smithi169:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-14T09:49:28.663 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-14T09:49:28.663 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-14T09:49:28.691 INFO:teuthology.orchestra.run.smithi131.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 82.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-14T09:49:28.832 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-14T09:49:28.917 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-14T09:49:28.938 INFO:teuthology.orchestra.run.smithi169.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 82.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-14T09:49:30.448 INFO:teuthology.orchestra.run.smithi131.stderr: 96.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-14T09:49:34.482 INFO:teuthology.orchestra.run.smithi169.stderr: 95.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-14T09:49:34.485 DEBUG:teuthology.misc:Transferring archived files from smithi131:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-13_20:38:02-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490503/remote/smithi131/ 2023-12-14T09:49:34.485 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-14T09:49:34.723 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-13_20:38:02-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490503/remote/smithi169/ 2023-12-14T09:49:34.723 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-14T09:49:35.091 INFO:teuthology.misc:Compressing logs... 2023-12-14T09:49:35.091 DEBUG:teuthology.orchestra.run.smithi131:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-14T09:49:35.093 DEBUG:teuthology.orchestra.run.smithi169:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-14T09:49:35.138 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-14T09:49:35.138 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-volume.log 2023-12-14T09:49:35.139 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.2.log 2023-12-14T09:49:35.140 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mgr.y.log 2023-12-14T09:49:35.140 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-volume.log: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mds.foo.smithi131.uiodvk.log 2023-12-14T09:49:35.140 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.3.log 2023-12-14T09:49:35.140 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mgr.y.log: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mds.foo.smithi131.uiodvk.log: gzip -5 --verbose -- /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.0.log 2023-12-14T09:49:35.140 INFO:teuthology.orchestra.run.smithi131.stderr: 78.7% -- replaced with /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mds.foo.smithi131.uiodvk.log.gz 2023-12-14T09:49:35.140 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mon.a.log 2023-12-14T09:49:35.141 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mon.c.log 2023-12-14T09:49:35.141 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.1.log 2023-12-14T09:49:35.291 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-14T09:49:35.441 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.6.log 2023-12-14T09:49:35.442 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-volume.log 2023-12-14T09:49:35.442 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mds.foo.smithi169.trmnkr.log 2023-12-14T09:49:35.443 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.7.log 2023-12-14T09:49:35.443 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mgr.x.log 2023-12-14T09:49:35.444 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mds.foo.smithi169.trmnkr.log: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mon.b.log 2023-12-14T09:49:35.444 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.4.log 2023-12-14T09:49:35.444 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mgr.x.log: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.5.log 2023-12-14T09:49:35.519 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.4.log: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.5.log: 92.9% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-14T09:49:35.525 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-volume.log.gz 2023-12-14T09:49:35.532 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mds.foo.smithi169.trmnkr.log.gz 2023-12-14T09:49:36.624 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mon.c.log: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.1.log: 92.9% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-14T09:49:38.316 INFO:teuthology.orchestra.run.smithi131.stderr: 91.5% -- replaced with /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-volume.log.gz 2023-12-14T09:49:59.224 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.5.log: file size changed while zipping 2023-12-14T09:49:59.224 INFO:teuthology.orchestra.run.smithi169.stderr: 92.8% -- replaced with /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.5.log.gz 2023-12-14T09:50:00.188 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.6.log: file size changed while zipping 2023-12-14T09:50:00.188 INFO:teuthology.orchestra.run.smithi169.stderr: 92.8% -- replaced with /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.6.log.gz 2023-12-14T09:50:03.042 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.7.log: file size changed while zipping 2023-12-14T09:50:03.179 INFO:teuthology.orchestra.run.smithi169.stderr: 93.0% -- replaced with /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.7.log.gz 2023-12-14T09:50:03.341 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.2.log: file size changed while zipping 2023-12-14T09:50:03.341 INFO:teuthology.orchestra.run.smithi131.stderr: 92.1% -- replaced with /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.2.log.gz 2023-12-14T09:50:08.394 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.4.log: file size changed while zipping 2023-12-14T09:50:08.410 INFO:teuthology.orchestra.run.smithi169.stderr: 93.4% -- replaced with /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.4.log.gz 2023-12-14T09:50:09.039 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.0.log: file size changed while zipping 2023-12-14T09:50:09.040 INFO:teuthology.orchestra.run.smithi131.stderr: 93.1% -- replaced with /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.0.log.gz 2023-12-14T09:50:10.243 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.1.log: file size changed while zipping 2023-12-14T09:50:10.244 INFO:teuthology.orchestra.run.smithi131.stderr: 93.0% -- replaced with /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.1.log.gz 2023-12-14T09:50:13.591 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.3.log: file size changed while zipping 2023-12-14T09:50:13.591 INFO:teuthology.orchestra.run.smithi131.stderr: 93.2% -- replaced with /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-osd.3.log.gz 2023-12-14T09:50:21.052 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mgr.y.log: file size changed while zipping 2023-12-14T09:50:21.052 INFO:teuthology.orchestra.run.smithi131.stderr: 92.3% -- replaced with /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mgr.y.log.gz 2023-12-14T10:14:12.166 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mon.c.log: file size changed while zipping 2023-12-14T10:14:12.167 INFO:teuthology.orchestra.run.smithi131.stderr: 94.7% -- replaced with /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mon.c.log.gz 2023-12-14T10:17:15.763 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mon.a.log: file size changed while zipping 2023-12-14T10:17:15.766 INFO:teuthology.orchestra.run.smithi131.stderr: 94.6% -- replaced with /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mon.a.log.gz 2023-12-14T11:29:03.651 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mgr.x.log: file size changed while zipping 2023-12-14T11:29:03.652 INFO:teuthology.orchestra.run.smithi169.stderr: 96.4% -- replaced with /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mgr.x.log.gz 2023-12-14T12:19:01.086 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mon.b.log: file size changed while zipping 2023-12-14T12:19:01.125 INFO:teuthology.orchestra.run.smithi169.stderr: 95.0% -- replaced with /var/log/ceph/98458a3c-9a03-11ee-95a3-87774f69a715/ceph-mon.b.log.gz 2023-12-14T12:19:01.126 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-13_20:38:02-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490503/remote/smithi131/log 2023-12-14T12:19:01.128 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-14T12:24:15.439 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-13_20:38:02-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490503/remote/smithi169/log 2023-12-14T12:24:15.442 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-14T12:47:19.936 INFO:teuthology.orchestra.run.smithi169.stderr:tar: ./98458a3c-9a03-11ee-95a3-87774f69a715: file changed as we read it 2023-12-14T12:47:20.084 INFO:teuthology.kill:No teuthology processes running 2023-12-14T12:47:20.084 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 331, in run_with_watchdog kill.kill_job( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/kill.py", line 89, in kill_job if kill_processes(run_name, [job_info.get('pid')]): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/kill.py", line 210, in kill_processes if survivors: UnboundLocalError: local variable 'survivors' referenced before assignment 2023-12-14T12:47:20.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T12:49:20.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T12:49:20.309 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-12-14T12:49:20.426 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-14T12:49:20.426 INFO:teuthology.nuke:Checking targets against current locks 2023-12-14T12:49:20.473 DEBUG:teuthology.nuke:shortname: smithi131 2023-12-14T12:49:20.473 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T12:49:20.501 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:02-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490503', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 21:43:11.296251', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPZMmY9GAcbVk4H22j9roc7rEOD9F32k0OfMGxVMUzzRIOD6ujcDZAjA1GTWAcQSCilBpoj+eyADOs/3YJDlLcc='} 2023-12-14T12:49:20.504 DEBUG:teuthology.nuke:shortname: smithi169 2023-12-14T12:49:20.505 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T12:49:20.530 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:02-upgrade:reef-x-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490503', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 21:43:11.294798', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLBI9L1/C5b1vk371Vn7RBtWTTs4j2z6ODWcDcLFeagDrVxcC7Y1wQh6mdK53y+eGVZo6v/8QF2rDQ1Y7gc/svI='} 2023-12-14T12:49:20.559 INFO:teuthology.orchestra.console.smithi131:Power off 2023-12-14T12:49:20.559 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T12:49:20.581 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2023-12-14T12:49:20.581 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T12:49:20.594 INFO:teuthology.orchestra.console.smithi169:Power off 2023-12-14T12:49:20.594 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T12:49:20.602 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-12-14T12:49:20.616 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-12-14T12:49:20.617 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T12:49:20.637 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-12-14T12:49:24.607 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T12:49:24.639 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T12:49:24.717 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-12-14T12:49:24.747 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-12-14T12:49:28.721 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T12:49:28.748 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T12:49:28.833 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-12-14T12:49:28.857 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-12-14T12:49:28.957 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-12-14T12:49:29.191 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com 2023-12-14T12:49:32.840 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T12:49:32.953 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-12-14T12:49:33.053 INFO:teuthology.orchestra.console.smithi131:Power off completed 2023-12-14T12:49:33.265 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com