2023-12-16T00:11:08.509 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-16T00:11:08.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:11:08.648 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4ac9f9d940>, signals=[15]) 2023-12-16T00:11:08.649 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2023-12-16T00:11:08.649 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2023-12-16T00:11:08.649 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-12-16T00:11:08.667 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging 2023-12-16T00:11:08.668 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server 2023-12-16T00:11:08.668 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-12-16T00:11:08.816 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_8.stream (ID 3) 2023-12-16T00:11:08.834 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_centos_8.stream (ID 3) 2023-12-16T00:11:08.862 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 8.stream 2023-12-16T00:11:08.890 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of centos 8.stream 2023-12-16T00:11:09.370 INFO:teuthology.orchestra.console.smithi175:Power off 2023-12-16T00:11:09.370 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T00:11:09.387 INFO:teuthology.orchestra.console.smithi161:Power off 2023-12-16T00:11:09.387 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T00:11:09.395 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-12-16T00:11:09.396 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:09.410 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-12-16T00:11:09.411 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:09.419 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-12-16T00:11:09.440 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-12-16T00:11:13.421 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:13.441 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:13.531 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-12-16T00:11:13.554 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-12-16T00:11:17.533 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:17.555 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:17.643 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-12-16T00:11:17.665 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-12-16T00:11:17.744 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-12-16T00:11:17.845 INFO:teuthology.orchestra.console.smithi175:Power on 2023-12-16T00:11:17.845 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-16T00:11:17.867 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On 2023-12-16T00:11:17.868 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:17.890 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-12-16T00:11:21.669 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:21.779 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-12-16T00:11:21.879 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-12-16T00:11:21.891 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:21.981 INFO:teuthology.orchestra.console.smithi161:Power on 2023-12-16T00:11:21.981 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-16T00:11:21.999 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-12-16T00:11:22.001 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2023-12-16T00:11:22.001 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:22.022 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-12-16T00:11:26.004 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:26.023 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:26.114 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-12-16T00:11:26.132 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-12-16T00:11:26.216 INFO:teuthology.orchestra.console.smithi175:Power on completed 2023-12-16T00:11:26.316 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish 2023-12-16T00:11:30.133 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:30.245 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-12-16T00:11:30.346 INFO:teuthology.orchestra.console.smithi161:Power on completed 2023-12-16T00:11:30.449 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2023-12-16T00:14:48.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:14:51.858 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-16T00:14:57.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:15:00.913 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-16T00:15:06.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:15:10.001 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-16T00:15:16.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:15:19.057 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-16T00:15:25.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:15:28.145 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-16T00:15:34.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:15:37.205 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-16T00:15:43.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:15:46.289 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-16T00:15:52.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:16:52.302 WARNING:teuthology.provision.fog.smithi161:timed out 2023-12-16T00:16:58.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:16:58.556 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-16T00:16:58.557 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-16T00:16:58.777 INFO:teuthology.provision.fog.smithi161:Node is ready 2023-12-16T00:16:58.777 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2023-12-16T00:16:58.835 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2023-12-16T00:16:58.835 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2023-12-16T00:16:58.894 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2023-12-16T00:16:58.894 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-12-16T00:16:58.987 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2023-12-16T00:16:59.015 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2023-12-16T00:16:59.083 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2023-12-16T00:16:59.151 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-12-16T00:16:59.218 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-12-16T00:16:59.276 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2023-12-16T00:16:59.276 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2023-12-16T00:16:59.276 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2023-12-16T00:16:59.276 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2023-12-16T00:16:59.276 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2023-12-16T00:16:59.277 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:16:59.277 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-16T00:16:59.277 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-12-16T00:16:59.277 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-16T00:16:59.277 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2023-12-16T00:16:59.277 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:16:59.277 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:16:59.277 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T00:16:59.278 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2023-12-16T00:16:59.279 DEBUG:teuthology.parallel:result is None 2023-12-16T00:17:01.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:17:04.338 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-12-16T00:17:10.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:17:13.393 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-12-16T00:17:19.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:17:22.482 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-12-16T00:17:28.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:17:31.569 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-12-16T00:17:37.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:17:40.661 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-12-16T00:17:46.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:17:49.745 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-12-16T00:17:55.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:18:14.166 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-12-16T00:18:20.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:18:23.253 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-12-16T00:18:29.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:18:29.858 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-16T00:18:29.858 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-16T00:18:54.692 INFO:teuthology.provision.fog.smithi175:Node is ready 2023-12-16T00:18:54.693 DEBUG:teuthology.orchestra.run.smithi175:> hostname 2023-12-16T00:18:54.718 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com 2023-12-16T00:18:54.718 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175.front.sepia.ceph.com /etc/hosts 2023-12-16T00:18:54.779 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175 2023-12-16T00:18:54.780 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-12-16T00:18:54.910 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hosts 2023-12-16T00:18:54.941 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts 2023-12-16T00:18:55.011 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hostname 2023-12-16T00:18:55.081 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-12-16T00:18:55.149 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-12-16T00:18:55.207 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2023-12-16T00:18:55.207 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8" 2023-12-16T00:18:55.207 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2023-12-16T00:18:55.207 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2023-12-16T00:18:55.207 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8" 2023-12-16T00:18:55.208 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:18:55.208 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-16T00:18:55.208 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-12-16T00:18:55.208 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-16T00:18:55.208 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2023-12-16T00:18:55.208 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:18:55.208 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:18:55.208 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T00:18:55.208 INFO:teuthology.provision.fog.smithi175:Deploy complete! 2023-12-16T00:18:55.209 DEBUG:teuthology.parallel:result is None 2023-12-16T00:18:55.362 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2023-12-16T00:18:55.362 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-16T00:18:55.389 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com 2023-12-16T00:18:55.389 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-16T00:18:55.407 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2023-12-16T00:18:55.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-12-16T00:18:55.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:18:55.477 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-12-16T00:18:55.612 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-12-16T00:18:55.612 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-12-16T00:18:55.671 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-12-16T00:18:55.672 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-12-16T00:18:55.730 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2023-12-16T00:18:55.730 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2023-12-16T00:18:55.730 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2023-12-16T00:18:55.730 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2023-12-16T00:18:55.731 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2023-12-16T00:18:55.731 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:18:55.731 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-16T00:18:55.731 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-12-16T00:18:55.731 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-16T00:18:55.731 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2023-12-16T00:18:55.731 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:18:55.731 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:18:55.731 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T00:18:55.731 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-12-16T00:18:55.756 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server 2023-12-16T00:18:55.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-12-16T00:18:55.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:18:55.823 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-12-16T00:18:55.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-12-16T00:18:55.850 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2023-12-16T00:18:55.911 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2023-12-16T00:18:55.911 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-12-16T00:18:55.970 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2023-12-16T00:18:55.970 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8" 2023-12-16T00:18:55.970 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2023-12-16T00:18:55.970 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2023-12-16T00:18:55.970 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8" 2023-12-16T00:18:55.970 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:18:55.970 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-16T00:18:55.970 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-12-16T00:18:55.970 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-16T00:18:55.970 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2023-12-16T00:18:55.970 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:18:55.970 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:18:55.971 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T00:18:55.971 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-12-16T00:18:55.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:18:56.076 INFO:teuthology.dispatcher.supervisor:Running job 7493386 2023-12-16T00:18:56.076 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493386 --name yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493386/orig.config.yaml 2023-12-16T00:18:56.080 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493386 2023-12-16T00:18:56.080 INFO:teuthology.dispatcher.supervisor:Job PID: 2038056 2023-12-16T00:18:56.080 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-16T00:20:56.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:22:56.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:24:56.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:26:56.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:28:56.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:30:57.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:32:57.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:34:57.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:36:57.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:38:57.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:40:57.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:42:58.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:44:58.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:46:58.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:48:58.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:50:58.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:52:58.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:54:59.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:56:59.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:58:59.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:00:59.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:02:59.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:04:59.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:07:00.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:09:00.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:11:00.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:13:00.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:15:00.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:17:00.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:19:01.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:21:01.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:23:01.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:25:01.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:27:01.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:29:01.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:31:02.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:33:02.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:35:02.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:37:02.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:39:02.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:41:02.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:43:03.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:45:03.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:47:03.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:49:03.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:51:03.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:53:03.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:55:04.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:57:04.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:59:04.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:01:04.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:03:04.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:05:04.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:07:04.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:09:05.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:11:05.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:13:05.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:15:05.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:17:05.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:19:05.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:21:06.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:23:06.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:25:06.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:27:06.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:29:06.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:31:06.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:33:07.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:35:07.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:37:07.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:39:07.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:41:07.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:43:07.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:45:08.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:47:08.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:49:08.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:51:08.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:53:08.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:55:08.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:57:09.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:59:09.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:01:09.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:03:09.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:05:09.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:07:09.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:09:10.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:11:10.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:13:10.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:15:10.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:17:10.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:19:10.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:21:11.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:23:11.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:25:11.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:27:11.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:29:11.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:31:11.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:33:12.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:35:12.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:37:12.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:39:12.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:41:12.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:43:12.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:45:13.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:47:13.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:49:13.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:51:13.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:53:13.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:55:13.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:57:14.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:59:14.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:01:14.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:03:14.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:05:14.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:07:14.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:09:15.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:11:15.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:13:15.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:15:15.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:17:15.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:19:15.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:21:16.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:23:16.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:25:16.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:27:16.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:29:17.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:31:17.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:33:17.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:35:17.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:37:17.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:39:17.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:41:18.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:43:18.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:45:18.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:47:18.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:49:18.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:51:18.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:53:19.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:55:19.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:57:19.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:59:19.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:01:19.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:03:19.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:05:20.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:07:20.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:09:20.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:11:20.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:13:20.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:15:20.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:17:21.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:19:21.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:21:21.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:23:21.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:25:21.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:27:21.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:29:21.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:31:22.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:33:22.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:35:22.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:37:22.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:39:22.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:41:22.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:43:23.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:45:23.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:47:23.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:49:23.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:51:23.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:53:24.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:55:24.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:57:24.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:59:24.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:01:24.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:03:24.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:05:24.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:07:25.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:09:25.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:11:25.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:13:25.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:15:25.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:17:26.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:19:26.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:21:26.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:23:26.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:25:26.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:27:26.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:29:27.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:31:27.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:33:27.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:35:27.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:37:27.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:39:27.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:41:28.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:43:28.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:45:28.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:47:28.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:49:28.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:51:28.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:53:29.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:55:29.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:57:29.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:59:29.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:01:29.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:03:29.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:05:30.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:07:30.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:09:30.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:11:30.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:13:30.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:15:30.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:17:31.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:19:31.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:21:31.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:23:31.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:25:31.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:27:32.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:29:32.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:31:32.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:33:32.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:35:32.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:37:32.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:39:33.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:41:33.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:43:33.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:45:33.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:47:33.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:49:33.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:51:34.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:53:34.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:55:34.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:57:34.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:59:34.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:01:34.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:03:35.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:05:35.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:07:35.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:09:35.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:11:35.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:13:36.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:15:36.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:17:36.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:19:36.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:21:36.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:23:36.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:25:37.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:27:37.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:29:37.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:31:37.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:33:37.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:35:38.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:37:38.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:39:38.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:41:38.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:43:38.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:45:38.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:47:39.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:49:39.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:51:39.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:53:39.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:55:39.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:57:40.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T08:59:40.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:01:40.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:03:40.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:05:40.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:07:40.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:09:41.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:11:41.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:13:41.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:15:41.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:17:41.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:19:42.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:21:42.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:23:42.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:25:42.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:27:42.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:29:43.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:31:43.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:33:43.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:35:43.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:37:43.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:39:43.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:41:44.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:43:44.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:45:44.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:47:44.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:49:44.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:51:45.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:53:45.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:55:45.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:57:45.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T09:59:45.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:01:45.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:03:46.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:05:46.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:07:46.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:09:46.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:11:46.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:13:46.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:15:47.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:17:47.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:19:47.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:21:47.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:23:47.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:25:47.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:27:48.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:29:48.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:31:48.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:33:48.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:35:48.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:37:49.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:39:49.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:41:49.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:43:49.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:45:49.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:47:49.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:49:50.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:51:50.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:53:50.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:55:50.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:57:50.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T10:59:50.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:01:51.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:03:51.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:05:51.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:07:51.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:09:51.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:11:52.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:13:52.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:15:52.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:17:52.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:19:52.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:21:52.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:23:53.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:25:53.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:27:53.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:29:53.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:31:53.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:33:53.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:35:54.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:37:54.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:39:54.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:41:54.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:43:54.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:45:54.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:47:54.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:49:55.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:51:55.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:53:55.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:55:55.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:57:55.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T11:59:56.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:01:56.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:03:56.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:05:56.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:07:56.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:09:56.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:11:56.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:13:57.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:15:57.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:17:57.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:19:57.634 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-12-16T12:19:57.839 INFO:teuthology.kill:Killing Pids: {2038056} 2023-12-16T12:19:58.671 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2023-12-16T12:19:58.671 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2023-12-16T12:19:58.671 INFO:teuthology.misc:Compressing logs... 2023-12-16T12:19:58.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-12-16T12:19:58.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T12:19:58.772 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-12-16T12:19:58.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-12-16T12:19:58.882 DEBUG:teuthology.orchestra.run.smithi161:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T12:19:58.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-12-16T12:19:58.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T12:19:59.008 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-12-16T12:19:59.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-12-16T12:19:59.187 DEBUG:teuthology.orchestra.run.smithi175:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T12:19:59.277 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493386/remote/smithi161/crash 2023-12-16T12:19:59.278 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T12:19:59.324 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493386/remote/smithi175/crash 2023-12-16T12:19:59.325 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T12:19:59.385 INFO:teuthology.misc:Compressing logs... 2023-12-16T12:19:59.385 DEBUG:teuthology.orchestra.run.smithi161:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T12:19:59.388 DEBUG:teuthology.orchestra.run.smithi175:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T12:19:59.426 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T12:19:59.428 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T12:19:59.434 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T12:19:59.435 INFO:teuthology.orchestra.run.smithi175.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 80.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-16T12:19:59.438 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T12:19:59.438 INFO:teuthology.orchestra.run.smithi161.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 80.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-16T12:19:59.593 INFO:teuthology.orchestra.run.smithi175.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2023-12-16T12:19:59.593 INFO:teuthology.orchestra.run.smithi175.stderr: 90.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-16T12:19:59.702 INFO:teuthology.orchestra.run.smithi161.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 92.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-16T12:19:59.704 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493386/remote/smithi161/ 2023-12-16T12:19:59.704 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T12:19:59.811 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493386/remote/smithi175/ 2023-12-16T12:19:59.812 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T12:19:59.862 INFO:teuthology.misc:Compressing logs... 2023-12-16T12:19:59.862 DEBUG:teuthology.orchestra.run.smithi161:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T12:19:59.864 DEBUG:teuthology.orchestra.run.smithi175:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T12:19:59.890 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-16T12:19:59.890 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-16T12:19:59.890 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.2.log 2023-12-16T12:19:59.890 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mgr.y.log 2023-12-16T12:19:59.890 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.3.log 2023-12-16T12:19:59.891 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.2.log: /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.0.log 2023-12-16T12:19:59.892 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mon.a.log 2023-12-16T12:19:59.892 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mon.c.log 2023-12-16T12:19:59.892 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mds.foo.smithi161.focsvh.log 2023-12-16T12:19:59.892 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.1.log 2023-12-16T12:19:59.892 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mds.foo.smithi161.focsvh.log: 79.1% -- replaced with /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mds.foo.smithi161.focsvh.log.gz 2023-12-16T12:19:59.919 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-16T12:19:59.919 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.6.log 2023-12-16T12:19:59.920 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-16T12:19:59.920 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.7.log 2023-12-16T12:19:59.920 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mgr.x.log 2023-12-16T12:19:59.920 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mds.foo.smithi175.gsoigl.log 2023-12-16T12:19:59.922 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mon.b.log 2023-12-16T12:19:59.922 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mds.foo.smithi175.gsoigl.log: gzip -5 --verbose -- /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.4.log 2023-12-16T12:19:59.922 INFO:teuthology.orchestra.run.smithi175.stderr: 58.1% -- replaced with /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mds.foo.smithi175.gsoigl.log.gz 2023-12-16T12:19:59.922 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.5.log 2023-12-16T12:19:59.958 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.1.log: 94.1% -- replaced with /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-16T12:20:00.122 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.4.log: /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.5.log: 94.4% -- replaced with /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mgr.x.log.gz 2023-12-16T12:20:00.130 INFO:teuthology.orchestra.run.smithi175.stderr: 93.9% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-16T12:20:00.514 INFO:teuthology.orchestra.run.smithi161.stderr: 93.9% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-16T12:20:00.831 INFO:teuthology.orchestra.run.smithi175.stderr: 94.0% -- replaced with /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-16T12:20:11.819 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mgr.y.log: file size changed while zipping 2023-12-16T12:20:11.820 INFO:teuthology.orchestra.run.smithi161.stderr: 89.7% -- replaced with /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mgr.y.log.gz 2023-12-16T12:20:13.064 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mon.b.log: file size changed while zipping 2023-12-16T12:20:13.065 INFO:teuthology.orchestra.run.smithi175.stderr: 91.6% -- replaced with /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mon.b.log.gz 2023-12-16T12:20:19.283 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mon.c.log: file size changed while zipping 2023-12-16T12:20:19.284 INFO:teuthology.orchestra.run.smithi161.stderr: 91.7% -- replaced with /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mon.c.log.gz 2023-12-16T12:20:55.342 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mon.a.log: file size changed while zipping 2023-12-16T12:20:55.342 INFO:teuthology.orchestra.run.smithi161.stderr: 89.8% -- replaced with /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-mon.a.log.gz 2023-12-16T12:21:01.396 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.6.log: file size changed while zipping 2023-12-16T12:21:01.396 INFO:teuthology.orchestra.run.smithi175.stderr: 93.6% -- replaced with /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.6.log.gz 2023-12-16T12:21:06.187 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.7.log: file size changed while zipping 2023-12-16T12:21:06.187 INFO:teuthology.orchestra.run.smithi175.stderr: 93.7% -- replaced with /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.7.log.gz 2023-12-16T12:21:11.154 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.4.log: file size changed while zipping 2023-12-16T12:21:11.155 INFO:teuthology.orchestra.run.smithi175.stderr: 93.6% -- replaced with /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.4.log.gz 2023-12-16T12:21:17.738 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.5.log: file size changed while zipping 2023-12-16T12:21:17.739 INFO:teuthology.orchestra.run.smithi175.stderr: 93.5% -- replaced with /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.5.log.gz 2023-12-16T12:22:14.731 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.1.log: file size changed while zipping 2023-12-16T12:22:14.731 INFO:teuthology.orchestra.run.smithi161.stderr: 93.6% -- replaced with /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.1.log.gz 2023-12-16T12:22:26.892 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.3.log: file size changed while zipping 2023-12-16T12:22:26.893 INFO:teuthology.orchestra.run.smithi161.stderr: 93.5% -- replaced with /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.3.log.gz 2023-12-16T12:22:27.818 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.2.log: file size changed while zipping 2023-12-16T12:22:27.818 INFO:teuthology.orchestra.run.smithi161.stderr: 93.5% -- replaced with /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.2.log.gz 2023-12-16T12:22:28.663 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.0.log: file size changed while zipping 2023-12-16T12:22:28.663 INFO:teuthology.orchestra.run.smithi161.stderr: 93.5% -- replaced with /var/log/ceph/160111aa-9bab-11ee-95a5-87774f69a715/ceph-osd.0.log.gz 2023-12-16T12:22:28.666 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493386/remote/smithi161/log 2023-12-16T12:22:28.667 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T12:23:06.163 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493386/remote/smithi175/log 2023-12-16T12:23:06.164 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T12:23:33.546 INFO:teuthology.kill:No teuthology processes running 2023-12-16T12:23:33.546 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 331, in run_with_watchdog kill.kill_job( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/kill.py", line 89, in kill_job if kill_processes(run_name, [job_info.get('pid')]): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/kill.py", line 210, in kill_processes if survivors: UnboundLocalError: local variable 'survivors' referenced before assignment 2023-12-16T12:23:33.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:25:33.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T12:25:33.807 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-12-16T12:25:33.934 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-16T12:25:33.934 INFO:teuthology.nuke:Checking targets against current locks 2023-12-16T12:25:33.980 DEBUG:teuthology.nuke:shortname: smithi161 2023-12-16T12:25:33.980 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T12:25:34.002 DEBUG:teuthology.nuke:shortname: smithi175 2023-12-16T12:25:34.003 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T12:25:34.006 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493386', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 00:11:07.606068', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMJ/Z7zwXihT2LW4GMtUr9vXsrW12W/QfKUZE/OZBCQY2a6gf59WsFoaXF2/yj5BDswv0VVKSG1hJmMGAjyA4bA='} 2023-12-16T12:25:34.030 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:10:10-upgrade:pacific-x-main-distro-default-smithi/7493386', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 00:11:07.604533', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFD18or0/HALEgmrtO1fMyN0qIhf0c+f2+dLq173tmLV1RsTcHoIduSP1VQoxK9cs/Dk96jI273MJzrSmyBQvbM='} 2023-12-16T12:25:34.058 INFO:teuthology.orchestra.console.smithi161:Power off 2023-12-16T12:25:34.058 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T12:25:34.073 INFO:teuthology.orchestra.console.smithi175:Power off 2023-12-16T12:25:34.073 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T12:25:34.081 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-12-16T12:25:34.082 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T12:25:34.095 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-12-16T12:25:34.095 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T12:25:34.104 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-12-16T12:25:34.121 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-12-16T12:25:38.109 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T12:25:38.122 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T12:25:38.219 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-12-16T12:25:38.231 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-12-16T12:25:42.223 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T12:25:42.233 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T12:25:42.333 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-12-16T12:25:42.344 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-12-16T12:25:42.444 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-12-16T12:25:42.594 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com 2023-12-16T12:25:46.337 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T12:25:46.448 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-12-16T12:25:46.549 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-12-16T12:25:46.703 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com