2023-12-15T18:26:23.692 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-15T18:26:23.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T18:26:23.831 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff762261940>, signals=[15]) 2023-12-15T18:26:23.831 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging 2023-12-15T18:26:23.831 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server 2023-12-15T18:26:23.832 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-12-15T18:26:23.856 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2023-12-15T18:26:23.856 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2023-12-15T18:26:23.856 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-12-15T18:26:23.987 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_centos_8.stream (ID 3) 2023-12-15T18:26:24.000 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_centos_8.stream (ID 3) 2023-12-15T18:26:24.035 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of centos 8.stream 2023-12-15T18:26:24.047 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of centos 8.stream 2023-12-15T18:26:24.268 INFO:teuthology.orchestra.console.smithi102:Power off 2023-12-15T18:26:24.268 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-15T18:26:24.281 INFO:teuthology.orchestra.console.smithi038:Power off 2023-12-15T18:26:24.281 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-15T18:26:24.290 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-12-15T18:26:24.291 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T18:26:24.302 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2023-12-15T18:26:24.302 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T18:26:24.313 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-12-15T18:26:24.325 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-12-15T18:26:28.318 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T18:26:28.326 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T18:26:28.427 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-12-15T18:26:28.433 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-12-15T18:26:32.429 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T18:26:32.436 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T18:26:32.539 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-12-15T18:26:32.545 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-12-15T18:26:32.646 INFO:teuthology.orchestra.console.smithi038:Power off completed 2023-12-15T18:26:32.746 INFO:teuthology.orchestra.console.smithi038:Power on 2023-12-15T18:26:32.746 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-15T18:26:32.766 DEBUG:teuthology.orchestra.console.smithi038:power on output: Chassis Power Control: Up/On 2023-12-15T18:26:32.766 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T18:26:32.787 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-12-15T18:26:36.541 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T18:26:36.652 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-12-15T18:26:36.753 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-12-15T18:26:36.788 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T18:26:36.854 INFO:teuthology.orchestra.console.smithi102:Power on 2023-12-15T18:26:36.854 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-15T18:26:36.875 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On 2023-12-15T18:26:36.875 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T18:26:36.896 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-12-15T18:26:36.897 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-12-15T18:26:40.897 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T18:26:40.904 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T18:26:41.007 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-12-15T18:26:41.077 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-12-15T18:26:41.177 INFO:teuthology.orchestra.console.smithi038:Power on completed 2023-12-15T18:26:41.278 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2023-12-15T18:26:45.009 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-15T18:26:45.118 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-12-15T18:26:45.219 INFO:teuthology.orchestra.console.smithi102:Power on completed 2023-12-15T18:26:45.319 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2023-12-15T18:29:12.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T18:29:12.133 ERROR:teuthology.orchestra.connection:Error authenticating with smithi038.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-15T18:29:26.418 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-12-15T18:29:31.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T18:29:32.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T18:29:34.097 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-15T18:29:35.473 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-12-15T18:29:40.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T18:29:41.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T18:29:43.153 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-15T18:29:44.529 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-12-15T18:29:49.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T18:29:50.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T18:29:52.214 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-15T18:29:53.585 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-12-15T18:29:58.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T18:29:59.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T18:30:01.269 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-15T18:30:02.641 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-12-15T18:30:07.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T18:30:08.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T18:30:10.325 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-15T18:30:16.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T18:30:19.381 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-15T18:30:25.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T18:31:08.646 WARNING:teuthology.provision.fog.smithi038:timed out 2023-12-15T18:31:14.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T18:31:14.915 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-15T18:31:14.916 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-15T18:31:15.150 INFO:teuthology.provision.fog.smithi038:Node is ready 2023-12-15T18:31:15.150 DEBUG:teuthology.orchestra.run.smithi038:> hostname 2023-12-15T18:31:15.210 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2023-12-15T18:31:15.211 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts 2023-12-15T18:31:15.271 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2023-12-15T18:31:15.283 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-12-15T18:31:15.363 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts 2023-12-15T18:31:15.394 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts 2023-12-15T18:31:15.464 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname 2023-12-15T18:31:15.535 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-12-15T18:31:15.606 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-12-15T18:31:15.665 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2023-12-15T18:31:15.665 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8" 2023-12-15T18:31:15.665 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2023-12-15T18:31:15.665 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2023-12-15T18:31:15.665 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8" 2023-12-15T18:31:15.666 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-12-15T18:31:15.666 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-15T18:31:15.666 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-12-15T18:31:15.666 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-15T18:31:15.666 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2023-12-15T18:31:15.666 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-15T18:31:15.666 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-15T18:31:15.666 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-15T18:31:15.667 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2023-12-15T18:31:15.668 DEBUG:teuthology.parallel:result is None 2023-12-15T18:31:25.386 WARNING:teuthology.provision.fog.smithi102:timed out 2023-12-15T18:31:31.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T18:31:31.624 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-15T18:31:31.624 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-15T18:31:31.911 INFO:teuthology.provision.fog.smithi102:Node is ready 2023-12-15T18:31:31.911 DEBUG:teuthology.orchestra.run.smithi102:> hostname 2023-12-15T18:31:31.932 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com 2023-12-15T18:31:31.932 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts 2023-12-15T18:31:31.993 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102 2023-12-15T18:31:31.994 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-12-15T18:31:32.096 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts 2023-12-15T18:31:32.126 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts 2023-12-15T18:31:32.197 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname 2023-12-15T18:31:32.266 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-12-15T18:31:32.334 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-12-15T18:31:32.392 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2023-12-15T18:31:32.392 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8" 2023-12-15T18:31:32.392 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2023-12-15T18:31:32.392 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2023-12-15T18:31:32.392 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8" 2023-12-15T18:31:32.392 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-12-15T18:31:32.392 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-15T18:31:32.392 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-12-15T18:31:32.392 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-15T18:31:32.392 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2023-12-15T18:31:32.392 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-15T18:31:32.393 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-15T18:31:32.393 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-15T18:31:32.393 INFO:teuthology.provision.fog.smithi102:Deploy complete! 2023-12-15T18:31:32.393 DEBUG:teuthology.parallel:result is None 2023-12-15T18:31:32.544 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com 2023-12-15T18:31:32.544 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-15T18:31:32.563 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com 2023-12-15T18:31:32.563 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-15T18:31:32.581 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2023-12-15T18:31:32.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-15T18:31:32.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T18:31:32.651 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-12-15T18:31:32.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-15T18:31:32.789 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2023-12-15T18:31:32.849 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2023-12-15T18:31:32.849 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-12-15T18:31:32.909 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2023-12-15T18:31:32.909 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8" 2023-12-15T18:31:32.909 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2023-12-15T18:31:32.909 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2023-12-15T18:31:32.909 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8" 2023-12-15T18:31:32.909 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-12-15T18:31:32.909 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-15T18:31:32.909 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-12-15T18:31:32.909 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-15T18:31:32.910 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2023-12-15T18:31:32.910 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-15T18:31:32.910 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-15T18:31:32.910 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-15T18:31:32.910 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-12-15T18:31:32.930 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server 2023-12-15T18:31:32.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-12-15T18:31:32.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-15T18:31:32.996 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-12-15T18:31:33.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-12-15T18:31:33.070 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2023-12-15T18:31:33.130 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2023-12-15T18:31:33.130 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-12-15T18:31:33.189 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2023-12-15T18:31:33.189 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8" 2023-12-15T18:31:33.189 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2023-12-15T18:31:33.189 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2023-12-15T18:31:33.189 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8" 2023-12-15T18:31:33.189 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-12-15T18:31:33.189 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-15T18:31:33.190 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-12-15T18:31:33.190 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-15T18:31:33.190 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2023-12-15T18:31:33.190 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-15T18:31:33.190 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-15T18:31:33.190 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-15T18:31:33.190 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-12-15T18:31:33.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T18:31:33.305 INFO:teuthology.dispatcher.supervisor:Running job 7493240 2023-12-15T18:31:33.305 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493240 --name cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi --description rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} -- /home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493240/orig.config.yaml 2023-12-15T18:31:33.308 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493240 2023-12-15T18:31:33.308 INFO:teuthology.dispatcher.supervisor:Job PID: 3125821 2023-12-15T18:31:33.308 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-15T18:33:33.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T18:35:33.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T18:37:33.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T18:39:33.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T18:41:33.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T18:43:33.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T18:45:33.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T18:47:33.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T18:49:33.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T18:51:33.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T18:53:34.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T18:55:34.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T18:57:34.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T18:59:34.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:01:34.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:03:34.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:05:34.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:07:34.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:09:34.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:11:34.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:13:34.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:15:34.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:17:34.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:19:34.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:21:35.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:23:35.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:25:35.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:27:35.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:29:35.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:31:35.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:33:35.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:35:35.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:37:35.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:39:35.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:41:35.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:43:35.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:45:35.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:47:36.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:49:36.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:51:36.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:53:36.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:55:36.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:57:36.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T19:59:36.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:01:36.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:03:36.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:05:36.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:07:36.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:09:36.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:11:36.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:13:37.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:15:37.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:17:37.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:19:37.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:21:37.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:23:37.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:25:37.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:27:37.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:29:37.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:31:37.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:33:37.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:35:37.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:37:37.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:39:37.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:41:37.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:43:38.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:45:38.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:47:38.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:49:38.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:51:38.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:53:38.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:55:38.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:57:38.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T20:59:38.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:01:38.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:03:38.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:05:38.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:07:38.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:09:39.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:11:39.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:13:39.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:15:39.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:17:39.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:19:39.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:21:39.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:23:39.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:25:39.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:27:39.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:29:39.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:31:39.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:33:39.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:35:39.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:37:40.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:39:40.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:41:40.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:43:40.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:45:40.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:47:40.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:49:40.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:51:40.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:53:40.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:55:40.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:57:40.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T21:59:40.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:01:40.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:03:41.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:05:41.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:07:41.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:09:41.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:11:41.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:13:41.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:15:41.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:17:41.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:19:41.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:21:41.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:23:41.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:25:41.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:27:41.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:29:42.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:31:42.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:33:42.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:35:42.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:37:42.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:39:42.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:41:42.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:43:42.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:45:42.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:47:42.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:49:42.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:51:42.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:53:42.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:55:43.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:57:43.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T22:59:43.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:01:43.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:03:43.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:05:43.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:07:43.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:09:43.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:11:43.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:13:43.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:15:43.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:17:43.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:19:43.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:21:44.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:23:44.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:25:44.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:27:44.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:29:44.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:31:44.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:33:44.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:35:44.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:37:44.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:39:44.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:41:45.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:43:45.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:45:45.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:47:45.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:49:45.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:51:45.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:53:45.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:55:45.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:57:45.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-15T23:59:45.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:01:45.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:03:45.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:05:46.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:07:46.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:09:46.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:11:46.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:13:46.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:15:46.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:17:46.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:19:46.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:21:46.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:23:46.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:25:46.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:27:47.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:29:47.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:31:47.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:33:47.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:35:47.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:37:47.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:39:47.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:41:47.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:43:47.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:45:47.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:47:47.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:49:47.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:51:47.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:53:47.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:55:48.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:57:48.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:59:48.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:01:48.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:03:48.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:05:48.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:07:48.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:09:48.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:11:48.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:13:48.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:15:48.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:17:48.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:19:48.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:21:48.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:23:49.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:25:49.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:27:49.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:29:49.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:31:49.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:33:49.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:35:49.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:37:49.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:39:49.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:41:49.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:43:49.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:45:49.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:47:49.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:49:49.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:51:49.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:53:50.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:55:50.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:57:50.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T01:59:50.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:01:50.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:03:50.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:05:50.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:07:50.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:09:50.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:11:50.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:13:50.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:15:50.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:17:50.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:19:50.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:21:51.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:23:51.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:25:51.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:27:51.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:29:51.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:31:51.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:33:51.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:35:51.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:37:51.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:39:51.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:41:51.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:43:51.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:45:51.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:47:51.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:49:52.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:51:52.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:53:52.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:55:52.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:57:52.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T02:59:52.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:01:52.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:03:52.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:05:52.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:07:52.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:09:52.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:11:52.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:13:52.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:15:52.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:17:53.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:19:53.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:21:53.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:23:53.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:25:53.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:27:53.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:29:53.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:31:53.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:33:53.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:35:53.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:37:53.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:39:53.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:41:53.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:43:53.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:45:54.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:47:54.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:49:54.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:51:54.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:53:54.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:55:54.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:57:54.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:59:54.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:01:54.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:03:54.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:05:54.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:07:54.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:09:54.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:11:54.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:13:55.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:15:55.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:17:55.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:19:55.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:21:55.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:23:55.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:25:55.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:27:55.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:29:55.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:31:55.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:33:55.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:35:55.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:37:55.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:39:55.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:41:56.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:43:56.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:45:56.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:47:56.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:49:56.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:51:56.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:53:56.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:55:56.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:57:56.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T04:59:56.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:01:56.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:03:56.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:05:56.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:07:56.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:09:57.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:11:57.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:13:57.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:15:57.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:17:57.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:19:57.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:21:57.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:23:57.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:25:57.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:27:57.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:29:57.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:31:57.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:33:57.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:35:57.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:37:58.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:39:58.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:41:58.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:43:58.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:45:58.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:47:58.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:49:58.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:51:58.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:53:58.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:55:58.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:57:58.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T05:59:58.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:01:58.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:03:59.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:05:59.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:07:59.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:09:59.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:11:59.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:13:59.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:15:59.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:17:59.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:19:59.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:21:59.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:23:59.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:26:00.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:28:00.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:30:00.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:32:00.245 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-12-16T06:32:00.381 INFO:teuthology.kill:Killing Pids: {3125821} 2023-12-16T06:32:01.365 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2023-12-16T06:32:01.365 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.b', 'mds.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2023-12-16T06:32:01.365 INFO:teuthology.misc:Compressing logs... 2023-12-16T06:32:01.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-16T06:32:01.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T06:32:01.443 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-12-16T06:32:01.526 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-16T06:32:01.527 DEBUG:teuthology.orchestra.run.smithi038:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T06:32:01.569 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-12-16T06:32:01.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T06:32:01.639 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-12-16T06:32:01.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-12-16T06:32:01.710 DEBUG:teuthology.orchestra.run.smithi102:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T06:32:01.786 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493240/remote/smithi038/crash 2023-12-16T06:32:01.787 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T06:32:01.828 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493240/remote/smithi102/crash 2023-12-16T06:32:01.829 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T06:32:02.023 INFO:teuthology.misc:Compressing logs... 2023-12-16T06:32:02.024 DEBUG:teuthology.orchestra.run.smithi038:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T06:32:02.027 DEBUG:teuthology.orchestra.run.smithi102:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T06:32:02.056 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T06:32:02.056 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T06:32:02.057 INFO:teuthology.orchestra.run.smithi102.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 82.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-16T06:32:02.060 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T06:32:02.060 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T06:32:02.061 INFO:teuthology.orchestra.run.smithi038.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 80.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-16T06:32:02.122 INFO:teuthology.orchestra.run.smithi102.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 90.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-16T06:32:02.189 INFO:teuthology.orchestra.run.smithi038.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 92.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-16T06:32:02.191 DEBUG:teuthology.misc:Transferring archived files from smithi038:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493240/remote/smithi038/ 2023-12-16T06:32:02.191 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T06:32:02.285 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493240/remote/smithi102/ 2023-12-16T06:32:02.285 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T06:32:02.325 INFO:teuthology.misc:Compressing logs... 2023-12-16T06:32:02.326 DEBUG:teuthology.orchestra.run.smithi038:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T06:32:02.328 DEBUG:teuthology.orchestra.run.smithi102:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T06:32:02.360 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-16T06:32:02.361 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-16T06:32:02.361 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.2.log 2023-12-16T06:32:02.361 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mgr.y.log 2023-12-16T06:32:02.362 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-volume.log: 91.0% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-16T06:32:02.362 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.3.log 2023-12-16T06:32:02.363 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.0.log 2023-12-16T06:32:02.363 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mgr.y.log: /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mds.a.log 2023-12-16T06:32:02.363 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mon.a.log 2023-12-16T06:32:02.364 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mds.a.log: 13.4% -- replaced with /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mds.a.log.gz 2023-12-16T06:32:02.365 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mon.a.log: 91.3% -- replaced with /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-16T06:32:02.366 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mon.c.log 2023-12-16T06:32:02.366 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.1.log 2023-12-16T06:32:02.389 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-16T06:32:02.389 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.6.log 2023-12-16T06:32:02.389 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-16T06:32:02.389 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.7.log 2023-12-16T06:32:02.391 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.6.log: /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mgr.x.log 2023-12-16T06:32:02.391 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.7.log: 91.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-16T06:32:02.391 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mon.b.log 2023-12-16T06:32:02.391 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mds.b.log 2023-12-16T06:32:02.391 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mgr.x.log: /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.4.log 2023-12-16T06:32:02.391 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mds.b.log: 14.0% -- replaced with /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mds.b.log.gz 2023-12-16T06:32:02.394 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.5.log 2023-12-16T06:32:02.394 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.5.log: 91.4% -- replaced with /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-16T06:32:02.424 INFO:teuthology.orchestra.run.smithi102.stderr: 94.6% -- replaced with /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mgr.x.log.gz 2023-12-16T06:32:03.911 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mon.c.log: /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.1.log: gzip: /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mgr.y.log: file size changed while zipping 2023-12-16T06:32:03.911 INFO:teuthology.orchestra.run.smithi038.stderr: 90.0% -- replaced with /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mgr.y.log.gz 2023-12-16T06:32:04.843 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mon.c.log: file size changed while zipping 2023-12-16T06:32:04.844 INFO:teuthology.orchestra.run.smithi038.stderr: 92.3% -- replaced with /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mon.c.log.gz 2023-12-16T06:32:04.857 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mon.b.log: file size changed while zipping 2023-12-16T06:32:04.858 INFO:teuthology.orchestra.run.smithi102.stderr: 93.1% -- replaced with /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mon.b.log.gz 2023-12-16T06:32:05.935 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.4.log: file size changed while zipping 2023-12-16T06:32:05.936 INFO:teuthology.orchestra.run.smithi102.stderr: 93.3% -- replaced with /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.4.log.gz 2023-12-16T06:32:05.952 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.2.log: file size changed while zipping 2023-12-16T06:32:05.952 INFO:teuthology.orchestra.run.smithi038.stderr: 92.9% -- replaced with /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.2.log.gz 2023-12-16T06:32:06.394 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.6.log: file size changed while zipping 2023-12-16T06:32:06.395 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.6.log.gz 2023-12-16T06:32:06.768 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.7.log: file size changed while zipping 2023-12-16T06:32:06.769 INFO:teuthology.orchestra.run.smithi102.stderr: 93.9% -- replaced with /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.7.log.gz 2023-12-16T06:32:07.569 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.1.log: file size changed while zipping 2023-12-16T06:32:07.569 INFO:teuthology.orchestra.run.smithi038.stderr: 93.3% -- replaced with /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.1.log.gz 2023-12-16T06:32:07.598 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.5.log: file size changed while zipping 2023-12-16T06:32:07.598 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.5.log.gz 2023-12-16T06:32:07.768 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.3.log: file size changed while zipping 2023-12-16T06:32:07.768 INFO:teuthology.orchestra.run.smithi038.stderr: 93.3% -- replaced with /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.3.log.gz 2023-12-16T06:32:07.947 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.0.log: file size changed while zipping 2023-12-16T06:32:07.947 INFO:teuthology.orchestra.run.smithi038.stderr: 93.5% -- replaced with /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-osd.0.log.gz 2023-12-16T06:32:08.160 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mon.a.log: file size changed while zipping 2023-12-16T06:32:08.160 INFO:teuthology.orchestra.run.smithi038.stderr: 89.9% -- replaced with /var/log/ceph/1743023e-9b7a-11ee-95a5-87774f69a715/ceph-mon.a.log.gz 2023-12-16T06:32:08.162 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/log/ceph to /home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493240/remote/smithi038/log 2023-12-16T06:32:08.163 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T06:32:33.438 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493240/remote/smithi102/log 2023-12-16T06:32:33.440 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T06:32:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:tar: .: file changed as we read it 2023-12-16T06:32:52.511 INFO:teuthology.kill:No teuthology processes running 2023-12-16T06:32:52.511 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 331, in run_with_watchdog kill.kill_job( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/kill.py", line 89, in kill_job if kill_processes(run_name, [job_info.get('pid')]): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/kill.py", line 210, in kill_processes if survivors: UnboundLocalError: local variable 'survivors' referenced before assignment 2023-12-16T06:32:52.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:34:52.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T06:34:52.654 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-12-16T06:34:52.763 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-16T06:34:52.764 INFO:teuthology.nuke:Checking targets against current locks 2023-12-16T06:34:52.813 DEBUG:teuthology.nuke:shortname: smithi038 2023-12-16T06:34:52.813 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T06:34:52.834 DEBUG:teuthology.nuke:shortname: smithi102 2023-12-16T06:34:52.834 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T06:34:52.837 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493240', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-15 18:26:22.842102', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMtO/6g6wfRlwJkWT5o8dqdBpTIEZs2k7IiNBz7WPUY2b1ZhY7RsfBqia5ZxtwocL+nRLcnHJZxK4HhGAyafQME='} 2023-12-16T06:34:52.859 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493240', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-15 18:26:22.844094', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNV2PMVr+u4GQifUyOKR21MC8YbGVafaEi/7VwHeOX6Ct7VO7QviLtCYOOuQVeMZUJzU7Nb1KOjzHK+EwjBiJp8='} 2023-12-16T06:34:52.889 INFO:teuthology.orchestra.console.smithi038:Power off 2023-12-16T06:34:52.889 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T06:34:52.913 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2023-12-16T06:34:52.913 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T06:34:52.928 INFO:teuthology.orchestra.console.smithi102:Power off 2023-12-16T06:34:52.929 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T06:34:52.935 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-12-16T06:34:52.953 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-12-16T06:34:52.953 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T06:34:52.976 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-12-16T06:34:56.936 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T06:34:56.977 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T06:34:57.046 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-12-16T06:34:57.088 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-12-16T06:35:01.047 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T06:35:01.088 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T06:35:01.158 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-12-16T06:35:01.198 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-12-16T06:35:01.299 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-12-16T06:35:01.459 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com 2023-12-16T06:35:05.159 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T06:35:05.269 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-12-16T06:35:05.370 INFO:teuthology.orchestra.console.smithi038:Power off completed 2023-12-16T06:35:05.525 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com