2023-12-07T01:46:40.365 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-07T01:46:40.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T01:46:40.583 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f97f4be9ee0>, signals=[15]) 2023-12-07T01:46:40.583 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging 2023-12-07T01:46:40.584 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server 2023-12-07T01:46:40.584 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-12-07T01:46:40.606 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2023-12-07T01:46:40.606 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2023-12-07T01:46:40.607 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-12-07T01:46:40.748 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-07T01:46:40.757 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-07T01:46:40.795 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of rhel 8.6 2023-12-07T01:46:40.801 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of rhel 8.6 2023-12-07T01:46:41.037 INFO:teuthology.orchestra.console.smithi172:Power off 2023-12-07T01:46:41.038 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-07T01:46:41.060 INFO:teuthology.orchestra.console.smithi038:Power off 2023-12-07T01:46:41.060 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-07T01:46:41.080 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-12-07T01:46:41.080 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T01:46:41.092 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2023-12-07T01:46:41.092 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T01:46:41.111 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-12-07T01:46:41.123 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-12-07T01:46:45.114 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T01:46:45.124 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T01:46:45.223 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-12-07T01:46:45.235 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-12-07T01:46:49.226 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T01:46:49.235 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T01:46:49.336 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-12-07T01:46:49.343 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-12-07T01:46:53.338 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T01:46:53.346 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T01:46:53.449 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-12-07T01:46:53.455 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-12-07T01:46:53.550 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-12-07T01:46:53.556 INFO:teuthology.orchestra.console.smithi038:Power off completed 2023-12-07T01:46:53.651 INFO:teuthology.orchestra.console.smithi172:Power on 2023-12-07T01:46:53.651 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-07T01:46:53.659 INFO:teuthology.orchestra.console.smithi038:Power on 2023-12-07T01:46:53.660 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-07T01:46:53.677 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On 2023-12-07T01:46:53.677 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T01:46:53.691 DEBUG:teuthology.orchestra.console.smithi038:power on output: Chassis Power Control: Up/On 2023-12-07T01:46:53.691 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T01:46:53.704 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-12-07T01:46:53.715 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-12-07T01:46:57.706 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T01:46:57.716 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T01:46:57.815 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-12-07T01:46:57.824 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-12-07T01:46:57.925 INFO:teuthology.orchestra.console.smithi038:Power on completed 2023-12-07T01:46:58.026 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2023-12-07T01:47:01.819 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T01:47:01.935 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-12-07T01:47:02.036 INFO:teuthology.orchestra.console.smithi172:Power on completed 2023-12-07T01:47:02.137 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2023-12-07T01:49:28.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T01:49:28.842 ERROR:teuthology.orchestra.connection:Error authenticating with smithi038.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-07T01:49:32.956 ERROR:teuthology.orchestra.connection:Error authenticating with smithi038.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-07T01:49:47.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T01:49:50.950 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-12-07T01:49:56.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T01:50:00.034 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-12-07T01:50:06.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T01:50:09.094 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-12-07T01:50:15.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T01:50:18.178 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-12-07T01:50:24.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T01:50:27.234 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-12-07T01:50:33.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T01:50:36.290 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-12-07T01:50:39.960 WARNING:teuthology.provision.fog.smithi038:timed out 2023-12-07T01:50:42.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T01:50:45.350 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-12-07T01:50:45.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T01:50:49.030 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-12-07T01:50:51.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T01:50:55.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T01:50:58.082 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-12-07T01:51:04.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T01:51:07.138 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-12-07T01:51:13.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T01:51:13.365 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-07T01:51:13.366 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-07T01:51:13.654 INFO:teuthology.provision.fog.smithi038:Node is ready 2023-12-07T01:51:13.655 DEBUG:teuthology.orchestra.run.smithi038:> hostname 2023-12-07T01:51:13.715 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2023-12-07T01:51:13.715 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts 2023-12-07T01:51:13.776 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2023-12-07T01:51:13.777 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-12-07T01:51:13.906 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts 2023-12-07T01:51:13.935 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts 2023-12-07T01:51:14.005 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname 2023-12-07T01:51:14.077 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-12-07T01:51:14.147 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-12-07T01:51:14.207 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Red Hat Enterprise Linux" 2023-12-07T01:51:14.208 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8.6 (Ootpa)" 2023-12-07T01:51:14.208 INFO:teuthology.orchestra.run.smithi038.stdout:ID="rhel" 2023-12-07T01:51:14.208 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="fedora" 2023-12-07T01:51:14.208 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8.6" 2023-12-07T01:51:14.209 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-12-07T01:51:14.209 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-07T01:51:14.209 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-12-07T01:51:14.209 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-07T01:51:14.210 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.redhat.com/" 2023-12-07T01:51:14.210 INFO:teuthology.orchestra.run.smithi038.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-07T01:51:14.210 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-07T01:51:14.210 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-07T01:51:14.211 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-07T01:51:14.211 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-07T01:51:14.211 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-07T01:51:14.212 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-07T01:51:14.212 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2023-12-07T01:51:14.214 DEBUG:teuthology.parallel:result is None 2023-12-07T01:51:51.354 WARNING:teuthology.provision.fog.smithi172:timed out 2023-12-07T01:51:57.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T01:51:57.605 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-07T01:51:57.605 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-07T01:51:57.873 INFO:teuthology.provision.fog.smithi172:Node is ready 2023-12-07T01:51:57.873 DEBUG:teuthology.orchestra.run.smithi172:> hostname 2023-12-07T01:51:57.891 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172 2023-12-07T01:51:57.891 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi172 /etc/hosts 2023-12-07T01:51:57.949 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172 2023-12-07T01:51:57.949 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-12-07T01:51:58.076 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172/smithi172/g' /etc/hosts 2023-12-07T01:51:58.104 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.172/172.21.15.172/g' /etc/hosts 2023-12-07T01:51:58.171 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172/smithi172/g' /etc/hostname 2023-12-07T01:51:58.237 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-12-07T01:51:58.304 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-12-07T01:51:58.361 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-12-07T01:51:58.361 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2023-12-07T01:51:58.361 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-12-07T01:51:58.361 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-12-07T01:51:58.361 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2023-12-07T01:51:58.361 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-12-07T01:51:58.361 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-07T01:51:58.361 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-12-07T01:51:58.361 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-07T01:51:58.361 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-12-07T01:51:58.361 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-07T01:51:58.362 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-07T01:51:58.362 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T01:51:58.362 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-07T01:51:58.362 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-07T01:51:58.362 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-07T01:51:58.362 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-07T01:51:58.362 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2023-12-07T01:51:58.363 DEBUG:teuthology.parallel:result is None 2023-12-07T01:51:58.513 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com 2023-12-07T01:51:58.514 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-07T01:51:58.544 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2023-12-07T01:51:58.544 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-07T01:51:58.562 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2023-12-07T01:51:58.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-07T01:51:58.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T01:51:58.630 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-12-07T01:51:58.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-07T01:51:58.764 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2023-12-07T01:51:58.822 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2023-12-07T01:51:58.822 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-12-07T01:51:58.880 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Red Hat Enterprise Linux" 2023-12-07T01:51:58.880 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8.6 (Ootpa)" 2023-12-07T01:51:58.880 INFO:teuthology.orchestra.run.smithi038.stdout:ID="rhel" 2023-12-07T01:51:58.880 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="fedora" 2023-12-07T01:51:58.880 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8.6" 2023-12-07T01:51:58.880 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-12-07T01:51:58.880 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-07T01:51:58.880 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-12-07T01:51:58.881 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-07T01:51:58.881 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.redhat.com/" 2023-12-07T01:51:58.881 INFO:teuthology.orchestra.run.smithi038.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-07T01:51:58.881 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-07T01:51:58.881 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-07T01:51:58.881 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-07T01:51:58.881 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-07T01:51:58.881 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-07T01:51:58.881 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-07T01:51:58.882 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-12-07T01:51:58.903 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2023-12-07T01:51:58.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-12-07T01:51:58.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T01:51:58.969 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-12-07T01:51:59.039 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-12-07T01:51:59.039 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2023-12-07T01:51:59.096 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-12-07T01:51:59.096 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-12-07T01:51:59.152 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-12-07T01:51:59.153 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2023-12-07T01:51:59.153 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-12-07T01:51:59.153 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-12-07T01:51:59.153 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2023-12-07T01:51:59.153 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-12-07T01:51:59.153 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-07T01:51:59.153 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-12-07T01:51:59.153 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-07T01:51:59.153 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-12-07T01:51:59.154 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-07T01:51:59.154 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-07T01:51:59.154 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T01:51:59.154 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-07T01:51:59.154 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-07T01:51:59.154 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-07T01:51:59.154 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-07T01:51:59.155 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-12-07T01:51:59.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T01:51:59.294 INFO:teuthology.dispatcher.supervisor:Running job 7481008 2023-12-07T01:51:59.294 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481008 --name yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi --description rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} -- /home/teuthworker/archive/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481008/orig.config.yaml 2023-12-07T01:51:59.298 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481008 2023-12-07T01:51:59.298 INFO:teuthology.dispatcher.supervisor:Job PID: 163936 2023-12-07T01:51:59.298 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-07T01:53:59.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T01:55:59.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T01:57:59.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T01:59:59.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:01:59.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:03:59.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:05:59.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:07:59.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:09:59.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:11:59.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:14:00.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:16:00.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:18:00.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:20:00.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:22:00.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:24:00.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:26:00.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:28:00.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:30:00.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:32:00.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:34:00.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:36:00.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:38:00.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:40:00.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:42:01.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:44:01.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:46:01.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:48:01.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:50:01.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:52:01.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:54:01.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:56:01.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T02:58:01.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:00:01.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:02:01.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:04:01.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:06:01.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:08:02.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:10:02.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:12:02.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:14:02.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:16:02.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:18:02.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:20:02.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:22:02.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:24:02.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:26:02.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:28:02.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:30:02.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:32:02.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:34:02.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:36:03.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:38:03.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:40:03.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:42:03.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:44:03.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:46:03.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:48:03.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:50:03.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:52:03.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:54:03.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:56:03.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T03:58:03.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:00:03.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:02:03.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:04:04.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:06:04.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:08:04.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:10:04.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:12:04.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:14:04.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:16:04.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:18:04.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:20:04.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:22:04.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:24:04.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:26:04.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:28:04.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:30:04.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:32:05.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:34:05.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:36:05.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:38:05.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:40:05.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:42:05.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:44:05.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:46:05.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:48:05.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:50:05.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:52:05.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:54:05.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:56:05.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T04:58:06.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:00:06.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:02:06.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:04:06.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:06:06.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:08:06.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:10:06.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:12:06.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:14:06.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:16:06.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:18:06.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:20:06.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:22:06.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:24:07.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:26:07.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:28:07.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:30:07.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:32:07.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:34:07.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:36:07.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:38:07.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:40:07.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:42:07.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:44:07.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:46:07.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:48:07.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:50:07.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:52:07.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:54:08.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:56:08.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T05:58:08.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:00:08.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:02:08.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:04:08.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:06:08.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:08:08.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:10:08.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:12:08.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:14:08.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:16:08.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:18:08.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:20:09.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:22:09.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:24:09.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:26:09.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:28:09.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:30:09.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:32:09.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:34:09.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:36:09.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:38:09.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:40:09.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:42:09.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:44:09.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:46:10.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:48:10.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:50:10.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:52:10.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:54:10.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:56:10.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T06:58:10.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:00:10.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:02:10.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:04:10.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:06:10.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:08:10.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:10:10.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:12:11.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:14:11.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:16:11.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:18:11.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:20:11.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:22:11.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:24:11.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:26:11.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:28:11.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:30:11.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:32:11.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:34:11.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:36:11.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:38:11.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:40:12.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:42:12.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:44:12.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:46:12.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:48:12.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:50:12.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:52:12.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:54:12.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:56:12.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T07:58:12.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:00:12.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:02:12.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:04:13.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:06:13.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:08:13.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:10:13.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:12:13.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:14:13.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:16:13.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:18:13.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:20:13.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:22:13.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:24:13.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:26:14.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:28:14.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:30:14.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:32:14.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:34:14.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:36:14.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:38:14.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:40:14.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:42:14.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:44:14.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:46:14.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:48:14.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:50:15.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:52:15.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:54:15.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:56:15.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T08:58:15.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:00:15.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:02:15.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:04:15.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:06:15.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:08:15.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:10:15.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:12:15.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:14:15.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:16:16.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:18:16.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:20:16.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:22:16.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:24:16.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:26:16.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:28:16.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:30:16.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:32:16.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:34:16.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:36:16.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:38:16.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:40:16.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:42:17.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:44:17.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:46:17.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:48:17.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:50:17.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:52:17.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:54:17.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:56:17.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T09:58:17.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:00:17.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:02:17.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:04:17.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:06:17.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:08:17.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:10:18.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:12:18.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:14:18.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:16:18.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:18:18.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:20:18.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:22:18.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:24:18.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:26:18.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:28:18.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:30:18.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:32:18.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:34:18.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:36:18.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:38:19.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:40:19.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:42:19.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:44:19.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:46:19.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:48:19.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:50:19.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:52:19.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:54:19.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:56:19.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T10:58:19.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:00:19.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:02:19.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:04:19.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:06:20.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:08:20.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:10:20.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:12:20.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:14:20.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:16:20.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:18:20.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:20:20.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:22:20.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:24:20.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:26:20.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:28:20.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:30:21.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:32:21.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:34:21.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:36:21.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:38:21.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:40:21.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:42:21.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:44:21.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:46:21.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:48:21.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:50:21.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:52:21.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:54:21.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:56:22.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T11:58:22.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:00:22.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:02:22.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:04:22.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:06:22.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:08:22.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:10:22.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:12:22.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:14:22.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:16:22.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:18:22.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:20:23.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:22:23.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:24:23.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:26:23.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:28:23.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:30:23.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:32:23.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:34:23.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:36:23.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:38:23.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:40:23.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:42:23.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:44:23.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:46:23.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:48:24.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:50:24.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:52:24.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:54:24.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:56:24.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T12:58:24.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:00:24.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:02:24.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:04:24.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:06:24.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:08:24.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:10:24.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:12:24.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:14:25.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:16:25.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:18:25.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:20:25.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:22:25.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:24:25.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:26:25.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:28:25.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:30:25.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:32:25.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:34:25.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:36:26.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:38:26.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:40:26.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:42:27.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:44:27.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:46:27.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:48:27.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:50:27.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:52:27.495 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-12-07T13:52:27.634 INFO:teuthology.kill:Killing Pids: {163936} 2023-12-07T13:52:28.467 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2023-12-07T13:52:28.468 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.b', 'mds.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2023-12-07T13:52:28.468 INFO:teuthology.misc:Compressing logs... 2023-12-07T13:52:28.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-07T13:52:28.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T13:52:28.567 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-12-07T13:52:28.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-07T13:52:28.662 DEBUG:teuthology.orchestra.run.smithi038:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-07T13:52:28.704 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-12-07T13:52:28.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T13:52:28.773 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-12-07T13:52:28.846 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-12-07T13:52:28.847 DEBUG:teuthology.orchestra.run.smithi172:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-07T13:52:28.948 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481008/remote/smithi038/crash 2023-12-07T13:52:28.949 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-07T13:52:29.000 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481008/remote/smithi172/crash 2023-12-07T13:52:29.001 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-07T13:52:29.040 INFO:teuthology.misc:Compressing logs... 2023-12-07T13:52:29.041 DEBUG:teuthology.orchestra.run.smithi038:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-07T13:52:29.044 DEBUG:teuthology.orchestra.run.smithi172:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-07T13:52:29.078 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-07T13:52:29.086 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-07T13:52:29.097 INFO:teuthology.orchestra.run.smithi038.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 77.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-07T13:52:29.112 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-07T13:52:29.112 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-07T13:52:29.112 INFO:teuthology.orchestra.run.smithi172.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 79.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-07T13:52:29.179 INFO:teuthology.orchestra.run.smithi172.stderr: 90.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-07T13:52:29.244 INFO:teuthology.orchestra.run.smithi038.stderr: 92.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-07T13:52:29.246 DEBUG:teuthology.misc:Transferring archived files from smithi038:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481008/remote/smithi038/ 2023-12-07T13:52:29.246 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-07T13:52:29.335 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481008/remote/smithi172/ 2023-12-07T13:52:29.336 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-07T13:52:29.375 INFO:teuthology.misc:Compressing logs... 2023-12-07T13:52:29.375 DEBUG:teuthology.orchestra.run.smithi038:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-07T13:52:29.378 DEBUG:teuthology.orchestra.run.smithi172:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-07T13:52:29.403 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.2.log 2023-12-07T13:52:29.403 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.0.log 2023-12-07T13:52:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mds.a.log 2023-12-07T13:52:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.2.log: /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.3.log 2023-12-07T13:52:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.1.log 2023-12-07T13:52:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mds.a.log: /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.3.log: 66.8% -- replaced with /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mds.a.log.gz 2023-12-07T13:52:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mon.c.log 2023-12-07T13:52:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-07T13:52:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mon.a.log 2023-12-07T13:52:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mgr.y.log 2023-12-07T13:52:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-07T13:52:29.437 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.5.log 2023-12-07T13:52:29.437 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.6.log 2023-12-07T13:52:29.437 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.4.log 2023-12-07T13:52:29.438 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.5.log: /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mgr.x.log 2023-12-07T13:52:29.438 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-07T13:52:29.439 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.7.log 2023-12-07T13:52:29.443 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-volume.log: /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mon.b.log 2023-12-07T13:52:29.452 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mds.b.log 2023-12-07T13:52:29.452 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mds.b.log: 80.4% -- replaced with /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mds.b.log.gz 2023-12-07T13:52:29.453 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-07T13:52:29.460 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/cephadm.log: 88.6% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-07T13:52:29.468 INFO:teuthology.orchestra.run.smithi172.stderr: 91.5% -- replaced with /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-07T13:52:29.516 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mgr.y.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-07T13:52:29.610 INFO:teuthology.orchestra.run.smithi172.stderr: 93.3% -- replaced with /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mgr.x.log.gz 2023-12-07T13:52:29.718 INFO:teuthology.orchestra.run.smithi038.stderr: 91.5% -- replaced with /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-07T13:52:34.726 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mgr.y.log: file size changed while zipping 2023-12-07T13:52:34.727 INFO:teuthology.orchestra.run.smithi038.stderr: 90.4% -- replaced with /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mgr.y.log.gz 2023-12-07T13:52:38.571 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mon.c.log: file size changed while zipping 2023-12-07T13:52:38.572 INFO:teuthology.orchestra.run.smithi038.stderr: 92.3% -- replaced with /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mon.c.log.gz 2023-12-07T13:52:39.787 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mon.b.log: file size changed while zipping 2023-12-07T13:52:39.787 INFO:teuthology.orchestra.run.smithi172.stderr: 92.9% -- replaced with /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mon.b.log.gz 2023-12-07T13:52:59.008 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mon.a.log: file size changed while zipping 2023-12-07T13:52:59.009 INFO:teuthology.orchestra.run.smithi038.stderr: 90.1% -- replaced with /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-mon.a.log.gz 2023-12-07T13:53:00.404 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.6.log: file size changed while zipping 2023-12-07T13:53:00.404 INFO:teuthology.orchestra.run.smithi172.stderr: 94.1% -- replaced with /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.6.log.gz 2023-12-07T13:53:01.072 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.4.log: file size changed while zipping 2023-12-07T13:53:01.072 INFO:teuthology.orchestra.run.smithi172.stderr: 93.9% -- replaced with /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.4.log.gz 2023-12-07T13:53:03.248 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.7.log: file size changed while zipping 2023-12-07T13:53:03.249 INFO:teuthology.orchestra.run.smithi172.stderr: 94.1% -- replaced with /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.7.log.gz 2023-12-07T13:53:08.909 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.5.log: file size changed while zipping 2023-12-07T13:53:08.910 INFO:teuthology.orchestra.run.smithi172.stderr: 94.1% -- replaced with /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.5.log.gz 2023-12-07T13:53:12.966 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.3.log: file size changed while zipping 2023-12-07T13:53:12.967 INFO:teuthology.orchestra.run.smithi038.stderr: 94.0% -- replaced with /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.3.log.gz 2023-12-07T13:53:17.004 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.0.log: file size changed while zipping 2023-12-07T13:53:17.005 INFO:teuthology.orchestra.run.smithi038.stderr: 94.3% -- replaced with /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.0.log.gz 2023-12-07T13:53:19.335 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.2.log: file size changed while zipping 2023-12-07T13:53:19.335 INFO:teuthology.orchestra.run.smithi038.stderr: 93.8% -- replaced with /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.2.log.gz 2023-12-07T13:53:21.384 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.1.log: file size changed while zipping 2023-12-07T13:53:21.384 INFO:teuthology.orchestra.run.smithi038.stderr: 93.9% -- replaced with /var/log/ceph/dcc88ba0-94a4-11ee-95a2-87774f69a715/ceph-osd.1.log.gz 2023-12-07T13:53:21.386 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481008/remote/smithi038/log 2023-12-07T13:53:21.387 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-07T13:53:48.441 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481008/remote/smithi172/log 2023-12-07T13:53:48.444 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-07T13:54:08.869 INFO:teuthology.kill:No teuthology processes running 2023-12-07T13:54:08.869 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 331, in run_with_watchdog kill.kill_job( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/kill.py", line 89, in kill_job if kill_processes(run_name, [job_info.get('pid')]): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/kill.py", line 210, in kill_processes if survivors: UnboundLocalError: local variable 'survivors' referenced before assignment 2023-12-07T13:54:08.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:56:08.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T13:56:09.016 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-12-07T13:56:09.143 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-07T13:56:09.143 INFO:teuthology.nuke:Checking targets against current locks 2023-12-07T13:56:09.186 DEBUG:teuthology.nuke:shortname: smithi038 2023-12-07T13:56:09.186 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-07T13:56:09.210 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481008', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 01:46:39.069464', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-07T13:56:09.213 DEBUG:teuthology.nuke:shortname: smithi172 2023-12-07T13:56:09.214 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-07T13:56:09.235 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481008', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 01:46:39.067503', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-07T13:56:09.265 INFO:teuthology.orchestra.console.smithi038:Power off 2023-12-07T13:56:09.265 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-07T13:56:09.287 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2023-12-07T13:56:09.287 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T13:56:09.306 INFO:teuthology.orchestra.console.smithi172:Power off 2023-12-07T13:56:09.306 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-07T13:56:09.313 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-12-07T13:56:09.327 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-12-07T13:56:09.327 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T13:56:09.353 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-12-07T13:56:13.314 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T13:56:13.355 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T13:56:13.424 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-12-07T13:56:13.465 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-12-07T13:56:17.425 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T13:56:17.466 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T13:56:17.534 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-12-07T13:56:17.576 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-12-07T13:56:17.634 INFO:teuthology.orchestra.console.smithi038:Power off completed 2023-12-07T13:56:17.677 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-12-07T13:56:17.789 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com 2023-12-07T13:56:17.823 INFO:teuthology.lock.ops:unlocked: smithi172.front.sepia.ceph.com