2024-01-11T17:11:10.189 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-11T17:11:10.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:11:10.366 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2d0e157c10>, signals=[15]) 2024-01-11T17:11:10.367 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2024-01-11T17:11:10.367 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2024-01-11T17:11:10.367 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-01-11T17:11:10.394 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2024-01-11T17:11:10.394 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2024-01-11T17:11:10.394 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-01-11T17:11:10.418 INFO:teuthology.lock.ops:Start node 'smithi135.front.sepia.ceph.com' reimaging 2024-01-11T17:11:10.418 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: reset os type and version on server 2024-01-11T17:11:10.418 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-01-11T17:11:10.506 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-11T17:11:10.530 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-11T17:11:10.546 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of rhel 8.6 2024-01-11T17:11:10.552 DEBUG:teuthology.provision.fog.smithi135:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-11T17:11:10.574 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of rhel 8.6 2024-01-11T17:11:10.598 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of rhel 8.6 2024-01-11T17:11:11.084 INFO:teuthology.orchestra.console.smithi099:Power off 2024-01-11T17:11:11.085 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T17:11:11.101 INFO:teuthology.orchestra.console.smithi102:Power off 2024-01-11T17:11:11.101 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T17:11:11.117 INFO:teuthology.orchestra.console.smithi135:Power off 2024-01-11T17:11:11.117 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T17:11:11.124 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2024-01-11T17:11:11.125 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:11:11.131 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2024-01-11T17:11:11.132 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:11:11.139 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2024-01-11T17:11:11.139 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:11:11.147 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-01-11T17:11:11.151 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2024-01-11T17:11:11.161 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-01-11T17:11:11.248 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-01-11T17:11:11.252 INFO:teuthology.orchestra.console.smithi102:Power off completed 2024-01-11T17:11:11.349 INFO:teuthology.orchestra.console.smithi099:Power on 2024-01-11T17:11:11.350 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-11T17:11:11.357 INFO:teuthology.orchestra.console.smithi102:Power on 2024-01-11T17:11:11.357 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-11T17:11:11.371 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2024-01-11T17:11:11.371 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:11:11.379 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On 2024-01-11T17:11:11.380 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:11:11.392 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-01-11T17:11:11.399 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2024-01-11T17:11:15.164 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:11:15.273 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-01-11T17:11:15.393 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:11:15.400 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:11:15.502 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-01-11T17:11:15.508 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2024-01-11T17:11:15.604 INFO:teuthology.orchestra.console.smithi099:Power on completed 2024-01-11T17:11:15.609 INFO:teuthology.orchestra.console.smithi102:Power on completed 2024-01-11T17:11:15.705 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2024-01-11T17:11:15.710 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2024-01-11T17:11:19.276 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:11:19.385 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-01-11T17:11:23.390 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:11:23.498 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2024-01-11T17:11:23.599 INFO:teuthology.orchestra.console.smithi135:Power off completed 2024-01-11T17:11:23.699 INFO:teuthology.orchestra.console.smithi135:Power on 2024-01-11T17:11:23.700 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-11T17:11:23.722 DEBUG:teuthology.orchestra.console.smithi135:power on output: Chassis Power Control: Up/On 2024-01-11T17:11:23.723 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:11:23.742 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2024-01-11T17:11:27.747 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:11:27.856 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-01-11T17:11:27.956 INFO:teuthology.orchestra.console.smithi135:Power on completed 2024-01-11T17:11:28.057 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish 2024-01-11T17:14:01.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:14:01.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:14:04.572 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-11T17:14:04.572 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-11T17:14:10.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:14:10.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:14:13.660 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-11T17:14:13.661 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-11T17:14:13.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:14:16.992 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-01-11T17:14:19.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:14:19.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:14:22.720 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-11T17:14:22.721 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-11T17:14:22.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:14:26.044 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-01-11T17:14:28.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:14:28.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:14:31.804 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-11T17:14:31.804 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-11T17:14:32.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:14:35.103 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-01-11T17:14:37.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:14:37.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:14:40.860 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-11T17:14:40.860 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-11T17:14:41.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:14:44.156 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-01-11T17:14:46.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:14:46.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:14:49.916 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-11T17:14:49.916 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-11T17:14:50.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:14:53.216 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-01-11T17:14:55.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:14:55.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:14:58.972 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-11T17:14:59.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:15:02.272 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-01-11T17:15:04.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:15:08.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:15:23.324 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-11T17:15:29.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:15:32.384 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-11T17:15:38.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:15:41.468 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-11T17:15:47.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:15:48.331 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-11T17:15:48.331 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-11T17:15:55.924 WARNING:teuthology.provision.fog.smithi102:timed out 2024-01-11T17:16:01.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:16:02.168 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-11T17:16:02.168 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-11T17:16:02.444 INFO:teuthology.provision.fog.smithi102:Node is ready 2024-01-11T17:16:02.444 DEBUG:teuthology.orchestra.run.smithi102:> hostname 2024-01-11T17:16:02.463 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com 2024-01-11T17:16:02.464 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts 2024-01-11T17:16:02.523 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102 2024-01-11T17:16:02.523 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2024-01-11T17:16:02.658 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts 2024-01-11T17:16:02.688 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts 2024-01-11T17:16:02.756 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname 2024-01-11T17:16:02.824 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2024-01-11T17:16:02.891 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-01-11T17:16:02.948 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux" 2024-01-11T17:16:02.948 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.6 (Ootpa)" 2024-01-11T17:16:02.948 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel" 2024-01-11T17:16:02.948 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora" 2024-01-11T17:16:02.948 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.6" 2024-01-11T17:16:02.949 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2024-01-11T17:16:02.949 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-11T17:16:02.949 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-01-11T17:16:02.949 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-11T17:16:02.949 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/" 2024-01-11T17:16:02.949 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-11T17:16:02.949 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T17:16:02.949 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-01-11T17:16:02.949 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T17:16:02.949 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-11T17:16:02.949 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-11T17:16:02.949 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-11T17:16:02.950 INFO:teuthology.provision.fog.smithi102:Deploy complete! 2024-01-11T17:16:02.951 DEBUG:teuthology.parallel:result is None 2024-01-11T17:16:03.986 INFO:teuthology.provision.fog.smithi099:Node is ready 2024-01-11T17:16:03.987 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2024-01-11T17:16:04.007 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2024-01-11T17:16:04.007 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2024-01-11T17:16:04.067 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2024-01-11T17:16:04.067 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-01-11T17:16:04.198 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2024-01-11T17:16:04.227 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2024-01-11T17:16:04.297 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2024-01-11T17:16:04.365 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-01-11T17:16:04.434 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-01-11T17:16:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux" 2024-01-11T17:16:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.6 (Ootpa)" 2024-01-11T17:16:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel" 2024-01-11T17:16:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora" 2024-01-11T17:16:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.6" 2024-01-11T17:16:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2024-01-11T17:16:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-11T17:16:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-01-11T17:16:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-11T17:16:04.493 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/" 2024-01-11T17:16:04.493 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-11T17:16:04.493 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T17:16:04.493 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-11T17:16:04.493 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T17:16:04.493 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-11T17:16:04.493 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-11T17:16:04.493 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-11T17:16:04.493 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2024-01-11T17:16:04.494 DEBUG:teuthology.parallel:result is None 2024-01-11T17:16:08.283 WARNING:teuthology.provision.fog.smithi135:timed out 2024-01-11T17:16:14.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:16:14.531 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-11T17:16:14.532 DEBUG:teuthology.orchestra.run.smithi135:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-11T17:16:14.845 INFO:teuthology.provision.fog.smithi135:Node is ready 2024-01-11T17:16:14.845 DEBUG:teuthology.orchestra.run.smithi135:> hostname 2024-01-11T17:16:14.863 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135.front.sepia.ceph.com 2024-01-11T17:16:14.863 DEBUG:teuthology.orchestra.run.smithi135:> grep smithi135.front.sepia.ceph.com /etc/hosts 2024-01-11T17:16:14.921 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135 2024-01-11T17:16:14.921 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2024-01-11T17:16:15.042 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hosts 2024-01-11T17:16:15.073 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/172.21.15.135/172.21.15.135/g' /etc/hosts 2024-01-11T17:16:15.140 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hostname 2024-01-11T17:16:15.207 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2024-01-11T17:16:15.273 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-01-11T17:16:15.330 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux" 2024-01-11T17:16:15.330 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.6 (Ootpa)" 2024-01-11T17:16:15.330 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel" 2024-01-11T17:16:15.330 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora" 2024-01-11T17:16:15.330 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.6" 2024-01-11T17:16:15.330 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2024-01-11T17:16:15.330 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-11T17:16:15.330 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-01-11T17:16:15.330 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-11T17:16:15.330 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/" 2024-01-11T17:16:15.330 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-11T17:16:15.330 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T17:16:15.331 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-01-11T17:16:15.331 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T17:16:15.331 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-11T17:16:15.331 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-11T17:16:15.331 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-11T17:16:15.331 INFO:teuthology.provision.fog.smithi135:Deploy complete! 2024-01-11T17:16:15.332 DEBUG:teuthology.parallel:result is None 2024-01-11T17:16:15.520 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2024-01-11T17:16:15.521 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-11T17:16:15.539 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com 2024-01-11T17:16:15.540 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-11T17:16:15.556 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com 2024-01-11T17:16:15.556 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-11T17:16:15.582 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2024-01-11T17:16:15.582 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-11T17:16:15.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:16:15.658 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-01-11T17:16:15.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-11T17:16:15.793 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-01-11T17:16:15.854 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-01-11T17:16:15.854 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-01-11T17:16:15.915 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux" 2024-01-11T17:16:15.915 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.6 (Ootpa)" 2024-01-11T17:16:15.915 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel" 2024-01-11T17:16:15.915 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora" 2024-01-11T17:16:15.916 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.6" 2024-01-11T17:16:15.916 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2024-01-11T17:16:15.916 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-11T17:16:15.916 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-01-11T17:16:15.916 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-11T17:16:15.916 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/" 2024-01-11T17:16:15.916 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-11T17:16:15.916 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T17:16:15.916 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-11T17:16:15.916 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T17:16:15.916 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-11T17:16:15.916 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-11T17:16:15.916 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-11T17:16:15.917 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-01-11T17:16:15.939 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server 2024-01-11T17:16:15.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-01-11T17:16:15.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:16:16.011 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-01-11T17:16:16.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-01-11T17:16:16.155 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-01-11T17:16:16.214 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-01-11T17:16:16.214 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-01-11T17:16:16.272 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux" 2024-01-11T17:16:16.272 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.6 (Ootpa)" 2024-01-11T17:16:16.273 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel" 2024-01-11T17:16:16.273 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora" 2024-01-11T17:16:16.273 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.6" 2024-01-11T17:16:16.273 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2024-01-11T17:16:16.273 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-11T17:16:16.273 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-01-11T17:16:16.273 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-11T17:16:16.273 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/" 2024-01-11T17:16:16.273 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-11T17:16:16.273 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T17:16:16.273 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-01-11T17:16:16.273 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T17:16:16.273 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-11T17:16:16.274 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-11T17:16:16.274 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-11T17:16:16.274 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-01-11T17:16:16.297 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server 2024-01-11T17:16:16.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-01-11T17:16:16.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:16:16.370 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-01-11T17:16:16.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-01-11T17:16:16.394 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-01-11T17:16:16.451 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-01-11T17:16:16.451 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-01-11T17:16:16.508 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux" 2024-01-11T17:16:16.508 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.6 (Ootpa)" 2024-01-11T17:16:16.508 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel" 2024-01-11T17:16:16.508 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora" 2024-01-11T17:16:16.509 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.6" 2024-01-11T17:16:16.509 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2024-01-11T17:16:16.509 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-11T17:16:16.509 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-01-11T17:16:16.509 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-11T17:16:16.509 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/" 2024-01-11T17:16:16.509 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-11T17:16:16.509 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T17:16:16.509 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-01-11T17:16:16.509 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T17:16:16.509 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-11T17:16:16.509 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-11T17:16:16.509 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-11T17:16:16.510 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-01-11T17:16:16.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:16:16.637 INFO:teuthology.dispatcher.supervisor:Running job 7511468 2024-01-11T17:16:16.637 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511468 --name vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/misc}} -- /home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511468/orig.config.yaml 2024-01-11T17:16:16.640 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511468 2024-01-11T17:16:16.640 INFO:teuthology.dispatcher.supervisor:Job PID: 3278248 2024-01-11T17:16:16.640 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-11T17:18:16.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:20:16.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:22:17.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:24:17.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:26:17.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:28:17.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:30:17.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:32:17.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:34:18.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:36:18.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:38:18.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:40:18.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:42:18.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:44:18.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:46:19.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:48:19.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:50:19.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:52:19.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:54:19.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:56:19.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:58:20.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:00:20.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:02:20.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:04:20.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:06:20.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:08:20.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:10:21.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:12:21.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:14:21.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:16:21.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:18:21.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:20:21.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:22:22.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:24:22.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:26:22.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:28:22.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:30:22.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:32:22.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:34:23.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:36:23.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:38:23.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:40:23.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:42:23.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:44:23.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:46:23.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:48:24.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:50:24.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:52:24.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:54:24.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:56:24.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:58:25.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:00:25.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:02:25.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:04:25.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:06:25.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:08:25.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:10:26.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:12:26.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:14:26.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:16:26.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:18:26.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:20:26.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:22:27.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:24:27.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:26:27.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:28:27.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:30:27.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:32:27.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:34:28.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:36:28.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:38:28.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:40:28.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:42:28.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:44:28.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:46:29.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:48:29.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:50:29.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:52:29.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:54:29.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:56:29.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T19:58:30.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:00:30.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:02:30.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:04:30.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:06:30.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:08:30.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:10:31.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:12:31.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:14:31.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:16:31.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:18:31.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:20:31.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:22:32.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:24:32.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:26:32.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:28:32.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:30:32.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:32:32.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:34:33.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:36:33.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:38:33.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:40:33.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:42:33.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:44:33.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:46:34.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:48:34.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:50:34.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:52:34.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:54:34.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:56:35.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T20:58:35.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:00:35.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:02:35.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:04:35.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:06:35.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:08:36.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:10:36.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:12:36.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:14:36.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:16:36.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:18:36.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:20:37.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:22:37.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:24:37.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:26:37.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:28:37.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:30:37.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:32:38.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:34:38.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:36:38.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:38:38.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:40:38.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:42:38.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:44:39.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:46:39.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:48:39.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:50:39.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:52:39.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:54:39.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:56:40.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T21:58:40.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:00:40.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:02:40.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:04:40.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:06:40.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:08:41.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:10:41.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:12:41.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:14:41.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:16:41.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:18:41.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:20:42.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:22:42.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:24:42.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:26:42.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:28:42.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:30:42.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:32:43.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:34:43.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:36:43.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:38:43.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:40:43.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:42:43.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:44:43.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:46:44.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:48:44.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:50:44.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:52:44.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:54:44.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:56:44.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T22:58:45.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:00:45.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:02:45.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:04:45.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:06:45.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:08:45.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:10:46.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:12:46.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:14:46.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:16:46.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:18:46.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:20:46.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:22:46.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:24:47.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:26:47.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:28:47.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:30:47.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:32:47.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:34:48.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:36:48.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:38:48.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:40:48.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:42:48.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:44:48.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:46:48.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:48:49.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:50:49.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:52:49.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:54:49.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:56:49.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T23:58:50.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:00:50.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:02:50.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:04:50.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:06:50.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:08:50.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:10:51.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:12:51.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:14:51.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:16:51.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:18:51.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:20:51.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:22:52.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:24:52.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:26:52.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:28:52.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:30:52.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:32:52.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:34:53.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:36:53.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:38:53.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:40:53.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:42:53.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:44:53.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:46:54.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:48:54.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:50:54.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:52:54.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:54:54.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:56:54.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T00:58:55.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:00:55.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:02:55.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:04:55.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:06:55.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:08:55.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:10:56.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:12:56.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:14:56.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:16:56.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:18:56.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:20:56.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:22:57.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:24:57.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:26:57.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:28:57.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:30:57.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:32:57.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:34:58.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:36:58.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:38:58.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:40:58.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:42:58.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:44:58.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:46:59.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:48:59.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:50:59.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:52:59.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:54:59.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:56:59.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T01:59:00.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:01:00.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:03:00.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:05:00.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:07:00.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:09:00.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:11:01.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:13:01.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:15:01.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:17:01.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:19:01.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:21:02.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:23:02.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:25:02.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:27:02.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:29:02.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:31:02.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:33:03.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:35:03.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:37:03.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:39:03.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:41:03.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:43:04.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:45:04.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:47:04.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:49:04.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:51:04.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:53:04.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:55:05.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:57:05.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T02:59:05.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:01:05.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:03:05.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:05:05.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:07:06.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:09:06.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:11:06.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:13:06.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:15:06.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:17:06.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:19:07.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:21:07.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:23:07.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:25:07.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:27:07.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:29:07.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:31:08.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:33:08.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:35:08.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:37:08.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:39:08.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:41:08.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:43:09.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:45:09.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:47:09.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:49:09.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:51:09.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:53:10.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:55:10.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:57:10.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T03:59:10.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:01:10.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:03:10.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:05:11.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:07:11.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:09:11.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:11:11.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:13:11.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:15:11.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:17:12.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:19:12.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:21:12.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:23:12.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:25:12.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:27:12.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:29:13.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:31:13.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:33:13.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:35:13.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:37:13.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:39:14.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:41:14.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:43:14.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:45:14.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:47:14.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:49:14.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:51:15.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:53:15.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:55:15.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:57:15.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T04:59:15.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T05:01:15.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T05:03:16.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T05:05:16.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T05:07:16.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T05:09:16.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T05:11:16.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T05:13:16.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T05:15:16.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T05:17:17.125 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2024-01-12T05:17:17.287 INFO:teuthology.kill:Killing Pids: {3278248} 2024-01-12T05:17:18.410 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-01-12T05:17:18.410 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-01-12T05:17:18.410 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-01-12T05:17:18.410 INFO:teuthology.misc:Compressing logs... 2024-01-12T05:17:18.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-12T05:17:18.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-12T05:17:18.505 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-01-12T05:17:18.649 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-12T05:17:18.649 DEBUG:teuthology.orchestra.run.smithi099:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-12T05:17:18.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-01-12T05:17:18.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-12T05:17:18.750 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-01-12T05:17:18.999 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-01-12T05:17:19.000 DEBUG:teuthology.orchestra.run.smithi102:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-12T05:17:19.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-01-12T05:17:19.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-12T05:17:19.107 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-01-12T05:17:19.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-01-12T05:17:19.234 DEBUG:teuthology.orchestra.run.smithi135:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-12T05:17:19.349 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511468/remote/smithi099/crash 2024-01-12T05:17:19.350 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-12T05:17:19.430 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511468/remote/smithi102/crash 2024-01-12T05:17:19.431 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-12T05:17:19.513 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511468/remote/smithi135/crash 2024-01-12T05:17:19.514 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-12T05:17:19.592 INFO:teuthology.misc:Compressing logs... 2024-01-12T05:17:19.592 DEBUG:teuthology.orchestra.run.smithi099:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-12T05:17:19.597 DEBUG:teuthology.orchestra.run.smithi102:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-12T05:17:19.601 DEBUG:teuthology.orchestra.run.smithi135:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-12T05:17:19.665 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-12T05:17:19.666 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-12T05:17:19.669 INFO:teuthology.orchestra.run.smithi102.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 89.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-01-12T05:17:19.669 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-12T05:17:19.670 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-12T05:17:19.672 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-12T05:17:19.673 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-12T05:17:19.673 INFO:teuthology.orchestra.run.smithi135.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 89.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-01-12T05:17:19.676 INFO:teuthology.orchestra.run.smithi099.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 89.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-01-12T05:17:19.737 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-01-12T05:17:19.750 INFO:teuthology.orchestra.run.smithi099.stderr: 91.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-01-12T05:17:19.798 INFO:teuthology.orchestra.run.smithi135.stderr: 94.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-01-12T05:17:19.802 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511468/remote/smithi099/ 2024-01-12T05:17:19.803 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-12T05:17:19.885 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511468/remote/smithi102/ 2024-01-12T05:17:19.886 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-12T05:17:19.966 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511468/remote/smithi135/ 2024-01-12T05:17:19.966 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-12T05:17:20.054 INFO:teuthology.misc:Compressing logs... 2024-01-12T05:17:20.054 DEBUG:teuthology.orchestra.run.smithi099:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-12T05:17:20.059 DEBUG:teuthology.orchestra.run.smithi102:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-12T05:17:20.064 DEBUG:teuthology.orchestra.run.smithi135:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-12T05:17:20.126 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-01-12T05:17:20.127 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-01-12T05:17:20.127 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-01-12T05:17:20.128 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.7.log 2024-01-12T05:17:20.128 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mon.a.log 2024-01-12T05:17:20.128 INFO:teuthology.orchestra.run.smithi099.stderr: 90.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-01-12T05:17:20.129 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-01-12T05:17:20.129 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.1.log 2024-01-12T05:17:20.129 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-01-12T05:17:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.g.log 2024-01-12T05:17:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.j.log 2024-01-12T05:17:20.130 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.h.log 2024-01-12T05:17:20.131 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.a.log 2024-01-12T05:17:20.132 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-volume.log 2024-01-12T05:17:20.132 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-01-12T05:17:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.9.log 2024-01-12T05:17:20.134 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.k.log 2024-01-12T05:17:20.134 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.5.log 2024-01-12T05:17:20.134 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.i.log 2024-01-12T05:17:20.134 INFO:teuthology.orchestra.run.smithi135.stderr: 90.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-01-12T05:17:20.135 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.e.log 2024-01-12T05:17:20.136 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.3.log 2024-01-12T05:17:20.136 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.c.log 2024-01-12T05:17:20.136 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.f.log 2024-01-12T05:17:20.137 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-volume.log 2024-01-12T05:17:20.137 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mon.b.log 2024-01-12T05:17:20.137 INFO:teuthology.orchestra.run.smithi102.stderr: 90.9% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-volume.log.gz 2024-01-12T05:17:20.138 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mgr.z.log 2024-01-12T05:17:20.138 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.b.log 2024-01-12T05:17:20.139 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.11.log 2024-01-12T05:17:20.140 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.3.log: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.0.log 2024-01-12T05:17:20.140 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.2.log 2024-01-12T05:17:20.141 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mon.b.log: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mgr.y.log 2024-01-12T05:17:20.142 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.d.log 2024-01-12T05:17:20.142 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-volume.log 2024-01-12T05:17:20.143 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.10.log 2024-01-12T05:17:20.143 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.6.log 2024-01-12T05:17:20.145 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-volume.log.gz 2024-01-12T05:17:20.146 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.2.log: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.l.log 2024-01-12T05:17:20.149 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mgr.x.log 2024-01-12T05:17:20.149 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.6.log: 94.6% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.g.log.gz 2024-01-12T05:17:20.149 INFO:teuthology.orchestra.run.smithi099.stderr: 94.7% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.a.log.gz 2024-01-12T05:17:20.149 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mon.c.log 2024-01-12T05:17:20.150 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mgr.y.log: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.4.log 2024-01-12T05:17:20.151 INFO:teuthology.orchestra.run.smithi135.stderr: 91.1% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-volume.log.gz 2024-01-12T05:17:20.153 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-01-12T05:17:20.154 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.8.log 2024-01-12T05:17:20.155 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.4.log: 94.3% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.k.log.gz 2024-01-12T05:17:20.158 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.log: 94.6% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.j.log.gz 2024-01-12T05:17:20.163 INFO:teuthology.orchestra.run.smithi102.stderr: 94.8% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mgr.y.log.gz 2024-01-12T05:17:20.164 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mon.c.log: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.8.log: 94.8% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mgr.z.log.gz 2024-01-12T05:17:20.168 INFO:teuthology.orchestra.run.smithi099.stderr: 94.5% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.d.log.gz 2024-01-12T05:17:20.182 INFO:teuthology.orchestra.run.smithi135.stderr: 94.2% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.l.log.gz 2024-01-12T05:17:20.243 INFO:teuthology.orchestra.run.smithi099.stderr: 97.6% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-01-12T05:17:20.316 INFO:teuthology.orchestra.run.smithi102.stderr: 94.5% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.h.log.gz 2024-01-12T05:17:20.393 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.i.log: file size changed while zipping 2024-01-12T05:17:20.394 INFO:teuthology.orchestra.run.smithi135.stderr: 94.5% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.i.log.gz 2024-01-12T05:17:20.404 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.e.log: file size changed while zipping 2024-01-12T05:17:20.404 INFO:teuthology.orchestra.run.smithi102.stderr: 95.0% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.e.log.gz 2024-01-12T05:17:20.559 INFO:teuthology.orchestra.run.smithi135.stderr: 95.0% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.f.log.gz 2024-01-12T05:17:20.574 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.c.log: file size changed while zipping 2024-01-12T05:17:20.574 INFO:teuthology.orchestra.run.smithi135.stderr: 95.0% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.c.log.gz 2024-01-12T05:17:20.629 INFO:teuthology.orchestra.run.smithi102.stderr: 93.5% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mds.b.log.gz 2024-01-12T05:17:20.963 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mgr.x.log: file size changed while zipping 2024-01-12T05:17:20.964 INFO:teuthology.orchestra.run.smithi099.stderr: 91.3% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mgr.x.log.gz 2024-01-12T05:17:21.185 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mon.b.log: file size changed while zipping 2024-01-12T05:17:21.185 INFO:teuthology.orchestra.run.smithi102.stderr: 92.4% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mon.b.log.gz 2024-01-12T05:17:21.772 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mon.c.log: file size changed while zipping 2024-01-12T05:17:21.772 INFO:teuthology.orchestra.run.smithi135.stderr: 92.1% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mon.c.log.gz 2024-01-12T05:17:22.902 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.0.log: file size changed while zipping 2024-01-12T05:17:22.902 INFO:teuthology.orchestra.run.smithi099.stderr: 92.9% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.0.log.gz 2024-01-12T05:17:22.996 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.7.log: file size changed while zipping 2024-01-12T05:17:22.996 INFO:teuthology.orchestra.run.smithi102.stderr: 93.0% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.7.log.gz 2024-01-12T05:17:23.007 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.1.log: file size changed while zipping 2024-01-12T05:17:23.007 INFO:teuthology.orchestra.run.smithi102.stderr: 92.8% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.1.log.gz 2024-01-12T05:17:23.327 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.3.log: file size changed while zipping 2024-01-12T05:17:23.327 INFO:teuthology.orchestra.run.smithi099.stderr: 92.9% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.3.log.gz 2024-01-12T05:17:23.717 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.4.log: file size changed while zipping 2024-01-12T05:17:23.717 INFO:teuthology.orchestra.run.smithi102.stderr: 92.6% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.4.log.gz 2024-01-12T05:17:23.728 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.11.log: file size changed while zipping 2024-01-12T05:17:23.729 INFO:teuthology.orchestra.run.smithi135.stderr: 93.0% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.11.log.gz 2024-01-12T05:17:24.131 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.10.log: file size changed while zipping 2024-01-12T05:17:24.131 INFO:teuthology.orchestra.run.smithi102.stderr: 92.0% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.10.log.gz 2024-01-12T05:17:24.203 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mon.a.log: file size changed while zipping 2024-01-12T05:17:24.203 INFO:teuthology.orchestra.run.smithi099.stderr: 90.3% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-mon.a.log.gz 2024-01-12T05:17:24.248 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.6.log: file size changed while zipping 2024-01-12T05:17:24.248 INFO:teuthology.orchestra.run.smithi099.stderr: 92.2% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.6.log.gz 2024-01-12T05:17:24.344 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.8.log: file size changed while zipping 2024-01-12T05:17:24.344 INFO:teuthology.orchestra.run.smithi135.stderr: 92.8% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.8.log.gz 2024-01-12T05:17:24.595 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.9.log: file size changed while zipping 2024-01-12T05:17:24.595 INFO:teuthology.orchestra.run.smithi099.stderr: 92.4% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.9.log.gz 2024-01-12T05:17:24.713 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.5.log: file size changed while zipping 2024-01-12T05:17:24.713 INFO:teuthology.orchestra.run.smithi135.stderr: 93.0% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.5.log.gz 2024-01-12T05:17:25.284 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.2.log: file size changed while zipping 2024-01-12T05:17:25.284 INFO:teuthology.orchestra.run.smithi135.stderr: 92.2% -- replaced with /var/log/ceph/aab47ca4-b0a7-11ee-95ab-87774f69a715/ceph-osd.2.log.gz 2024-01-12T05:17:25.288 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511468/remote/smithi099/log 2024-01-12T05:17:25.289 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-12T05:17:58.423 INFO:teuthology.orchestra.run.smithi099.stderr:tar: .: file changed as we read it 2024-01-12T05:17:58.424 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511468/remote/smithi102/log 2024-01-12T05:17:58.425 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-12T05:18:40.293 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511468/remote/smithi135/log 2024-01-12T05:18:40.294 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-12T05:19:14.525 INFO:teuthology.kill:No teuthology processes running 2024-01-12T05:19:15.501 INFO:teuthology.kill:Nuking machines: ['smithi099', 'smithi102', 'smithi135'] 2024-01-12T05:19:16.336 INFO:teuthology.kill:2024-01-12 05:19:16,336.336 INFO:teuthology.nuke:targets: 2024-01-12T05:19:16.337 INFO:teuthology.kill: smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGecExmZdc19R7Do+PvEdN9qT9cRDFqpCir9r8PNlW4HgPbjiYzE24s4WPUWjEZboiWTgLmjX8vR9ta+kreyj7c= 2024-01-12T05:19:16.337 INFO:teuthology.kill: smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOlN4qOjijTN3xj52RfBOw4NC8KI43CCkqgqAdCbntCIHlTa/YBQaucptxdE0gSsJkzY1tBOsr5dAiGqv3QtA/A= 2024-01-12T05:19:16.337 INFO:teuthology.kill: smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDShiLJXQoAaNwfJ2kueql0zjzqqoRkA6aD3Ygsa0eciV3upC7/eQahZsNGNn0dBEwnT+wBlrZ6eatGNKSPDwY8= 2024-01-12T05:19:16.337 INFO:teuthology.kill:2024-01-12 05:19:16,336.336 INFO:teuthology.nuke:Checking targets against current locks 2024-01-12T05:19:16.392 INFO:teuthology.kill:2024-01-12 05:19:16,391.391 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-12T05:19:16.416 INFO:teuthology.kill:2024-01-12 05:19:16,416.416 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-12T05:19:16.434 INFO:teuthology.kill:2024-01-12 05:19:16,433.433 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-12T05:19:16.466 INFO:teuthology.kill:2024-01-12 05:19:16,465.465 INFO:teuthology.orchestra.console.smithi099:Power off 2024-01-12T05:19:16.500 INFO:teuthology.kill:2024-01-12 05:19:16,500.500 INFO:teuthology.orchestra.console.smithi102:Power off 2024-01-12T05:19:16.512 INFO:teuthology.kill:2024-01-12 05:19:16,512.512 INFO:teuthology.orchestra.console.smithi135:Power off 2024-01-12T05:19:24.874 INFO:teuthology.kill:2024-01-12 05:19:24,873.873 INFO:teuthology.orchestra.console.smithi135:Power off completed 2024-01-12T05:19:25.024 INFO:teuthology.kill:2024-01-12 05:19:25,023.023 INFO:teuthology.lock.ops:unlocked: smithi135.front.sepia.ceph.com 2024-01-12T05:19:28.965 INFO:teuthology.kill:2024-01-12 05:19:28,964.964 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-01-12T05:19:28.975 INFO:teuthology.kill:2024-01-12 05:19:28,975.975 INFO:teuthology.orchestra.console.smithi102:Power off completed 2024-01-12T05:19:29.123 INFO:teuthology.kill:2024-01-12 05:19:29,122.122 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com 2024-01-12T05:19:29.132 INFO:teuthology.kill:2024-01-12 05:19:29,131.131 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com 2024-01-12T05:19:29.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T05:21:29.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-12T05:21:29.499 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2024-01-12T05:21:29.648 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi102 but it was locked by another job: /home/teuthworker/archive/dis-2024-01-12_00:14:46-rbd-wip-dis-testing-distro-default-smithi/7513907 2024-01-12T05:21:29.648 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi135 but it was locked by another job: /home/teuthworker/archive/dis-2024-01-12_00:14:46-rbd-wip-dis-testing-distro-default-smithi/7513907