2024-03-28T14:44:50.832 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-28T14:44:50.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T14:44:51.024 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2727a4dc10>, signals=[15]) 2024-03-28T14:44:51.025 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging 2024-03-28T14:44:51.025 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server 2024-03-28T14:44:51.025 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-03-28T14:44:51.052 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging 2024-03-28T14:44:51.052 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server 2024-03-28T14:44:51.052 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-03-28T14:44:51.076 INFO:teuthology.lock.ops:Start node 'smithi171.front.sepia.ceph.com' reimaging 2024-03-28T14:44:51.076 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: reset os type and version on server 2024-03-28T14:44:51.076 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-03-28T14:44:51.165 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_centos_9.stream (ID 10) 2024-03-28T14:44:51.184 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_centos_9.stream (ID 10) 2024-03-28T14:44:51.208 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of centos 9.stream 2024-03-28T14:44:51.217 DEBUG:teuthology.provision.fog.smithi171:Requesting image smithi_centos_9.stream (ID 10) 2024-03-28T14:44:51.230 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of centos 9.stream 2024-03-28T14:44:51.258 INFO:teuthology.provision.fog.smithi171:Scheduling deploy of centos 9.stream 2024-03-28T14:44:51.435 INFO:teuthology.orchestra.console.smithi046:Power off 2024-03-28T14:44:51.436 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-28T14:44:51.457 INFO:teuthology.orchestra.console.smithi171:Power off 2024-03-28T14:44:51.457 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-28T14:44:51.466 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2024-03-28T14:44:51.467 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T14:44:51.481 DEBUG:teuthology.orchestra.console.smithi171:power off output: Chassis Power Control: Down/Off 2024-03-28T14:44:51.481 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T14:44:51.495 INFO:teuthology.orchestra.console.smithi110:Power off 2024-03-28T14:44:51.495 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-28T14:44:51.504 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-03-28T14:44:51.506 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-03-28T14:44:51.519 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2024-03-28T14:44:51.520 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T14:44:51.544 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-03-28T14:44:55.506 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T14:44:55.513 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T14:44:55.545 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T14:44:55.615 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-03-28T14:44:55.622 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-03-28T14:44:55.654 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-03-28T14:44:59.620 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T14:44:59.627 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T14:44:59.655 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T14:44:59.729 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-03-28T14:44:59.736 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-03-28T14:44:59.764 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-03-28T14:45:03.734 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T14:45:03.741 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T14:45:03.765 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T14:45:03.844 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2024-03-28T14:45:03.851 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off 2024-03-28T14:45:03.874 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-03-28T14:45:03.945 INFO:teuthology.orchestra.console.smithi046:Power off completed 2024-03-28T14:45:03.952 INFO:teuthology.orchestra.console.smithi171:Power off completed 2024-03-28T14:45:03.976 INFO:teuthology.orchestra.console.smithi110:Power off completed 2024-03-28T14:45:04.046 INFO:teuthology.orchestra.console.smithi046:Power on 2024-03-28T14:45:04.047 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-28T14:45:04.054 INFO:teuthology.orchestra.console.smithi171:Power on 2024-03-28T14:45:04.054 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-28T14:45:04.068 DEBUG:teuthology.orchestra.console.smithi046:power on output: Chassis Power Control: Up/On 2024-03-28T14:45:04.069 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T14:45:04.079 INFO:teuthology.orchestra.console.smithi110:Power on 2024-03-28T14:45:04.079 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-28T14:45:04.086 DEBUG:teuthology.orchestra.console.smithi171:power on output: Chassis Power Control: Up/On 2024-03-28T14:45:04.086 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T14:45:04.093 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2024-03-28T14:45:04.099 DEBUG:teuthology.orchestra.console.smithi110:power on output: Chassis Power Control: Up/On 2024-03-28T14:45:04.100 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T14:45:04.109 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off 2024-03-28T14:45:04.125 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-03-28T14:45:08.094 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T14:45:08.110 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T14:45:08.126 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T14:45:08.203 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-03-28T14:45:08.219 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off 2024-03-28T14:45:08.234 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-03-28T14:45:08.304 INFO:teuthology.orchestra.console.smithi046:Power on completed 2024-03-28T14:45:08.335 INFO:teuthology.orchestra.console.smithi110:Power on completed 2024-03-28T14:45:08.405 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish 2024-03-28T14:45:08.436 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2024-03-28T14:45:12.222 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T14:45:12.331 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-03-28T14:45:12.432 INFO:teuthology.orchestra.console.smithi171:Power on completed 2024-03-28T14:45:12.532 INFO:teuthology.provision.fog.smithi171:Waiting for deploy to finish 2024-03-28T14:47:39.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:47:42.275 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-03-28T14:47:48.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:47:51.362 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-03-28T14:47:54.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:47:57.342 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-03-28T14:47:57.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:47:58.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:48:00.446 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-03-28T14:48:01.406 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-28T14:48:03.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:48:06.398 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-03-28T14:48:06.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:48:07.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:48:09.502 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-03-28T14:48:10.466 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-28T14:48:12.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:48:15.454 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-03-28T14:48:15.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:48:16.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:48:18.558 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-03-28T14:48:19.518 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-28T14:48:21.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:48:24.510 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-03-28T14:48:24.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:48:25.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:48:27.614 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-03-28T14:48:28.574 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-28T14:48:30.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:48:33.566 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-03-28T14:48:33.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:48:34.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:48:37.634 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-28T14:48:39.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:48:42.626 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-03-28T14:48:43.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:48:46.686 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-28T14:48:48.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:48:52.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:48:55.746 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-28T14:49:01.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:49:07.870 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-28T14:49:13.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:49:16.926 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-28T14:49:22.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:49:26.014 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-28T14:49:32.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:49:33.618 WARNING:teuthology.provision.fog.smithi110:timed out 2024-03-28T14:49:35.106 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-28T14:49:39.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:49:39.850 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-28T14:49:39.851 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-28T14:49:40.183 INFO:teuthology.provision.fog.smithi110:Node is ready 2024-03-28T14:49:40.183 DEBUG:teuthology.orchestra.run.smithi110:> hostname 2024-03-28T14:49:40.198 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com 2024-03-28T14:49:40.198 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts 2024-03-28T14:49:40.254 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2024-03-28T14:49:40.254 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2024-03-28T14:49:40.369 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts 2024-03-28T14:49:40.398 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts 2024-03-28T14:49:40.466 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname 2024-03-28T14:49:40.534 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2024-03-28T14:49:40.601 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-03-28T14:49:40.655 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-03-28T14:49:40.656 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2024-03-28T14:49:40.656 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-03-28T14:49:40.656 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-03-28T14:49:40.656 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2024-03-28T14:49:40.656 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2024-03-28T14:49:40.656 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-28T14:49:40.656 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-03-28T14:49:40.656 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2024-03-28T14:49:40.656 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-28T14:49:40.656 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-03-28T14:49:40.656 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-28T14:49:40.656 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-28T14:49:40.656 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-28T14:49:40.657 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2024-03-28T14:49:40.658 DEBUG:teuthology.parallel:result is None 2024-03-28T14:49:41.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:49:41.384 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-28T14:49:41.385 DEBUG:teuthology.orchestra.run.smithi171:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-28T14:49:48.632 WARNING:teuthology.provision.fog.smithi046:timed out 2024-03-28T14:49:54.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:49:54.928 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-28T14:49:54.928 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-28T14:49:55.304 INFO:teuthology.provision.fog.smithi046:Node is ready 2024-03-28T14:49:55.305 DEBUG:teuthology.orchestra.run.smithi046:> hostname 2024-03-28T14:49:55.319 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com 2024-03-28T14:49:55.320 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts 2024-03-28T14:49:55.375 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-03-28T14:49:55.375 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2024-03-28T14:49:55.491 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts 2024-03-28T14:49:55.523 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts 2024-03-28T14:49:55.595 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname 2024-03-28T14:49:55.666 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2024-03-28T14:49:55.737 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-03-28T14:49:55.793 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-03-28T14:49:55.793 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-03-28T14:49:55.793 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-03-28T14:49:55.793 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-03-28T14:49:55.793 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-03-28T14:49:55.793 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-03-28T14:49:55.793 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-28T14:49:55.793 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-03-28T14:49:55.793 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-03-28T14:49:55.794 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-28T14:49:55.794 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-03-28T14:49:55.794 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-28T14:49:55.794 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-28T14:49:55.794 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-28T14:49:55.794 INFO:teuthology.provision.fog.smithi046:Deploy complete! 2024-03-28T14:49:55.795 DEBUG:teuthology.parallel:result is None 2024-03-28T14:49:56.869 INFO:teuthology.provision.fog.smithi171:Node is ready 2024-03-28T14:49:56.869 DEBUG:teuthology.orchestra.run.smithi171:> hostname 2024-03-28T14:49:56.927 INFO:teuthology.orchestra.run.smithi171.stdout:smithi046 2024-03-28T14:49:56.927 DEBUG:teuthology.orchestra.run.smithi171:> grep smithi046 /etc/hosts 2024-03-28T14:49:56.985 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-03-28T14:49:56.986 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171 2024-03-28T14:49:57.135 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi046/smithi171/g' /etc/hosts 2024-03-28T14:49:57.167 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/172.21.15.46/172.21.15.171/g' /etc/hosts 2024-03-28T14:49:57.238 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi046/smithi171/g' /etc/hostname 2024-03-28T14:49:57.308 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171 2024-03-28T14:49:57.378 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-03-28T14:49:57.435 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream" 2024-03-28T14:49:57.435 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9" 2024-03-28T14:49:57.435 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos" 2024-03-28T14:49:57.435 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora" 2024-03-28T14:49:57.435 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9" 2024-03-28T14:49:57.435 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9" 2024-03-28T14:49:57.435 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-28T14:49:57.435 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2024-03-28T14:49:57.436 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon" 2024-03-28T14:49:57.436 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-28T14:49:57.436 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/" 2024-03-28T14:49:57.436 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-28T14:49:57.436 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-28T14:49:57.436 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-28T14:49:57.436 INFO:teuthology.provision.fog.smithi171:Deploy complete! 2024-03-28T14:49:57.437 DEBUG:teuthology.parallel:result is None 2024-03-28T14:49:57.659 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com 2024-03-28T14:49:57.659 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-28T14:49:57.689 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2024-03-28T14:49:57.689 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-28T14:49:57.713 INFO:teuthology.lock.ops:Checking smithi171.front.sepia.ceph.com 2024-03-28T14:49:57.713 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-28T14:49:57.731 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server 2024-03-28T14:49:57.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-03-28T14:49:57.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:49:57.838 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-03-28T14:49:57.907 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-03-28T14:49:57.907 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-03-28T14:49:57.965 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-03-28T14:49:57.965 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-03-28T14:49:58.022 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-03-28T14:49:58.022 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-03-28T14:49:58.022 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-03-28T14:49:58.022 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-03-28T14:49:58.022 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-03-28T14:49:58.023 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-03-28T14:49:58.023 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-28T14:49:58.023 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-03-28T14:49:58.023 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-03-28T14:49:58.023 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-28T14:49:58.023 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-03-28T14:49:58.023 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-28T14:49:58.023 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-28T14:49:58.023 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-28T14:49:58.023 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-03-28T14:49:58.055 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2024-03-28T14:49:58.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-03-28T14:49:58.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:49:58.147 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-03-28T14:49:58.321 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-03-28T14:49:58.321 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-03-28T14:49:58.375 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-03-28T14:49:58.375 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-03-28T14:49:58.430 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-03-28T14:49:58.430 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2024-03-28T14:49:58.430 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-03-28T14:49:58.430 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-03-28T14:49:58.430 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2024-03-28T14:49:58.430 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2024-03-28T14:49:58.430 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-28T14:49:58.430 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-03-28T14:49:58.431 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2024-03-28T14:49:58.431 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-28T14:49:58.431 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-03-28T14:49:58.431 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-28T14:49:58.431 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-28T14:49:58.431 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-28T14:49:58.431 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-03-28T14:49:58.447 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: set os type and version on server 2024-03-28T14:49:58.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-03-28T14:49:58.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T14:49:58.538 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-03-28T14:49:58.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-03-28T14:49:58.606 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2024-03-28T14:49:58.663 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2024-03-28T14:49:58.663 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-03-28T14:49:58.718 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream" 2024-03-28T14:49:58.719 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9" 2024-03-28T14:49:58.719 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos" 2024-03-28T14:49:58.719 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora" 2024-03-28T14:49:58.719 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9" 2024-03-28T14:49:58.719 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9" 2024-03-28T14:49:58.719 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-28T14:49:58.719 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2024-03-28T14:49:58.719 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon" 2024-03-28T14:49:58.719 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-28T14:49:58.719 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/" 2024-03-28T14:49:58.719 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-28T14:49:58.719 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-28T14:49:58.719 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-28T14:49:58.720 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-03-28T14:49:58.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T14:49:58.853 INFO:teuthology.dispatcher.supervisor:Running job 7627985 2024-03-28T14:49:58.853 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627985 --name pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/misc}} -- /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627985/orig.config.yaml 2024-03-28T14:49:58.856 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627985 2024-03-28T14:49:58.856 INFO:teuthology.dispatcher.supervisor:Job PID: 663656 2024-03-28T14:49:58.857 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-28T14:51:58.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T14:53:59.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T14:55:59.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T14:57:59.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T14:59:59.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:01:59.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:03:59.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:06:00.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:08:00.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:10:00.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:12:00.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:14:00.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:16:01.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:18:01.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:20:01.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:22:01.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:24:01.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:26:01.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:28:02.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:30:02.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:32:02.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:34:02.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:36:02.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:38:02.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:40:03.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:42:03.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:44:03.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:46:03.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:48:03.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:50:03.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:52:04.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:54:04.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:56:04.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T15:58:04.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:00:04.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:02:04.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:04:05.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:06:05.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:08:05.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:10:05.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:12:05.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:14:05.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:16:06.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:18:06.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:20:06.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:22:06.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:24:06.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:26:07.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:28:07.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:30:07.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:32:07.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:34:07.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:36:07.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:38:08.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:40:08.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:42:08.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:44:08.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:46:08.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:48:08.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:50:09.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:52:09.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:54:09.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:56:09.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T16:58:09.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:00:09.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:02:10.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:04:10.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:06:10.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:08:10.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:10:10.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:12:10.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:14:11.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:16:11.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:18:11.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:20:11.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:22:11.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:24:11.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:26:11.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:28:12.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:30:12.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:32:12.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:34:12.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:36:12.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:38:12.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:40:13.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:42:13.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:44:13.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:46:13.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:48:13.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:50:13.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:52:14.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:54:14.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:56:14.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T17:58:14.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:00:14.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:02:14.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:04:15.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:06:15.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:08:15.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:10:15.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:12:15.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:14:15.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:16:16.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:18:16.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:20:16.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:22:16.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:24:16.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:26:16.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:28:17.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:30:17.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:32:17.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:34:17.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:36:17.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:38:17.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:40:17.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:42:18.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:44:18.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:46:18.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:48:18.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:50:18.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:52:18.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:54:19.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:56:19.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T18:58:19.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:00:19.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:02:19.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:04:19.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:06:20.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:08:20.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:10:20.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:12:20.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:14:20.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:16:20.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:18:21.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:20:21.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:22:21.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:24:21.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:26:21.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:28:21.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:30:22.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:32:22.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:34:22.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:36:22.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:38:22.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:40:22.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:42:23.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:44:23.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:46:23.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:48:23.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:50:23.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:52:24.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:54:24.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:56:24.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T19:58:24.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:00:24.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:02:25.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:04:25.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:06:25.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:08:25.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:10:25.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:12:25.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:14:26.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:16:26.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:18:26.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:20:26.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:22:26.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:24:26.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:26:27.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:28:27.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:30:27.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:32:27.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:34:27.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:36:27.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:38:27.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:40:28.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:42:28.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:44:28.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:46:28.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:48:28.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:50:28.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:52:29.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:54:29.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:56:29.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T20:58:29.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:00:29.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:02:30.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:04:30.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:06:30.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:08:30.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:10:30.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:12:30.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:14:31.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:16:31.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:18:31.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:20:31.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:22:31.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:24:31.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:26:32.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:28:32.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:30:32.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:32:32.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:34:32.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:36:32.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:38:33.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:40:33.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:42:33.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:44:33.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:46:33.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:48:33.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:50:34.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:52:34.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:54:34.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:56:34.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T21:58:34.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:00:34.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:02:35.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:04:35.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:06:35.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:08:35.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:10:35.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:12:36.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:14:36.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:16:36.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:18:36.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:20:36.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:22:37.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:24:37.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:26:37.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:28:38.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:30:38.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:32:38.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:34:38.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:36:38.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:38:38.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:40:39.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:42:39.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:44:39.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:46:39.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:48:39.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:50:39.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:52:40.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:54:40.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:56:40.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T22:58:40.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:00:40.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:02:40.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:04:41.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:06:41.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:08:41.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:10:41.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:12:41.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:14:42.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:16:42.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:18:42.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:20:42.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:22:42.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:24:43.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:26:43.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:28:43.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:30:43.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:32:43.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:34:43.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:36:44.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:38:44.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:40:44.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:42:44.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:44:44.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:46:45.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:48:45.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:50:45.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:52:45.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:54:45.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:56:45.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T23:58:46.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:00:46.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:02:46.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:04:46.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:06:46.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:08:46.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:10:47.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:12:47.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:14:47.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:16:47.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:18:47.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:20:47.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:22:48.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:24:48.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:26:48.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:28:48.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:30:48.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:32:48.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:34:49.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:36:49.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:38:49.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:40:49.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:42:49.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:44:50.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:46:50.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:48:50.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:50:50.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:52:50.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:54:50.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:56:51.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T00:58:51.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:00:51.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:02:51.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:04:51.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:06:51.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:08:52.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:10:52.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:12:52.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:14:52.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:16:52.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:18:55.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:21:07.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:23:15.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:25:15.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:27:15.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:29:15.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:31:16.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:33:24.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:35:31.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:37:32.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:39:33.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:41:35.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:43:37.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:45:40.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:47:40.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:49:41.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:51:41.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:53:41.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:55:41.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:57:41.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T01:59:41.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:01:42.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:03:42.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:05:42.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:07:42.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:09:42.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:11:42.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:13:43.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:15:43.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:17:43.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:19:43.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:21:43.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:23:44.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:25:44.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:27:44.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:29:44.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:31:44.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:33:44.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:35:45.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:37:45.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:39:45.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:41:45.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:43:45.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:45:45.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:47:46.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:49:46.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:51:46.367 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2024-03-29T02:51:46.523 INFO:teuthology.kill:Killing Pids: {663656} 2024-03-29T02:51:47.788 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-03-29T02:51:47.788 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-03-29T02:51:47.788 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-03-29T02:51:47.788 INFO:teuthology.misc:Compressing logs... 2024-03-29T02:51:47.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-03-29T02:51:47.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:51:48.084 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-03-29T02:51:48.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-03-29T02:51:48.258 DEBUG:teuthology.orchestra.run.smithi046:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-29T02:51:48.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-03-29T02:51:48.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:51:48.460 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-03-29T02:51:48.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-03-29T02:51:48.581 DEBUG:teuthology.orchestra.run.smithi110:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-29T02:51:48.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-03-29T02:51:48.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:51:48.761 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-03-29T02:51:48.883 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-03-29T02:51:48.883 DEBUG:teuthology.orchestra.run.smithi171:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-29T02:51:49.016 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627985/remote/smithi046/crash 2024-03-29T02:51:49.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-29T02:51:49.066 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627985/remote/smithi110/crash 2024-03-29T02:51:49.067 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-29T02:51:49.105 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627985/remote/smithi171/crash 2024-03-29T02:51:49.106 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-29T02:51:49.159 INFO:teuthology.misc:Compressing logs... 2024-03-29T02:51:49.159 DEBUG:teuthology.orchestra.run.smithi046:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-29T02:51:49.162 DEBUG:teuthology.orchestra.run.smithi110:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-29T02:51:49.165 DEBUG:teuthology.orchestra.run.smithi171:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-29T02:51:49.199 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-29T02:51:49.199 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-29T02:51:49.200 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-29T02:51:49.201 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-29T02:51:49.201 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-29T02:51:49.202 INFO:teuthology.orchestra.run.smithi171.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-03-29T02:51:49.202 INFO:teuthology.orchestra.run.smithi171.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-03-29T02:51:49.205 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-29T02:51:49.205 INFO:teuthology.orchestra.run.smithi046.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-03-29T02:51:49.206 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-03-29T02:51:49.208 INFO:teuthology.orchestra.run.smithi110.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-03-29T02:51:49.208 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-03-29T02:51:49.211 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627985/remote/smithi046/ 2024-03-29T02:51:49.211 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-29T02:51:49.282 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627985/remote/smithi110/ 2024-03-29T02:51:49.282 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-29T02:51:49.312 DEBUG:teuthology.misc:Transferring archived files from smithi171:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627985/remote/smithi171/ 2024-03-29T02:51:49.312 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-29T02:51:49.345 INFO:teuthology.misc:Compressing logs... 2024-03-29T02:51:49.345 DEBUG:teuthology.orchestra.run.smithi046:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-29T02:51:49.348 DEBUG:teuthology.orchestra.run.smithi110:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-29T02:51:49.356 DEBUG:teuthology.orchestra.run.smithi171:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-29T02:51:49.375 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-29T02:51:49.375 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.6.log 2024-03-29T02:51:49.375 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mon.a.log 2024-03-29T02:51:49.376 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.audit.log 2024-03-29T02:51:49.376 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.g.log 2024-03-29T02:51:49.376 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.j.log 2024-03-29T02:51:49.376 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.3.log 2024-03-29T02:51:49.377 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mgr.x.log 2024-03-29T02:51:49.377 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.0.log 2024-03-29T02:51:49.377 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.cephadm.log 2024-03-29T02:51:49.377 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.log 2024-03-29T02:51:49.378 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-volume.log 2024-03-29T02:51:49.378 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.9.log 2024-03-29T02:51:49.378 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.d.log 2024-03-29T02:51:49.379 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.a.log 2024-03-29T02:51:49.379 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-03-29T02:51:49.381 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-29T02:51:49.381 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.10.log 2024-03-29T02:51:49.383 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.audit.log 2024-03-29T02:51:49.383 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.b.log 2024-03-29T02:51:49.383 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.10.log: gzip -5/var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.audit.log: --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.4.log 2024-03-29T02:51:49.383 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.1.log 2024-03-29T02:51:49.386 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.k.log 2024-03-29T02:51:49.386 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.h.log 2024-03-29T02:51:49.386 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.1.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.k.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.7.log 2024-03-29T02:51:49.386 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.e.log 2024-03-29T02:51:49.386 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mgr.y.log 2024-03-29T02:51:49.386 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.cephadm.log 2024-03-29T02:51:49.386 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.e.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.log 2024-03-29T02:51:49.387 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-volume.log 2024-03-29T02:51:49.387 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mon.b.log 2024-03-29T02:51:49.416 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-29T02:51:49.416 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.l.log 2024-03-29T02:51:49.416 INFO:teuthology.orchestra.run.smithi171.stderr:gzip/var/log/ceph/cephadm.log: -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.audit.log 2024-03-29T02:51:49.416 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.i.log 2024-03-29T02:51:49.417 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.11.log 2024-03-29T02:51:49.417 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mgr.z.log 2024-03-29T02:51:49.417 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.8.log 2024-03-29T02:51:49.417 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.5.log 2024-03-29T02:51:49.418 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.f.log 2024-03-29T02:51:49.418 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.cephadm.log 2024-03-29T02:51:49.418 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.log 2024-03-29T02:51:49.418 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.2.log 2024-03-29T02:51:49.419 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.c.log 2024-03-29T02:51:49.419 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-volume.log 2024-03-29T02:51:49.419 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mon.c.log 2024-03-29T02:51:49.556 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.6.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mon.a.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.audit.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.g.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.j.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.3.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mgr.x.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.0.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.cephadm.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-volume.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.9.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.d.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.a.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-03-29T02:51:49.622 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.l.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.audit.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.i.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.11.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mgr.z.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.8.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.5.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.f.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.cephadm.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.2.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.c.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-volume.log: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mon.c.log: 90.4% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.cephadm.log.gz 2024-03-29T02:51:49.641 INFO:teuthology.orchestra.run.smithi171.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-29T02:51:49.653 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mon.b.log: 90.4% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.cephadm.log.gz 2024-03-29T02:51:49.657 INFO:teuthology.orchestra.run.smithi171.stderr: 92.4% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.audit.log.gz 2024-03-29T02:51:49.679 INFO:teuthology.orchestra.run.smithi110.stderr: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-29T02:51:49.841 INFO:teuthology.orchestra.run.smithi046.stderr: 92.3% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.audit.log.gz 2024-03-29T02:51:49.871 INFO:teuthology.orchestra.run.smithi046.stderr: 90.2% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.cephadm.log.gz 2024-03-29T02:51:49.879 INFO:teuthology.orchestra.run.smithi171.stderr: 94.5% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mgr.z.log.gz 2024-03-29T02:51:49.880 INFO:teuthology.orchestra.run.smithi171.stderr: 91.9% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.log.gz 2024-03-29T02:51:49.900 INFO:teuthology.orchestra.run.smithi110.stderr: 91.4% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-volume.log.gz 2024-03-29T02:51:49.949 INFO:teuthology.orchestra.run.smithi171.stderr: 94.3% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.l.log.gz 2024-03-29T02:51:50.078 INFO:teuthology.orchestra.run.smithi171.stderr: 91.3% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-volume.log.gz 2024-03-29T02:51:50.231 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.log: file size changed while zipping 2024-03-29T02:51:50.231 INFO:teuthology.orchestra.run.smithi046.stderr: 91.9% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.log.gz 2024-03-29T02:51:50.346 INFO:teuthology.orchestra.run.smithi046.stderr: 91.4% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-volume.log.gz 2024-03-29T02:51:50.353 INFO:teuthology.orchestra.run.smithi046.stderr: 93.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-29T02:51:50.494 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.j.log: file size changed while zipping 2024-03-29T02:51:50.494 INFO:teuthology.orchestra.run.smithi046.stderr: 94.6% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.j.log.gz 2024-03-29T02:51:50.540 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.k.log: file size changed while zipping 2024-03-29T02:51:50.540 INFO:teuthology.orchestra.run.smithi110.stderr: 94.6% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.k.log.gz 2024-03-29T02:51:50.730 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.d.log: file size changed while zipping 2024-03-29T02:51:50.730 INFO:teuthology.orchestra.run.smithi046.stderr: 94.6% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.d.log.gz 2024-03-29T02:51:50.775 INFO:teuthology.orchestra.run.smithi110.stderr: 92.4% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.audit.log.gz 2024-03-29T02:51:50.821 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.a.log: file size changed while zipping 2024-03-29T02:51:50.821 INFO:teuthology.orchestra.run.smithi046.stderr: 94.7% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.a.log.gz 2024-03-29T02:51:50.852 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mgr.y.log: file size changed while zipping 2024-03-29T02:51:50.853 INFO:teuthology.orchestra.run.smithi110.stderr: 94.5% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mgr.y.log.gz 2024-03-29T02:51:50.972 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.log: file size changed while zipping 2024-03-29T02:51:50.972 INFO:teuthology.orchestra.run.smithi110.stderr: 92.0% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph.log.gz 2024-03-29T02:51:53.358 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.g.log: file size changed while zipping 2024-03-29T02:51:53.358 INFO:teuthology.orchestra.run.smithi046.stderr: 94.6% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.g.log.gz 2024-03-29T02:52:17.260 INFO:teuthology.orchestra.run.smithi171.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.c.log: file size changed while zipping 2024-03-29T02:52:17.260 INFO:teuthology.orchestra.run.smithi171.stderr: 95.3% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.c.log.gz 2024-03-29T02:52:27.812 INFO:teuthology.orchestra.run.smithi171.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.f.log: file size changed while zipping 2024-03-29T02:52:27.812 INFO:teuthology.orchestra.run.smithi171.stderr: 95.1% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.f.log.gz 2024-03-29T02:53:22.846 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.h.log: file size changed while zipping 2024-03-29T02:53:22.847 INFO:teuthology.orchestra.run.smithi110.stderr: 94.6% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.h.log.gz 2024-03-29T02:53:25.216 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.e.log: file size changed while zipping 2024-03-29T02:53:25.217 INFO:teuthology.orchestra.run.smithi110.stderr: 94.6% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.e.log.gz 2024-03-29T02:53:48.058 INFO:teuthology.orchestra.run.smithi171.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.i.log: file size changed while zipping 2024-03-29T02:53:48.058 INFO:teuthology.orchestra.run.smithi171.stderr: 94.7% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.i.log.gz 2024-03-29T02:54:12.634 INFO:teuthology.orchestra.run.smithi171.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mon.c.log: file size changed while zipping 2024-03-29T02:54:12.635 INFO:teuthology.orchestra.run.smithi171.stderr: 92.4% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mon.c.log.gz 2024-03-29T02:54:15.736 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mon.b.log: file size changed while zipping 2024-03-29T02:54:15.736 INFO:teuthology.orchestra.run.smithi110.stderr: 92.2% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mon.b.log.gz 2024-03-29T02:54:46.979 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mgr.x.log: file size changed while zipping 2024-03-29T02:54:46.979 INFO:teuthology.orchestra.run.smithi046.stderr: 90.6% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mgr.x.log.gz 2024-03-29T02:56:37.487 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.0.log: file size changed while zipping 2024-03-29T02:56:37.487 INFO:teuthology.orchestra.run.smithi046.stderr: 92.1% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.0.log.gz 2024-03-29T02:56:54.430 INFO:teuthology.orchestra.run.smithi171.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.8.log: file size changed while zipping 2024-03-29T02:56:54.430 INFO:teuthology.orchestra.run.smithi171.stderr: 92.2% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.8.log.gz 2024-03-29T02:56:57.693 INFO:teuthology.orchestra.run.smithi171.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.11.log: file size changed while zipping 2024-03-29T02:56:57.693 INFO:teuthology.orchestra.run.smithi171.stderr: 92.2% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.11.log.gz 2024-03-29T02:57:38.304 INFO:teuthology.orchestra.run.smithi171.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.2.log: file size changed while zipping 2024-03-29T02:57:38.305 INFO:teuthology.orchestra.run.smithi171.stderr: 92.1% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.2.log.gz 2024-03-29T02:57:58.377 INFO:teuthology.orchestra.run.smithi171.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.5.log: file size changed while zipping 2024-03-29T02:57:58.378 INFO:teuthology.orchestra.run.smithi171.stderr: 91.9% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.5.log.gz 2024-03-29T02:58:41.331 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.6.log: file size changed while zipping 2024-03-29T02:58:41.331 INFO:teuthology.orchestra.run.smithi046.stderr: 91.9% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.6.log.gz 2024-03-29T02:59:01.656 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mon.a.log: file size changed while zipping 2024-03-29T02:59:01.657 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mon.a.log.gz 2024-03-29T02:59:10.542 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.1.log: file size changed while zipping 2024-03-29T02:59:10.542 INFO:teuthology.orchestra.run.smithi110.stderr: 92.0% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.1.log.gz 2024-03-29T03:00:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.9.log: file size changed while zipping 2024-03-29T03:00:28.845 INFO:teuthology.orchestra.run.smithi046.stderr: 92.1% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.9.log.gz 2024-03-29T03:00:35.248 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.3.log: file size changed while zipping 2024-03-29T03:00:35.248 INFO:teuthology.orchestra.run.smithi046.stderr: 92.0% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.3.log.gz 2024-03-29T03:00:37.066 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.10.log: file size changed while zipping 2024-03-29T03:00:37.066 INFO:teuthology.orchestra.run.smithi110.stderr: 91.8% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.10.log.gz 2024-03-29T03:01:07.365 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.7.log: file size changed while zipping 2024-03-29T03:01:07.366 INFO:teuthology.orchestra.run.smithi110.stderr: 92.0% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.7.log.gz 2024-03-29T03:03:55.397 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.4.log: file size changed while zipping 2024-03-29T03:03:55.398 INFO:teuthology.orchestra.run.smithi110.stderr: 92.1% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-osd.4.log.gz 2024-03-29T03:07:03.710 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.b.log: file size changed while zipping 2024-03-29T03:07:03.710 INFO:teuthology.orchestra.run.smithi110.stderr: 92.6% -- replaced with /var/log/ceph/e878d370-ed13-11ee-95d0-87774f69a715/ceph-mds.b.log.gz 2024-03-29T03:07:03.765 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627985/remote/smithi046/log 2024-03-29T03:07:03.767 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-29T03:07:52.517 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627985/remote/smithi110/log 2024-03-29T03:07:52.519 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-29T03:09:04.384 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627985/remote/smithi171/log 2024-03-29T03:09:04.385 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-29T03:09:46.272 INFO:teuthology.kill:No teuthology processes running 2024-03-29T03:09:47.261 INFO:teuthology.kill:Nuking machines: ['smithi046', 'smithi110', 'smithi171'] 2024-03-29T03:09:48.086 INFO:teuthology.kill:2024-03-29 03:09:48,086.086 INFO:teuthology.nuke:targets: 2024-03-29T03:09:48.087 INFO:teuthology.kill: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtnUGWbIy0igwAxKq8IGc25P0H1RQyWF5QowVW05iL/6MfmUHBWils/5Yflbauf6gHFtsEbzT41mq2fktfLCy0= 2024-03-29T03:09:48.087 INFO:teuthology.kill: smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNInbdVau7Gtgo5LE31OjHt44J0i05o7AzTM0iWOFQNcOXvHDvVmihe8+hUViXWDEaZIwLQp3TvV4TLD39sRfDg= 2024-03-29T03:09:48.087 INFO:teuthology.kill: smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFZ4PlnXOTd1yKRn6PQivuQJaRZN85UBI/5nBdbYBltOZMB1Z4J2yx2ijG1lxd0XIZhRbAyuhz89tFMUyQPtQyE= 2024-03-29T03:09:48.087 INFO:teuthology.kill:2024-03-29 03:09:48,087.087 INFO:teuthology.nuke:Checking targets against current locks 2024-03-29T03:09:48.125 INFO:teuthology.kill:2024-03-29 03:09:48,125.125 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-29T03:09:48.152 INFO:teuthology.kill:2024-03-29 03:09:48,152.152 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-29T03:09:48.174 INFO:teuthology.kill:2024-03-29 03:09:48,173.173 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-29T03:09:48.200 INFO:teuthology.kill:2024-03-29 03:09:48,200.200 INFO:teuthology.orchestra.console.smithi046:Power off 2024-03-29T03:09:48.237 INFO:teuthology.kill:2024-03-29 03:09:48,237.237 INFO:teuthology.orchestra.console.smithi110:Power off 2024-03-29T03:09:48.271 INFO:teuthology.kill:2024-03-29 03:09:48,271.271 INFO:teuthology.orchestra.console.smithi171:Power off 2024-03-29T03:09:56.633 INFO:teuthology.kill:2024-03-29 03:09:56,633.633 INFO:teuthology.orchestra.console.smithi171:Power off completed 2024-03-29T03:09:56.787 INFO:teuthology.kill:2024-03-29 03:09:56,787.787 INFO:teuthology.lock.ops:unlocked: smithi171.front.sepia.ceph.com 2024-03-29T03:10:00.694 INFO:teuthology.kill:2024-03-29 03:10:00,694.694 INFO:teuthology.orchestra.console.smithi046:Power off completed 2024-03-29T03:10:00.714 INFO:teuthology.kill:2024-03-29 03:10:00,714.714 INFO:teuthology.orchestra.console.smithi110:Power off completed 2024-03-29T03:10:00.845 INFO:teuthology.kill:2024-03-29 03:10:00,845.845 INFO:teuthology.lock.ops:unlocked: smithi046.front.sepia.ceph.com 2024-03-29T03:10:00.861 INFO:teuthology.kill:2024-03-29 03:10:00,861.861 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com 2024-03-29T03:10:00.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T03:12:01.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T03:12:01.186 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2024-03-29T03:12:01.338 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi046 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-28_21:32:02-powercycle-squid-distro-default-smithi/7628856 2024-03-29T03:12:01.338 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi110 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-28_21:32:02-powercycle-squid-distro-default-smithi/7628855 2024-03-29T03:12:01.338 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi171 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-28_21:32:02-powercycle-squid-distro-default-smithi/7628856