2024-03-31T00:15:23.514 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-31T00:15:23.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:15:23.677 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f03d17dbc10>, signals=[15]) 2024-03-31T00:15:23.677 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2024-03-31T00:15:23.677 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2024-03-31T00:15:23.678 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-03-31T00:15:23.699 INFO:teuthology.lock.ops:Start node 'smithi165.front.sepia.ceph.com' reimaging 2024-03-31T00:15:23.699 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: reset os type and version on server 2024-03-31T00:15:23.699 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2024-03-31T00:15:23.715 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging 2024-03-31T00:15:23.716 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server 2024-03-31T00:15:23.716 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-03-31T00:15:23.823 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_9.stream (ID 10) 2024-03-31T00:15:23.829 DEBUG:teuthology.provision.fog.smithi165:Requesting image smithi_centos_9.stream (ID 10) 2024-03-31T00:15:23.839 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_centos_9.stream (ID 10) 2024-03-31T00:15:23.869 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 9.stream 2024-03-31T00:15:23.884 INFO:teuthology.provision.fog.smithi165:Scheduling deploy of centos 9.stream 2024-03-31T00:15:23.888 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of centos 9.stream 2024-03-31T00:15:24.080 INFO:teuthology.orchestra.console.smithi112:Power off 2024-03-31T00:15:24.080 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-31T00:15:24.093 INFO:teuthology.orchestra.console.smithi175:Power off 2024-03-31T00:15:24.093 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-31T00:15:24.103 INFO:teuthology.orchestra.console.smithi165:Power off 2024-03-31T00:15:24.104 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-31T00:15:24.113 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2024-03-31T00:15:24.113 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T00:15:24.124 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2024-03-31T00:15:24.124 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T00:15:24.132 DEBUG:teuthology.orchestra.console.smithi165:power off output: Chassis Power Control: Down/Off 2024-03-31T00:15:24.132 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T00:15:24.139 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-03-31T00:15:24.144 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-03-31T00:15:24.151 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on 2024-03-31T00:15:28.142 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T00:15:28.148 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T00:15:28.155 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T00:15:28.251 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-03-31T00:15:28.256 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-03-31T00:15:28.263 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on 2024-03-31T00:15:32.255 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T00:15:32.262 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T00:15:32.270 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T00:15:32.364 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-03-31T00:15:32.371 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-03-31T00:15:32.377 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off 2024-03-31T00:15:32.477 INFO:teuthology.orchestra.console.smithi165:Power off completed 2024-03-31T00:15:32.578 INFO:teuthology.orchestra.console.smithi165:Power on 2024-03-31T00:15:32.578 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-31T00:15:32.597 DEBUG:teuthology.orchestra.console.smithi165:power on output: Chassis Power Control: Up/On 2024-03-31T00:15:32.598 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T00:15:32.618 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off 2024-03-31T00:15:36.369 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T00:15:36.376 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T00:15:36.478 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-03-31T00:15:36.484 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-03-31T00:15:36.579 INFO:teuthology.orchestra.console.smithi112:Power off completed 2024-03-31T00:15:36.585 INFO:teuthology.orchestra.console.smithi175:Power off completed 2024-03-31T00:15:36.619 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T00:15:36.680 INFO:teuthology.orchestra.console.smithi112:Power on 2024-03-31T00:15:36.680 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-31T00:15:36.686 INFO:teuthology.orchestra.console.smithi175:Power on 2024-03-31T00:15:36.687 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-31T00:15:36.701 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2024-03-31T00:15:36.701 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T00:15:36.708 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On 2024-03-31T00:15:36.709 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T00:15:36.723 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-03-31T00:15:36.727 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off 2024-03-31T00:15:36.729 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-03-31T00:15:40.726 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T00:15:40.733 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T00:15:40.740 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T00:15:40.836 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-03-31T00:15:40.842 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on 2024-03-31T00:15:40.849 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-03-31T00:15:40.936 INFO:teuthology.orchestra.console.smithi112:Power on completed 2024-03-31T00:15:40.943 INFO:teuthology.orchestra.console.smithi165:Power on completed 2024-03-31T00:15:41.037 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2024-03-31T00:15:41.044 INFO:teuthology.provision.fog.smithi165:Waiting for deploy to finish 2024-03-31T00:15:44.852 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T00:15:44.961 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-03-31T00:15:45.061 INFO:teuthology.orchestra.console.smithi175:Power on completed 2024-03-31T00:15:45.162 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish 2024-03-31T00:18:11.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:18:14.818 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-03-31T00:18:15.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:18:18.910 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-03-31T00:18:20.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:18:23.902 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-03-31T00:18:24.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:18:26.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:18:27.970 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-03-31T00:18:29.858 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-03-31T00:18:29.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:18:32.958 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-03-31T00:18:33.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:18:35.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:18:37.022 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-03-31T00:18:38.946 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-03-31T00:18:38.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:18:42.014 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-03-31T00:18:43.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:18:44.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:18:46.078 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-03-31T00:18:48.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:18:48.034 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-03-31T00:18:51.074 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-03-31T00:18:52.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:18:54.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:18:55.134 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-03-31T00:18:57.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:18:57.118 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-03-31T00:19:00.162 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-03-31T00:19:01.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:19:03.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:19:04.190 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-03-31T00:19:06.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:19:06.174 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-03-31T00:19:09.246 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-03-31T00:19:10.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:19:12.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:19:15.230 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-03-31T00:19:15.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:19:21.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:20:10.242 WARNING:teuthology.provision.fog.smithi175:timed out 2024-03-31T00:20:15.254 WARNING:teuthology.provision.fog.smithi165:timed out 2024-03-31T00:20:16.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:20:16.552 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-31T00:20:16.553 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-31T00:20:16.870 INFO:teuthology.provision.fog.smithi175:Node is ready 2024-03-31T00:20:16.870 DEBUG:teuthology.orchestra.run.smithi175:> hostname 2024-03-31T00:20:16.885 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com 2024-03-31T00:20:16.885 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175.front.sepia.ceph.com /etc/hosts 2024-03-31T00:20:16.941 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175 2024-03-31T00:20:16.941 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2024-03-31T00:20:17.035 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hosts 2024-03-31T00:20:17.063 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts 2024-03-31T00:20:17.130 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hostname 2024-03-31T00:20:17.198 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2024-03-31T00:20:17.265 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-03-31T00:20:17.320 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-03-31T00:20:17.320 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-03-31T00:20:17.320 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-03-31T00:20:17.320 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-03-31T00:20:17.320 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-03-31T00:20:17.320 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-03-31T00:20:17.320 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T00:20:17.321 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-03-31T00:20:17.321 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-03-31T00:20:17.321 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T00:20:17.321 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-03-31T00:20:17.321 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T00:20:17.321 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T00:20:17.321 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T00:20:17.321 INFO:teuthology.provision.fog.smithi175:Deploy complete! 2024-03-31T00:20:17.322 DEBUG:teuthology.parallel:result is None 2024-03-31T00:20:21.238 WARNING:teuthology.provision.fog.smithi112:timed out 2024-03-31T00:20:21.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:20:21.503 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-31T00:20:21.503 DEBUG:teuthology.orchestra.run.smithi165:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-31T00:20:21.836 INFO:teuthology.provision.fog.smithi165:Node is ready 2024-03-31T00:20:21.836 DEBUG:teuthology.orchestra.run.smithi165:> hostname 2024-03-31T00:20:21.851 INFO:teuthology.orchestra.run.smithi165.stdout:smithi165.front.sepia.ceph.com 2024-03-31T00:20:21.851 DEBUG:teuthology.orchestra.run.smithi165:> grep smithi165.front.sepia.ceph.com /etc/hosts 2024-03-31T00:20:21.906 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.15.165 smithi165.front.sepia.ceph.com smithi165 2024-03-31T00:20:21.906 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname smithi165 2024-03-31T00:20:22.011 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/smithi165.front.sepia.ceph.com/smithi165/g' /etc/hosts 2024-03-31T00:20:22.040 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/172.21.15.165/172.21.15.165/g' /etc/hosts 2024-03-31T00:20:22.108 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/smithi165.front.sepia.ceph.com/smithi165/g' /etc/hostname 2024-03-31T00:20:22.175 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname smithi165 2024-03-31T00:20:22.242 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release 2024-03-31T00:20:22.297 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream" 2024-03-31T00:20:22.297 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="9" 2024-03-31T00:20:22.297 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2024-03-31T00:20:22.297 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2024-03-31T00:20:22.298 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="9" 2024-03-31T00:20:22.298 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el9" 2024-03-31T00:20:22.298 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T00:20:22.298 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2024-03-31T00:20:22.298 INFO:teuthology.orchestra.run.smithi165.stdout:LOGO="fedora-logo-icon" 2024-03-31T00:20:22.298 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T00:20:22.298 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/" 2024-03-31T00:20:22.298 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T00:20:22.298 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T00:20:22.298 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T00:20:22.299 INFO:teuthology.provision.fog.smithi165:Deploy complete! 2024-03-31T00:20:22.299 DEBUG:teuthology.parallel:result is None 2024-03-31T00:20:27.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:20:27.471 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-31T00:20:27.471 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-31T00:20:27.797 INFO:teuthology.provision.fog.smithi112:Node is ready 2024-03-31T00:20:27.797 DEBUG:teuthology.orchestra.run.smithi112:> hostname 2024-03-31T00:20:27.812 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com 2024-03-31T00:20:27.812 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts 2024-03-31T00:20:27.868 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2024-03-31T00:20:27.868 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2024-03-31T00:20:27.974 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts 2024-03-31T00:20:28.002 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2024-03-31T00:20:28.069 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname 2024-03-31T00:20:28.135 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2024-03-31T00:20:28.203 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-03-31T00:20:28.262 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-03-31T00:20:28.262 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-03-31T00:20:28.262 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-03-31T00:20:28.262 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-03-31T00:20:28.262 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-03-31T00:20:28.262 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-03-31T00:20:28.262 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T00:20:28.263 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-03-31T00:20:28.263 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-03-31T00:20:28.263 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T00:20:28.263 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-03-31T00:20:28.263 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T00:20:28.263 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T00:20:28.263 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T00:20:28.263 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2024-03-31T00:20:28.264 DEBUG:teuthology.parallel:result is None 2024-03-31T00:20:28.504 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2024-03-31T00:20:28.504 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-31T00:20:28.527 INFO:teuthology.lock.ops:Checking smithi165.front.sepia.ceph.com 2024-03-31T00:20:28.527 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-31T00:20:28.552 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com 2024-03-31T00:20:28.552 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-31T00:20:28.578 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2024-03-31T00:20:28.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-03-31T00:20:28.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:20:28.663 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-03-31T00:20:28.732 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-03-31T00:20:28.732 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-03-31T00:20:28.790 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-03-31T00:20:28.790 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-03-31T00:20:28.848 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-03-31T00:20:28.848 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-03-31T00:20:28.848 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-03-31T00:20:28.848 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-03-31T00:20:28.848 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-03-31T00:20:28.848 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-03-31T00:20:28.849 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T00:20:28.849 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-03-31T00:20:28.849 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-03-31T00:20:28.849 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T00:20:28.849 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-03-31T00:20:28.849 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T00:20:28.849 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T00:20:28.849 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T00:20:28.849 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-03-31T00:20:28.876 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: set os type and version on server 2024-03-31T00:20:28.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-03-31T00:20:28.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:20:28.964 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-03-31T00:20:29.035 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-03-31T00:20:29.035 DEBUG:teuthology.orchestra.run.smithi165:> uname -m 2024-03-31T00:20:29.091 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2024-03-31T00:20:29.091 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release 2024-03-31T00:20:29.147 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream" 2024-03-31T00:20:29.147 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="9" 2024-03-31T00:20:29.147 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2024-03-31T00:20:29.147 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2024-03-31T00:20:29.147 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="9" 2024-03-31T00:20:29.147 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el9" 2024-03-31T00:20:29.147 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T00:20:29.148 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2024-03-31T00:20:29.148 INFO:teuthology.orchestra.run.smithi165.stdout:LOGO="fedora-logo-icon" 2024-03-31T00:20:29.148 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T00:20:29.148 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/" 2024-03-31T00:20:29.148 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T00:20:29.148 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T00:20:29.148 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T00:20:29.148 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2024-03-31T00:20:29.168 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server 2024-03-31T00:20:29.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-03-31T00:20:29.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T00:20:29.255 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-03-31T00:20:29.426 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-03-31T00:20:29.426 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-03-31T00:20:29.480 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-03-31T00:20:29.480 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-03-31T00:20:29.534 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-03-31T00:20:29.534 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-03-31T00:20:29.534 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-03-31T00:20:29.535 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-03-31T00:20:29.535 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-03-31T00:20:29.535 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-03-31T00:20:29.535 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T00:20:29.535 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-03-31T00:20:29.535 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-03-31T00:20:29.535 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T00:20:29.535 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-03-31T00:20:29.535 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T00:20:29.535 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T00:20:29.535 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T00:20:29.536 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-03-31T00:20:29.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:20:29.663 INFO:teuthology.dispatcher.supervisor:Running job 7631022 2024-03-31T00:20:29.664 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_mchangir@teuthology --archive /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7631022 --name mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/postgres}} -- /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7631022/orig.config.yaml 2024-03-31T00:20:29.667 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7631022 2024-03-31T00:20:29.667 INFO:teuthology.dispatcher.supervisor:Job PID: 1681983 2024-03-31T00:20:29.667 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-31T00:22:29.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:24:29.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:26:30.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:28:30.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:30:30.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:32:30.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:34:30.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:36:30.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:38:30.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:40:31.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:42:31.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:44:31.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:46:31.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:48:31.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:50:31.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:52:32.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:54:32.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:56:32.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:58:32.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:00:32.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:02:32.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:04:33.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:06:33.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:08:33.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:10:33.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:12:33.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:14:33.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:16:34.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:18:34.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:20:34.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:22:34.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:24:34.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:26:34.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:28:35.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:30:35.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:32:35.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:34:35.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:36:35.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:38:35.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:40:35.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:42:36.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:44:36.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:46:36.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:48:36.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:50:36.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:52:36.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:54:36.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:56:37.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:58:37.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:00:37.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:02:37.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:04:37.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:06:37.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:08:38.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:10:38.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:12:38.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:14:38.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:16:38.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:18:38.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:20:38.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:22:39.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:24:39.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:26:39.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:28:39.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:30:39.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:32:39.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:34:40.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:36:40.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:38:40.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:40:40.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:42:40.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:44:40.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:46:41.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:48:41.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:50:41.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:52:41.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:54:41.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:56:41.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:58:42.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:00:42.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:02:42.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:04:42.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:06:42.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:08:42.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:10:42.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:12:43.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:14:43.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:16:43.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:18:43.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:20:43.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:22:43.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:24:44.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:26:44.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:28:44.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:30:44.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:32:44.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:34:45.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:36:45.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:38:45.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:40:45.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:42:45.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:44:46.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:46:46.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:48:46.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:50:46.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:52:46.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:54:46.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:56:46.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:58:47.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:00:47.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:02:47.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:04:47.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:06:47.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:08:47.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:10:48.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:12:48.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:14:48.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:16:48.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:18:48.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:20:48.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:22:49.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:24:49.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:26:49.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:28:49.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:30:49.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:32:49.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:34:49.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:36:49.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:38:50.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:40:50.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:42:50.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:44:50.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:46:50.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:48:50.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:50:51.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:52:51.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:54:51.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:56:51.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:58:51.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:00:52.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:02:52.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:04:52.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:06:52.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:08:52.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:10:52.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:12:53.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:14:53.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:16:53.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:18:53.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:20:53.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:22:53.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:24:54.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:26:54.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:28:54.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:30:54.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:32:54.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:34:54.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:36:54.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:38:55.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:40:55.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:42:55.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:44:55.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:46:55.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:48:56.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:50:56.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:52:56.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:54:56.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:56:56.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:58:56.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:00:57.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:02:57.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:04:57.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:06:57.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:08:57.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:10:57.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:12:58.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:14:58.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:16:58.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:18:58.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:20:58.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:22:58.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:24:59.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:26:59.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:28:59.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:30:59.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:32:59.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:34:59.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:37:00.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:39:00.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:41:00.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:43:00.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:45:00.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:47:00.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:49:01.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:51:01.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:53:01.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:55:01.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:57:01.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:59:01.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:01:02.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:03:02.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:05:02.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:07:02.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:09:02.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:11:02.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:13:03.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:15:03.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:17:03.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:19:03.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:21:03.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:23:03.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:25:04.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:27:04.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:29:04.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:31:04.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:33:04.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:35:04.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:37:05.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:39:05.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:41:05.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:43:05.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:45:05.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:47:05.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:49:06.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:51:06.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:53:06.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:55:06.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:57:06.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:59:06.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:01:06.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:03:07.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:05:07.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:07:07.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:09:07.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:11:07.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:13:08.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:15:08.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:17:08.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:19:08.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:21:08.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:23:08.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:25:08.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:27:09.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:29:09.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:31:09.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:33:09.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:35:09.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:37:09.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:39:10.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:41:10.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:43:10.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:45:10.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:47:10.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:49:11.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:51:11.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:53:11.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:55:11.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:57:11.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:59:11.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:01:11.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:03:12.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:05:12.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:07:12.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:09:12.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:11:12.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:13:12.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:15:13.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:17:13.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:19:13.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:21:13.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:23:13.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:25:13.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:27:14.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:29:14.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:31:14.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:33:14.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:35:14.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:37:14.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:39:15.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:41:15.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:43:15.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:45:15.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:47:15.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:49:15.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:51:16.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:53:16.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:55:16.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:57:16.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:59:16.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:01:16.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:03:16.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:05:17.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:07:17.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:09:17.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:11:17.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:13:17.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:15:18.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:17:18.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:19:18.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:21:18.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:23:18.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:25:18.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:27:19.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:29:19.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:31:19.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:33:19.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:35:19.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:37:19.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:39:20.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:41:20.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:43:20.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:45:20.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:47:20.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:49:20.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:51:21.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:53:21.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:55:21.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:57:21.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:59:21.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:01:21.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:03:22.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:05:22.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:07:22.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:09:22.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:11:22.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:13:23.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:15:23.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:17:23.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:19:23.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:21:23.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:23:23.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:25:24.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:27:24.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:29:24.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:31:24.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:33:24.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:35:25.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:37:25.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:39:25.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:41:25.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:43:25.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:45:25.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:47:26.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:49:26.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:51:26.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:53:26.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:55:26.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:57:27.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:59:27.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T12:01:27.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T12:03:27.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T12:05:27.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T12:07:27.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T12:09:28.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T12:11:28.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T12:13:28.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T12:15:28.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T12:17:28.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T12:19:28.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T12:21:29.080 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2024-03-31T12:21:29.241 INFO:teuthology.kill:Killing Pids: {1681983} 2024-03-31T12:21:30.243 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-03-31T12:21:30.244 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-03-31T12:21:30.244 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-03-31T12:21:30.244 INFO:teuthology.misc:Compressing logs... 2024-03-31T12:21:30.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-03-31T12:21:30.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T12:21:30.392 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-03-31T12:21:30.554 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-03-31T12:21:30.554 DEBUG:teuthology.orchestra.run.smithi112:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T12:21:30.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-03-31T12:21:30.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T12:21:30.645 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-03-31T12:21:30.721 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-03-31T12:21:30.721 DEBUG:teuthology.orchestra.run.smithi165:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T12:21:30.763 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-03-31T12:21:30.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T12:21:30.854 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-03-31T12:21:30.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-03-31T12:21:30.928 DEBUG:teuthology.orchestra.run.smithi175:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T12:21:31.001 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7631022/remote/smithi112/crash 2024-03-31T12:21:31.002 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-31T12:21:31.108 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7631022/remote/smithi165/crash 2024-03-31T12:21:31.109 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-31T12:21:31.171 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7631022/remote/smithi175/crash 2024-03-31T12:21:31.172 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-31T12:21:31.211 INFO:teuthology.misc:Compressing logs... 2024-03-31T12:21:31.211 DEBUG:teuthology.orchestra.run.smithi112:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T12:21:31.219 DEBUG:teuthology.orchestra.run.smithi165:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T12:21:31.221 DEBUG:teuthology.orchestra.run.smithi175:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T12:21:31.247 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-31T12:21:31.247 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-31T12:21:31.247 INFO:teuthology.orchestra.run.smithi165.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-03-31T12:21:31.248 INFO:teuthology.orchestra.run.smithi165.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-03-31T12:21:31.279 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-31T12:21:31.279 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-31T12:21:31.279 INFO:teuthology.orchestra.run.smithi175.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-03-31T12:21:31.280 INFO:teuthology.orchestra.run.smithi175.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-03-31T12:21:31.297 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-31T12:21:31.299 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-31T12:21:31.299 INFO:teuthology.orchestra.run.smithi112.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-03-31T12:21:31.300 INFO:teuthology.orchestra.run.smithi112.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-03-31T12:21:31.305 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7631022/remote/smithi112/ 2024-03-31T12:21:31.305 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-31T12:21:31.387 DEBUG:teuthology.misc:Transferring archived files from smithi165:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7631022/remote/smithi165/ 2024-03-31T12:21:31.387 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-31T12:21:31.416 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7631022/remote/smithi175/ 2024-03-31T12:21:31.416 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-31T12:21:31.444 INFO:teuthology.misc:Compressing logs... 2024-03-31T12:21:31.444 DEBUG:teuthology.orchestra.run.smithi112:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T12:21:31.452 DEBUG:teuthology.orchestra.run.smithi165:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T12:21:31.459 DEBUG:teuthology.orchestra.run.smithi175:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T12:21:31.483 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-31T12:21:31.483 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.10.log 2024-03-31T12:21:31.484 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-03-31T12:21:31.484 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.b.log 2024-03-31T12:21:31.484 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.4.log 2024-03-31T12:21:31.484 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.audit.log: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.1.log 2024-03-31T12:21:31.486 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.k.log 2024-03-31T12:21:31.486 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.h.log 2024-03-31T12:21:31.486 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.k.log: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-31T12:21:31.487 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.7.log 2024-03-31T12:21:31.497 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.h.log: 91.9% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-03-31T12:21:31.500 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.e.log 2024-03-31T12:21:31.512 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-31T12:21:31.512 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.l.log 2024-03-31T12:21:31.512 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-03-31T12:21:31.514 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.i.log 2024-03-31T12:21:31.515 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.l.log: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.11.log 2024-03-31T12:21:31.515 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mgr.z.log 2024-03-31T12:21:31.515 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.8.log 2024-03-31T12:21:31.515 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.11.log: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.5.log 2024-03-31T12:21:31.516 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.8.log: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.5.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-31T12:21:31.517 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.f.log 2024-03-31T12:21:31.520 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-03-31T12:21:31.522 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mgr.y.log 2024-03-31T12:21:31.526 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.f.log: 91.9% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-03-31T12:21:31.527 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.log 2024-03-31T12:21:31.529 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.cephadm.log: 90.2% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-03-31T12:21:31.529 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.2.log 2024-03-31T12:21:31.535 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-03-31T12:21:31.538 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.c.log 2024-03-31T12:21:31.538 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-31T12:21:31.539 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-03-31T12:21:31.541 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.6.log 2024-03-31T12:21:31.542 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mon.a.log 2024-03-31T12:21:31.543 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-03-31T12:21:31.544 INFO:teuthology.orchestra.run.smithi112.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-03-31T12:21:31.544 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.log 2024-03-31T12:21:31.545 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.g.log 2024-03-31T12:21:31.546 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.j.log 2024-03-31T12:21:31.548 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.3.log 2024-03-31T12:21:31.550 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mgr.x.log 2024-03-31T12:21:31.552 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.3.log: 92.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-31T12:21:31.553 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.0.log 2024-03-31T12:21:31.555 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-03-31T12:21:31.556 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.log 2024-03-31T12:21:31.558 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.cephadm.log: 90.2% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-03-31T12:21:31.558 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-03-31T12:21:31.559 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-03-31T12:21:31.562 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.cephadm.log: 89.9% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-03-31T12:21:31.564 INFO:teuthology.orchestra.run.smithi112.stderr: 91.9% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-03-31T12:21:31.564 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mon.c.log 2024-03-31T12:21:31.566 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mon.b.log 2024-03-31T12:21:31.567 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-03-31T12:21:31.568 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.9.log 2024-03-31T12:21:31.574 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.d.log 2024-03-31T12:21:31.575 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.a.log 2024-03-31T12:21:31.637 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-volume.log: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mon.c.log: 91.3% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-03-31T12:21:31.640 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-volume.log: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mon.b.log: 91.3% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-03-31T12:21:31.653 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.d.log: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.a.log: 91.1% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-03-31T12:21:31.687 INFO:teuthology.orchestra.run.smithi175.stderr: 90.3% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-03-31T12:21:31.721 INFO:teuthology.orchestra.run.smithi175.stderr: 94.6% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mgr.z.log.gz 2024-03-31T12:21:31.731 INFO:teuthology.orchestra.run.smithi165.stderr: 90.3% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-03-31T12:21:31.736 INFO:teuthology.orchestra.run.smithi112.stderr: 90.3% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-03-31T12:21:31.764 INFO:teuthology.orchestra.run.smithi165.stderr: 94.7% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mgr.y.log.gz 2024-03-31T12:21:31.859 INFO:teuthology.orchestra.run.smithi112.stderr: 92.8% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.j.log.gz 2024-03-31T12:21:31.865 INFO:teuthology.orchestra.run.smithi175.stderr: 92.9% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.l.log.gz 2024-03-31T12:21:31.945 INFO:teuthology.orchestra.run.smithi165.stderr: 92.9% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.e.log.gz 2024-03-31T12:21:31.983 INFO:teuthology.orchestra.run.smithi165.stderr: 92.9% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.k.log.gz 2024-03-31T12:21:32.038 INFO:teuthology.orchestra.run.smithi112.stderr: 92.8% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.g.log.gz 2024-03-31T12:21:32.064 INFO:teuthology.orchestra.run.smithi112.stderr: 92.9% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.d.log.gz 2024-03-31T12:21:32.076 INFO:teuthology.orchestra.run.smithi175.stderr: 93.3% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.c.log.gz 2024-03-31T12:21:32.083 INFO:teuthology.orchestra.run.smithi165.stderr: 94.4% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.h.log.gz 2024-03-31T12:21:32.114 INFO:teuthology.orchestra.run.smithi112.stderr: 93.4% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.a.log.gz 2024-03-31T12:21:33.350 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.i.log: file size changed while zipping 2024-03-31T12:21:33.350 INFO:teuthology.orchestra.run.smithi175.stderr: 94.4% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.i.log.gz 2024-03-31T12:21:34.292 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.f.log: file size changed while zipping 2024-03-31T12:21:34.293 INFO:teuthology.orchestra.run.smithi175.stderr: 95.2% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.f.log.gz 2024-03-31T12:21:37.707 INFO:teuthology.orchestra.run.smithi112.stderr:gzip: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mgr.x.log: file size changed while zipping 2024-03-31T12:21:37.708 INFO:teuthology.orchestra.run.smithi112.stderr: 90.6% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mgr.x.log.gz 2024-03-31T12:21:40.103 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.b.log: file size changed while zipping 2024-03-31T12:21:40.104 INFO:teuthology.orchestra.run.smithi165.stderr: 93.3% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mds.b.log.gz 2024-03-31T12:21:44.066 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mon.c.log: file size changed while zipping 2024-03-31T12:21:44.066 INFO:teuthology.orchestra.run.smithi175.stderr: 91.9% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mon.c.log.gz 2024-03-31T12:21:48.016 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mon.b.log: file size changed while zipping 2024-03-31T12:21:48.016 INFO:teuthology.orchestra.run.smithi165.stderr: 92.0% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mon.b.log.gz 2024-03-31T12:21:55.658 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.10.log: file size changed while zipping 2024-03-31T12:21:55.658 INFO:teuthology.orchestra.run.smithi165.stderr: 92.4% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.10.log.gz 2024-03-31T12:21:56.403 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.8.log: file size changed while zipping 2024-03-31T12:21:56.404 INFO:teuthology.orchestra.run.smithi175.stderr: 92.6% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.8.log.gz 2024-03-31T12:21:56.413 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.11.log: file size changed while zipping 2024-03-31T12:21:56.413 INFO:teuthology.orchestra.run.smithi175.stderr: 93.0% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.11.log.gz 2024-03-31T12:21:56.611 INFO:teuthology.orchestra.run.smithi112.stderr:gzip: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.0.log: file size changed while zipping 2024-03-31T12:21:56.611 INFO:teuthology.orchestra.run.smithi112.stderr: 92.7% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.0.log.gz 2024-03-31T12:21:57.649 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.2.log: file size changed while zipping 2024-03-31T12:21:57.649 INFO:teuthology.orchestra.run.smithi175.stderr: 92.7% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.2.log.gz 2024-03-31T12:21:59.121 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.1.log: file size changed while zipping 2024-03-31T12:21:59.122 INFO:teuthology.orchestra.run.smithi165.stderr: 92.5% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.1.log.gz 2024-03-31T12:21:59.761 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.5.log: file size changed while zipping 2024-03-31T12:21:59.762 INFO:teuthology.orchestra.run.smithi175.stderr: 92.9% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.5.log.gz 2024-03-31T12:22:00.469 INFO:teuthology.orchestra.run.smithi112.stderr:gzip: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.3.log: file size changed while zipping 2024-03-31T12:22:00.469 INFO:teuthology.orchestra.run.smithi112.stderr: 92.3% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.3.log.gz 2024-03-31T12:22:00.882 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.7.log: file size changed while zipping 2024-03-31T12:22:00.882 INFO:teuthology.orchestra.run.smithi165.stderr: 92.8% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.7.log.gz 2024-03-31T12:22:00.942 INFO:teuthology.orchestra.run.smithi112.stderr:gzip: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mon.a.log: file size changed while zipping 2024-03-31T12:22:00.942 INFO:teuthology.orchestra.run.smithi112.stderr: 90.2% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-mon.a.log.gz 2024-03-31T12:22:01.463 INFO:teuthology.orchestra.run.smithi112.stderr:gzip: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.9.log: file size changed while zipping 2024-03-31T12:22:01.463 INFO:teuthology.orchestra.run.smithi112.stderr: 92.5% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.9.log.gz 2024-03-31T12:22:02.283 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.4.log: file size changed while zipping 2024-03-31T12:22:02.283 INFO:teuthology.orchestra.run.smithi165.stderr: 92.5% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.4.log.gz 2024-03-31T12:22:03.285 INFO:teuthology.orchestra.run.smithi112.stderr:gzip: /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.6.log: file size changed while zipping 2024-03-31T12:22:03.285 INFO:teuthology.orchestra.run.smithi112.stderr: 92.0% -- replaced with /var/log/ceph/1bebbb12-eef6-11ee-b647-cb9ed24678a4/ceph-osd.6.log.gz 2024-03-31T12:22:03.291 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7631022/remote/smithi112/log 2024-03-31T12:22:03.292 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-31T12:22:23.994 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7631022/remote/smithi165/log 2024-03-31T12:22:23.995 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-31T12:22:41.690 INFO:teuthology.orchestra.run.smithi165.stderr:tar: .: file changed as we read it 2024-03-31T12:22:41.697 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7631022/remote/smithi175/log 2024-03-31T12:22:41.698 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-31T12:22:57.706 INFO:teuthology.kill:No teuthology processes running 2024-03-31T12:22:58.696 INFO:teuthology.kill:Nuking machines: ['smithi112', 'smithi165', 'smithi175'] 2024-03-31T12:22:59.558 INFO:teuthology.kill:2024-03-31 12:22:59,558.558 INFO:teuthology.nuke:targets: 2024-03-31T12:22:59.559 INFO:teuthology.kill: smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCXIotCqiJydBiA2Oz8qdBeWgDna0eJaN2qrb49myUTpk8xUeLGui7H26QDOl6LgnCECmoWI566YZdM8vh/aItg= 2024-03-31T12:22:59.559 INFO:teuthology.kill: smithi165.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOWvHlP7oRYbmheo4tqrFJFv4YFGvP+dWVI+VwZseK9pmjjKC1yiW9R62eaNkaKyv3SHHOx0iUbirNZCtXRTjxQ= 2024-03-31T12:22:59.559 INFO:teuthology.kill: smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMYKgRjL45oWHe16Sopjm9AhqbDplTATij+MFyjwRvG2HodjnVNLq0BBp5UDhkZFE3F/3irfcLb25GE5eKv8muE= 2024-03-31T12:22:59.559 INFO:teuthology.kill:2024-03-31 12:22:59,558.558 INFO:teuthology.nuke:Checking targets against current locks 2024-03-31T12:22:59.609 INFO:teuthology.kill:2024-03-31 12:22:59,609.609 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-31T12:22:59.638 INFO:teuthology.kill:2024-03-31 12:22:59,638.638 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-31T12:22:59.662 INFO:teuthology.kill:2024-03-31 12:22:59,662.662 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-31T12:22:59.695 INFO:teuthology.kill:2024-03-31 12:22:59,695.695 INFO:teuthology.orchestra.console.smithi112:Power off 2024-03-31T12:22:59.738 INFO:teuthology.kill:2024-03-31 12:22:59,737.737 INFO:teuthology.orchestra.console.smithi165:Power off 2024-03-31T12:22:59.770 INFO:teuthology.kill:2024-03-31 12:22:59,770.770 INFO:teuthology.orchestra.console.smithi175:Power off 2024-03-31T12:23:08.073 INFO:teuthology.kill:2024-03-31 12:23:08,072.072 INFO:teuthology.orchestra.console.smithi112:Power off completed 2024-03-31T12:23:08.098 INFO:teuthology.kill:2024-03-31 12:23:08,098.098 INFO:teuthology.orchestra.console.smithi165:Power off completed 2024-03-31T12:23:08.128 INFO:teuthology.kill:2024-03-31 12:23:08,127.127 INFO:teuthology.orchestra.console.smithi175:Power off completed 2024-03-31T12:23:08.230 INFO:teuthology.kill:2024-03-31 12:23:08,229.229 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com 2024-03-31T12:23:08.255 INFO:teuthology.kill:2024-03-31 12:23:08,255.255 INFO:teuthology.lock.ops:unlocked: smithi165.front.sepia.ceph.com 2024-03-31T12:23:08.271 INFO:teuthology.kill:2024-03-31 12:23:08,271.271 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com 2024-03-31T12:23:08.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T12:25:08.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T12:25:08.601 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2024-03-31T12:25:08.751 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi112 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-30_21:16:02-rbd-squid-distro-default-smithi/7631419 2024-03-31T12:25:08.752 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi165 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-30_21:16:02-rbd-squid-distro-default-smithi/7631418 2024-03-31T12:25:08.752 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi175 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-30_21:16:02-rbd-squid-distro-default-smithi/7631419