2024-03-30T17:33:13.940 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-30T17:33:13.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T17:33:14.118 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2672d21c10>, signals=[15]) 2024-03-30T17:33:14.118 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2024-03-30T17:33:14.119 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2024-03-30T17:33:14.119 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2024-03-30T17:33:14.139 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging 2024-03-30T17:33:14.140 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server 2024-03-30T17:33:14.140 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-03-30T17:33:14.164 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging 2024-03-30T17:33:14.164 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server 2024-03-30T17:33:14.164 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-03-30T17:33:14.254 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_centos_9.stream (ID 10) 2024-03-30T17:33:14.305 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_centos_9.stream (ID 10) 2024-03-30T17:33:14.308 DEBUG:teuthology.provision.fog.smithi134:Requesting image smithi_centos_9.stream (ID 10) 2024-03-30T17:33:14.312 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 9.stream 2024-03-30T17:33:14.349 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of centos 9.stream 2024-03-30T17:33:14.356 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of centos 9.stream 2024-03-30T17:33:14.550 INFO:teuthology.orchestra.console.smithi064:Power off 2024-03-30T17:33:14.550 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T17:33:14.561 INFO:teuthology.orchestra.console.smithi153:Power off 2024-03-30T17:33:14.562 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T17:33:14.574 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2024-03-30T17:33:14.574 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:14.582 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2024-03-30T17:33:14.583 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:14.600 INFO:teuthology.orchestra.console.smithi134:Power off 2024-03-30T17:33:14.600 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T17:33:14.608 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2024-03-30T17:33:14.608 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-03-30T17:33:14.621 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2024-03-30T17:33:14.621 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:14.643 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-03-30T17:33:18.610 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:18.617 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:18.644 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:18.720 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2024-03-30T17:33:18.726 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-03-30T17:33:18.751 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-03-30T17:33:22.722 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:22.729 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:22.752 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:22.831 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2024-03-30T17:33:22.838 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-03-30T17:33:22.860 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-03-30T17:33:26.834 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:26.841 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:26.861 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:26.944 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2024-03-30T17:33:26.952 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2024-03-30T17:33:26.970 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2024-03-30T17:33:27.045 INFO:teuthology.orchestra.console.smithi064:Power off completed 2024-03-30T17:33:27.053 INFO:teuthology.orchestra.console.smithi153:Power off completed 2024-03-30T17:33:27.071 INFO:teuthology.orchestra.console.smithi134:Power off completed 2024-03-30T17:33:27.146 INFO:teuthology.orchestra.console.smithi064:Power on 2024-03-30T17:33:27.147 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-30T17:33:27.154 INFO:teuthology.orchestra.console.smithi153:Power on 2024-03-30T17:33:27.154 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-30T17:33:27.169 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On 2024-03-30T17:33:27.170 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:27.176 INFO:teuthology.orchestra.console.smithi134:Power on 2024-03-30T17:33:27.177 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-30T17:33:27.183 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On 2024-03-30T17:33:27.184 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:27.192 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2024-03-30T17:33:27.196 DEBUG:teuthology.orchestra.console.smithi134:power on output: Chassis Power Control: Up/On 2024-03-30T17:33:27.197 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:27.204 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2024-03-30T17:33:27.218 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2024-03-30T17:33:31.194 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:31.206 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:31.219 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:31.303 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2024-03-30T17:33:31.314 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2024-03-30T17:33:31.328 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2024-03-30T17:33:31.405 INFO:teuthology.orchestra.console.smithi064:Power on completed 2024-03-30T17:33:31.505 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2024-03-30T17:33:35.318 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:35.329 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T17:33:35.428 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-03-30T17:33:35.438 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-03-30T17:33:35.529 INFO:teuthology.orchestra.console.smithi153:Power on completed 2024-03-30T17:33:35.539 INFO:teuthology.orchestra.console.smithi134:Power on completed 2024-03-30T17:33:35.630 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2024-03-30T17:33:35.640 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish 2024-03-30T17:36:02.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:36:05.282 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-03-30T17:36:06.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:36:09.314 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-03-30T17:36:11.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:36:14.370 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-03-30T17:36:15.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:36:18.402 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-03-30T17:36:20.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:36:21.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:36:23.426 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-03-30T17:36:24.350 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-03-30T17:36:24.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:36:27.458 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-03-30T17:36:29.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:36:30.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:36:32.510 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-03-30T17:36:33.406 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-03-30T17:36:33.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:36:36.515 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-03-30T17:36:38.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:36:39.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:36:41.566 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-03-30T17:36:42.462 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-03-30T17:36:42.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:36:45.598 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-03-30T17:36:47.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:36:48.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:36:50.622 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-03-30T17:36:51.518 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-03-30T17:36:51.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:36:54.654 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-03-30T17:36:56.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:36:57.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:36:59.678 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-03-30T17:37:00.574 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-03-30T17:37:00.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:37:03.710 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-03-30T17:37:05.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:37:06.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:37:09.634 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-03-30T17:37:09.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:37:15.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:37:18.718 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-03-30T17:37:24.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:38:05.724 WARNING:teuthology.provision.fog.smithi064:timed out 2024-03-30T17:38:09.714 WARNING:teuthology.provision.fog.smithi134:timed out 2024-03-30T17:38:11.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:38:11.985 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-30T17:38:11.985 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-30T17:38:12.313 INFO:teuthology.provision.fog.smithi064:Node is ready 2024-03-30T17:38:12.313 DEBUG:teuthology.orchestra.run.smithi064:> hostname 2024-03-30T17:38:12.329 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2024-03-30T17:38:12.329 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts 2024-03-30T17:38:12.386 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2024-03-30T17:38:12.386 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2024-03-30T17:38:12.501 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts 2024-03-30T17:38:12.533 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts 2024-03-30T17:38:12.605 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname 2024-03-30T17:38:12.676 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2024-03-30T17:38:12.746 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2024-03-30T17:38:12.801 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2024-03-30T17:38:12.801 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2024-03-30T17:38:12.801 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2024-03-30T17:38:12.801 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2024-03-30T17:38:12.801 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2024-03-30T17:38:12.801 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2024-03-30T17:38:12.801 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T17:38:12.801 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2024-03-30T17:38:12.802 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2024-03-30T17:38:12.802 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T17:38:12.802 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2024-03-30T17:38:12.802 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T17:38:12.802 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T17:38:12.802 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T17:38:12.802 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2024-03-30T17:38:12.804 DEBUG:teuthology.parallel:result is None 2024-03-30T17:38:15.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:38:16.073 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-30T17:38:16.073 DEBUG:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-30T17:38:16.448 INFO:teuthology.provision.fog.smithi134:Node is ready 2024-03-30T17:38:16.449 DEBUG:teuthology.orchestra.run.smithi134:> hostname 2024-03-30T17:38:16.464 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com 2024-03-30T17:38:16.465 DEBUG:teuthology.orchestra.run.smithi134:> grep smithi134.front.sepia.ceph.com /etc/hosts 2024-03-30T17:38:16.519 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134 2024-03-30T17:38:16.520 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2024-03-30T17:38:16.624 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hosts 2024-03-30T17:38:16.654 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/172.21.15.134/172.21.15.134/g' /etc/hosts 2024-03-30T17:38:16.721 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hostname 2024-03-30T17:38:16.790 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2024-03-30T17:38:16.857 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-03-30T17:38:16.911 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-03-30T17:38:16.911 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-03-30T17:38:16.911 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-03-30T17:38:16.911 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-03-30T17:38:16.911 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-03-30T17:38:16.912 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-03-30T17:38:16.912 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T17:38:16.912 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-03-30T17:38:16.912 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-03-30T17:38:16.912 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T17:38:16.912 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-03-30T17:38:16.912 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T17:38:16.912 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T17:38:16.912 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T17:38:16.912 INFO:teuthology.provision.fog.smithi134:Deploy complete! 2024-03-30T17:38:16.913 DEBUG:teuthology.parallel:result is None 2024-03-30T17:38:24.732 WARNING:teuthology.provision.fog.smithi153:timed out 2024-03-30T17:38:30.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:38:31.169 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-30T17:38:31.169 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-30T17:38:31.476 INFO:teuthology.provision.fog.smithi153:Node is ready 2024-03-30T17:38:31.476 DEBUG:teuthology.orchestra.run.smithi153:> hostname 2024-03-30T17:38:31.490 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2024-03-30T17:38:31.490 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts 2024-03-30T17:38:31.544 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2024-03-30T17:38:31.544 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2024-03-30T17:38:31.643 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts 2024-03-30T17:38:31.670 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts 2024-03-30T17:38:31.737 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname 2024-03-30T17:38:31.804 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2024-03-30T17:38:31.871 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-03-30T17:38:31.926 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2024-03-30T17:38:31.926 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2024-03-30T17:38:31.926 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2024-03-30T17:38:31.926 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2024-03-30T17:38:31.926 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2024-03-30T17:38:31.927 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2024-03-30T17:38:31.927 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T17:38:31.927 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2024-03-30T17:38:31.927 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2024-03-30T17:38:31.927 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T17:38:31.927 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2024-03-30T17:38:31.927 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T17:38:31.927 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T17:38:31.927 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T17:38:31.927 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2024-03-30T17:38:31.928 DEBUG:teuthology.parallel:result is None 2024-03-30T17:38:32.141 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2024-03-30T17:38:32.141 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-30T17:38:32.164 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com 2024-03-30T17:38:32.164 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-30T17:38:32.180 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2024-03-30T17:38:32.180 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-30T17:38:32.198 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2024-03-30T17:38:32.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-03-30T17:38:32.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:38:32.301 DEBUG:teuthology.orchestra.run.smithi064:> true 2024-03-30T17:38:32.484 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-03-30T17:38:32.485 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2024-03-30T17:38:32.540 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2024-03-30T17:38:32.540 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2024-03-30T17:38:32.595 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2024-03-30T17:38:32.595 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2024-03-30T17:38:32.595 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2024-03-30T17:38:32.595 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2024-03-30T17:38:32.595 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2024-03-30T17:38:32.595 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2024-03-30T17:38:32.596 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T17:38:32.596 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2024-03-30T17:38:32.596 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2024-03-30T17:38:32.596 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T17:38:32.596 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2024-03-30T17:38:32.596 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T17:38:32.596 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T17:38:32.596 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T17:38:32.596 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2024-03-30T17:38:32.614 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server 2024-03-30T17:38:32.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-03-30T17:38:32.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:38:32.702 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-03-30T17:38:32.868 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-03-30T17:38:32.868 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-03-30T17:38:32.923 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-03-30T17:38:32.923 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-03-30T17:38:32.977 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-03-30T17:38:32.978 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-03-30T17:38:32.978 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-03-30T17:38:32.978 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-03-30T17:38:32.978 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-03-30T17:38:32.978 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-03-30T17:38:32.978 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T17:38:32.978 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-03-30T17:38:32.978 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-03-30T17:38:32.978 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T17:38:32.978 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-03-30T17:38:32.978 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T17:38:32.978 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T17:38:32.979 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T17:38:32.979 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-03-30T17:38:32.998 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2024-03-30T17:38:32.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-30T17:38:32.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T17:38:33.084 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-03-30T17:38:33.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-30T17:38:33.154 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-03-30T17:38:33.209 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-03-30T17:38:33.210 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-03-30T17:38:33.265 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2024-03-30T17:38:33.265 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2024-03-30T17:38:33.265 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2024-03-30T17:38:33.265 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2024-03-30T17:38:33.266 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2024-03-30T17:38:33.266 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2024-03-30T17:38:33.266 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T17:38:33.266 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2024-03-30T17:38:33.266 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2024-03-30T17:38:33.266 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T17:38:33.266 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2024-03-30T17:38:33.266 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T17:38:33.266 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T17:38:33.266 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T17:38:33.267 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-03-30T17:38:33.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T17:38:33.383 INFO:teuthology.dispatcher.supervisor:Running job 7630899 2024-03-30T17:38:33.383 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_mchangir@teuthology --archive /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630899 --name mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630899/orig.config.yaml 2024-03-30T17:38:33.386 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630899 2024-03-30T17:38:33.386 INFO:teuthology.dispatcher.supervisor:Job PID: 842204 2024-03-30T17:38:33.386 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-30T17:40:33.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T17:42:33.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T17:44:33.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T17:46:33.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T17:48:34.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T17:50:34.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T17:52:34.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T17:54:34.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T17:56:34.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T17:58:34.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:00:35.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:02:35.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:04:35.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:06:35.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:08:35.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:10:35.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:12:36.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:14:36.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:16:36.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:18:36.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:20:36.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:22:36.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:24:37.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:26:37.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:28:37.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:30:37.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:32:37.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:34:37.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:36:38.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:38:38.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:40:38.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:42:38.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:44:38.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:46:38.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:48:39.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:50:39.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:52:39.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:54:39.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:56:39.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T18:58:39.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:00:40.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:02:40.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:04:40.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:06:40.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:08:40.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:10:40.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:12:40.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:14:41.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:16:41.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:18:41.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:20:41.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:22:41.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:24:41.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:26:42.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:28:42.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:30:42.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:32:42.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:34:42.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:36:42.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:38:43.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:40:43.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:42:43.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:44:43.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:46:43.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:48:43.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:50:44.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:52:44.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:54:44.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:56:44.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T19:58:44.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:00:44.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:02:45.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:04:45.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:06:45.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:08:45.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:10:45.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:12:45.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:14:45.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:16:46.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:18:46.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:20:46.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:22:46.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:24:46.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:26:46.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:28:47.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:30:47.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:32:47.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:34:47.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:36:47.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:38:47.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:40:48.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:42:48.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:44:48.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:46:48.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:48:48.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:50:48.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:52:49.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:54:49.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:56:49.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T20:58:49.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:00:49.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:02:49.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:04:49.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:06:50.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:08:50.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:10:50.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:12:50.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:14:50.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:16:50.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:18:51.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:20:51.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:22:51.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:24:51.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:26:51.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:28:51.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:30:52.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:32:52.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:34:52.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:36:52.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:38:52.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:40:52.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:42:53.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:44:53.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:46:53.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:48:53.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:50:53.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:52:53.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:54:54.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:56:54.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T21:58:54.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:00:54.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:02:54.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:04:54.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:06:54.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:08:55.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:10:55.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:12:55.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:14:55.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:16:55.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:18:55.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:20:56.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:22:56.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:24:56.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:26:56.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:28:56.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:30:57.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:32:57.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:34:57.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:36:57.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:38:57.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:40:57.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:42:57.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:44:58.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:46:58.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:48:58.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:50:58.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:52:58.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:54:58.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:56:59.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:58:59.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:00:59.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:02:59.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:04:59.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:06:59.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:09:00.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:11:00.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:13:00.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:15:00.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:17:00.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:19:00.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:21:01.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:23:01.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:25:01.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:27:01.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:29:01.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:31:01.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:33:02.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:35:02.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:37:02.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:39:02.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:41:02.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:43:02.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:45:03.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:47:03.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:49:03.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:51:03.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:53:03.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:55:03.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:57:03.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:59:04.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:01:04.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:03:04.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:05:04.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:07:04.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:09:05.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:11:05.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:13:05.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:15:05.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:17:05.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:19:05.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:21:06.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:23:06.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:25:06.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:27:06.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:29:06.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:31:06.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:33:07.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:35:07.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:37:07.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:39:07.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:41:07.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:43:07.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:45:08.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:47:08.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:49:08.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:51:08.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:53:08.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:55:08.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:57:08.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:59:09.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:01:09.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:03:09.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:05:09.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:07:09.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:09:09.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:11:10.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:13:10.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:15:10.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:17:10.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:19:10.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:21:10.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:23:11.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:25:11.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:27:11.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:29:11.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:31:11.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:33:12.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:35:12.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:37:12.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:39:12.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:41:12.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:43:12.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:45:13.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:47:13.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:49:13.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:51:13.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:53:13.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:55:14.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:57:14.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:59:14.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:01:14.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:03:14.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:05:14.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:07:14.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:09:15.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:11:15.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:13:15.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:15:15.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:17:15.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:19:15.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:21:16.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:23:16.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:25:16.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:27:16.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:29:17.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:31:17.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:33:17.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:35:17.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:37:17.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:39:17.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:41:18.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:43:18.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:45:18.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:47:18.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:49:18.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:51:18.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:53:19.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:55:19.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:57:19.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:59:19.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:01:19.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:03:19.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:05:20.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:07:20.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:09:20.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:11:20.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:13:20.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:15:20.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:17:20.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:19:21.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:21:21.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:23:21.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:25:21.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:27:21.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:29:21.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:31:22.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:33:22.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:35:22.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:37:22.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:39:22.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:41:22.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:43:23.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:45:23.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:47:23.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:49:23.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:51:23.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:53:23.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:55:24.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:57:24.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:59:24.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:01:24.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:03:24.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:05:24.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:07:25.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:09:25.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:11:25.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:13:25.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:15:25.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:17:25.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:19:25.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:21:26.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:23:26.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:25:26.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:27:26.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:29:26.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:31:26.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:33:27.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:35:27.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:37:27.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:39:27.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:41:27.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:43:28.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:45:28.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:47:28.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:49:28.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:51:28.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:53:28.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:55:29.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:57:29.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:59:29.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:01:29.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:03:29.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:05:29.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:07:30.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:09:30.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:11:30.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:13:30.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:15:30.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:17:30.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:19:31.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:21:31.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:23:31.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:25:31.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:27:31.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:29:31.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:31:32.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:33:32.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:35:32.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:37:32.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:39:32.727 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2024-03-31T05:39:32.881 INFO:teuthology.kill:Killing Pids: {842204} 2024-03-31T05:39:33.899 INFO:teuthology.task.internal:roles: ubuntu@smithi064.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-03-31T05:39:33.899 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-03-31T05:39:33.899 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-03-31T05:39:33.899 INFO:teuthology.misc:Compressing logs... 2024-03-31T05:39:33.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-03-31T05:39:33.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T05:39:34.047 DEBUG:teuthology.orchestra.run.smithi064:> true 2024-03-31T05:39:34.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-03-31T05:39:34.214 DEBUG:teuthology.orchestra.run.smithi064:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T05:39:34.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-03-31T05:39:34.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T05:39:34.306 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-03-31T05:39:34.387 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-03-31T05:39:34.387 DEBUG:teuthology.orchestra.run.smithi134:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T05:39:34.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-31T05:39:34.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T05:39:34.516 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-03-31T05:39:34.588 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-31T05:39:34.588 DEBUG:teuthology.orchestra.run.smithi153:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T05:39:34.661 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630899/remote/smithi064/crash 2024-03-31T05:39:34.662 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-31T05:39:34.776 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630899/remote/smithi134/crash 2024-03-31T05:39:34.777 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-31T05:39:34.820 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630899/remote/smithi153/crash 2024-03-31T05:39:34.821 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-31T05:39:34.862 INFO:teuthology.misc:Compressing logs... 2024-03-31T05:39:34.862 DEBUG:teuthology.orchestra.run.smithi064:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T05:39:34.870 DEBUG:teuthology.orchestra.run.smithi134:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T05:39:34.872 DEBUG:teuthology.orchestra.run.smithi153:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T05:39:34.899 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-31T05:39:34.900 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-31T05:39:34.900 INFO:teuthology.orchestra.run.smithi134.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-03-31T05:39:34.900 INFO:teuthology.orchestra.run.smithi134.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-03-31T05:39:34.929 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-31T05:39:34.929 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-31T05:39:34.930 INFO:teuthology.orchestra.run.smithi153.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-03-31T05:39:34.930 INFO:teuthology.orchestra.run.smithi153.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-03-31T05:39:34.964 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-31T05:39:34.966 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-31T05:39:34.967 INFO:teuthology.orchestra.run.smithi064.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-03-31T05:39:34.968 INFO:teuthology.orchestra.run.smithi064.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-03-31T05:39:34.972 DEBUG:teuthology.misc:Transferring archived files from smithi064:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630899/remote/smithi064/ 2024-03-31T05:39:34.973 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-31T05:39:35.060 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630899/remote/smithi134/ 2024-03-31T05:39:35.060 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-31T05:39:35.092 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630899/remote/smithi153/ 2024-03-31T05:39:35.092 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-31T05:39:35.120 INFO:teuthology.misc:Compressing logs... 2024-03-31T05:39:35.120 DEBUG:teuthology.orchestra.run.smithi064:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T05:39:35.128 DEBUG:teuthology.orchestra.run.smithi134:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T05:39:35.135 DEBUG:teuthology.orchestra.run.smithi153:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T05:39:35.161 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-31T05:39:35.161 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.10.log 2024-03-31T05:39:35.164 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-03-31T05:39:35.164 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.b.log 2024-03-31T05:39:35.164 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.10.log: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.4.log 2024-03-31T05:39:35.164 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.1.log 2024-03-31T05:39:35.164 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.b.log: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.k.log 2024-03-31T05:39:35.164 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.h.log 2024-03-31T05:39:35.164 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.7.log 2024-03-31T05:39:35.165 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.h.log: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-31T05:39:35.165 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.e.log 2024-03-31T05:39:35.176 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.7.log: 91.9% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-03-31T05:39:35.176 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mgr.y.log 2024-03-31T05:39:35.176 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-03-31T05:39:35.187 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-31T05:39:35.187 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.l.log 2024-03-31T05:39:35.188 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-03-31T05:39:35.188 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.i.log 2024-03-31T05:39:35.188 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.l.log: --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.11.log 2024-03-31T05:39:35.188 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.audit.log: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mgr.z.log 2024-03-31T05:39:35.189 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.8.log 2024-03-31T05:39:35.191 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mgr.z.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-31T05:39:35.192 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.5.log 2024-03-31T05:39:35.192 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.f.log 2024-03-31T05:39:35.194 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.e.log: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.log 2024-03-31T05:39:35.196 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.cephadm.log: 90.3% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-03-31T05:39:35.202 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.5.log: 91.9% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-03-31T05:39:35.205 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-03-31T05:39:35.208 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-03-31T05:39:35.219 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-31T05:39:35.220 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.log 2024-03-31T05:39:35.220 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.6.log 2024-03-31T05:39:35.221 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mon.b.log 2024-03-31T05:39:35.222 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mon.a.log 2024-03-31T05:39:35.222 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.cephadm.log: 90.2% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-03-31T05:39:35.223 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-03-31T05:39:35.223 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.6.log: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.g.log 2024-03-31T05:39:35.225 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.j.log 2024-03-31T05:39:35.227 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.2.log 2024-03-31T05:39:35.227 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.3.log 2024-03-31T05:39:35.229 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mgr.x.log 2024-03-31T05:39:35.233 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.3.log: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.0.log 2024-03-31T05:39:35.238 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-03-31T05:39:35.238 INFO:teuthology.orchestra.run.smithi064.stderr: 92.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-31T05:39:35.238 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.c.log 2024-03-31T05:39:35.239 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.log 2024-03-31T05:39:35.241 INFO:teuthology.orchestra.run.smithi064.stderr: 91.8%gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-03-31T05:39:35.241 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-03-31T05:39:35.245 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.log: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.cephadm.log: gzip 90.0% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-03-31T05:39:35.245 INFO:teuthology.orchestra.run.smithi064.stderr: -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.9.log 2024-03-31T05:39:35.248 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-03-31T05:39:35.252 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-volume.log: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.d.log 2024-03-31T05:39:35.254 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.a.log 2024-03-31T05:39:35.257 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-03-31T05:39:35.260 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mon.c.log 2024-03-31T05:39:35.268 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-03-31T05:39:35.295 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-volume.log: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mon.b.log: 91.3% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-03-31T05:39:35.311 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mgr.y.log: file size changed while zipping 2024-03-31T05:39:35.311 INFO:teuthology.orchestra.run.smithi134.stderr: 94.5% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mgr.y.log.gz 2024-03-31T05:39:35.320 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-volume.log: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mon.c.log: 94.7% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mgr.z.log.gz 2024-03-31T05:39:35.327 INFO:teuthology.orchestra.run.smithi153.stderr: 91.3% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-03-31T05:39:35.332 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-03-31T05:39:35.338 INFO:teuthology.orchestra.run.smithi064.stderr: 90.4% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-03-31T05:39:35.340 INFO:teuthology.orchestra.run.smithi134.stderr: 90.4% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-03-31T05:39:35.398 INFO:teuthology.orchestra.run.smithi153.stderr: 90.4% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-03-31T05:39:36.288 INFO:teuthology.orchestra.run.smithi134.stderr: 93.4% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.k.log.gz 2024-03-31T05:39:36.312 INFO:teuthology.orchestra.run.smithi153.stderr: 94.5% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.f.log.gz 2024-03-31T05:39:36.440 INFO:teuthology.orchestra.run.smithi064.stderr: 93.4% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.a.log.gz 2024-03-31T05:39:36.521 INFO:teuthology.orchestra.run.smithi134.stderr: 93.4% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.h.log.gz 2024-03-31T05:39:36.526 INFO:teuthology.orchestra.run.smithi064.stderr: 93.4% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.g.log.gz 2024-03-31T05:39:36.585 INFO:teuthology.orchestra.run.smithi064.stderr: 93.4% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.j.log.gz 2024-03-31T05:39:36.702 INFO:teuthology.orchestra.run.smithi153.stderr: 93.4% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.l.log.gz 2024-03-31T05:39:36.845 INFO:teuthology.orchestra.run.smithi064.stderr: 93.4% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.d.log.gz 2024-03-31T05:39:37.058 INFO:teuthology.orchestra.run.smithi134.stderr: 94.5% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.b.log.gz 2024-03-31T05:39:37.904 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.e.log: file size changed while zipping 2024-03-31T05:39:37.905 INFO:teuthology.orchestra.run.smithi134.stderr: 95.0% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.e.log.gz 2024-03-31T05:39:41.852 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.c.log: file size changed while zipping 2024-03-31T05:39:41.852 INFO:teuthology.orchestra.run.smithi153.stderr: 92.0% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.c.log.gz 2024-03-31T05:39:43.243 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mgr.x.log: file size changed while zipping 2024-03-31T05:39:43.243 INFO:teuthology.orchestra.run.smithi064.stderr: 90.3% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mgr.x.log.gz 2024-03-31T05:39:46.378 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mon.b.log: file size changed while zipping 2024-03-31T05:39:46.378 INFO:teuthology.orchestra.run.smithi134.stderr: 91.9% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mon.b.log.gz 2024-03-31T05:39:49.727 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mon.c.log: file size changed while zipping 2024-03-31T05:39:49.727 INFO:teuthology.orchestra.run.smithi153.stderr: 91.9% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mon.c.log.gz 2024-03-31T05:40:01.248 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.i.log: file size changed while zipping 2024-03-31T05:40:01.248 INFO:teuthology.orchestra.run.smithi153.stderr: 92.4% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mds.i.log.gz 2024-03-31T05:40:01.263 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.0.log: file size changed while zipping 2024-03-31T05:40:01.263 INFO:teuthology.orchestra.run.smithi064.stderr: 92.5% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.0.log.gz 2024-03-31T05:40:01.405 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.7.log: file size changed while zipping 2024-03-31T05:40:01.406 INFO:teuthology.orchestra.run.smithi134.stderr: 92.7% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.7.log.gz 2024-03-31T05:40:01.662 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.1.log: file size changed while zipping 2024-03-31T05:40:01.662 INFO:teuthology.orchestra.run.smithi134.stderr: 92.5% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.1.log.gz 2024-03-31T05:40:01.665 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.10.log: file size changed while zipping 2024-03-31T05:40:01.665 INFO:teuthology.orchestra.run.smithi134.stderr: 92.4% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.10.log.gz 2024-03-31T05:40:03.986 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mon.a.log: file size changed while zipping 2024-03-31T05:40:03.986 INFO:teuthology.orchestra.run.smithi064.stderr: 90.1% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-mon.a.log.gz 2024-03-31T05:40:05.135 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.9.log: file size changed while zipping 2024-03-31T05:40:05.136 INFO:teuthology.orchestra.run.smithi064.stderr: 92.3% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.9.log.gz 2024-03-31T05:40:06.159 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.4.log: file size changed while zipping 2024-03-31T05:40:06.159 INFO:teuthology.orchestra.run.smithi134.stderr: 92.2% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.4.log.gz 2024-03-31T05:40:06.314 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.11.log: file size changed while zipping 2024-03-31T05:40:06.314 INFO:teuthology.orchestra.run.smithi153.stderr: 92.8% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.11.log.gz 2024-03-31T05:40:08.051 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.8.log: file size changed while zipping 2024-03-31T05:40:08.051 INFO:teuthology.orchestra.run.smithi153.stderr: 92.6% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.8.log.gz 2024-03-31T05:40:09.328 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.3.log: file size changed while zipping 2024-03-31T05:40:09.328 INFO:teuthology.orchestra.run.smithi064.stderr: 92.1% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.3.log.gz 2024-03-31T05:40:11.356 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.2.log: file size changed while zipping 2024-03-31T05:40:11.357 INFO:teuthology.orchestra.run.smithi153.stderr: 92.5% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.2.log.gz 2024-03-31T05:40:12.827 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.5.log: file size changed while zipping 2024-03-31T05:40:12.827 INFO:teuthology.orchestra.run.smithi153.stderr: 92.6% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.5.log.gz 2024-03-31T05:40:14.218 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.6.log: file size changed while zipping 2024-03-31T05:40:14.218 INFO:teuthology.orchestra.run.smithi064.stderr: 91.7% -- replaced with /var/log/ceph/f7d49cd6-eebd-11ee-b647-cb9ed24678a4/ceph-osd.6.log.gz 2024-03-31T05:40:14.223 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630899/remote/smithi064/log 2024-03-31T05:40:14.224 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-31T05:40:36.739 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630899/remote/smithi134/log 2024-03-31T05:40:36.740 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-31T05:40:54.707 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630899/remote/smithi153/log 2024-03-31T05:40:54.708 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-31T05:41:15.365 INFO:teuthology.kill:No teuthology processes running 2024-03-31T05:41:16.363 INFO:teuthology.kill:Nuking machines: ['smithi064', 'smithi134', 'smithi153'] 2024-03-31T05:41:17.188 INFO:teuthology.kill:2024-03-31 05:41:17,187.187 INFO:teuthology.nuke:targets: 2024-03-31T05:41:17.188 INFO:teuthology.kill: smithi064.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIe9nR11duzB8KGoMxqmYqf1+5UmtSA8YzPOaj5BDOEmMB1IpGC6cZygfAFmzZw6Nc6kx3e8WjGDUql5/uUEvwI= 2024-03-31T05:41:17.188 INFO:teuthology.kill: smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIlqbpCkbdQnICetL7p0XF0LaczSqbIglMq8ruo0YUjc9k61HP2ZqluX35RQgDhJ9SJn59OXMV0DVpUFzhi48x0= 2024-03-31T05:41:17.188 INFO:teuthology.kill: smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKMQekLAnZDXD+Af6tQlwsdtevaNuSR3c1Qnb6I2fTdM/Y+8Yqae9RRil7O3hMt//I8639cHE7XA7gVdo/UHyuk= 2024-03-31T05:41:17.188 INFO:teuthology.kill:2024-03-31 05:41:17,187.187 INFO:teuthology.nuke:Checking targets against current locks 2024-03-31T05:41:17.244 INFO:teuthology.kill:2024-03-31 05:41:17,243.243 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-31T05:41:17.267 INFO:teuthology.kill:2024-03-31 05:41:17,267.267 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-31T05:41:17.279 INFO:teuthology.kill:2024-03-31 05:41:17,279.279 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-31T05:41:17.310 INFO:teuthology.kill:2024-03-31 05:41:17,310.310 INFO:teuthology.orchestra.console.smithi064:Power off 2024-03-31T05:41:17.347 INFO:teuthology.kill:2024-03-31 05:41:17,347.347 INFO:teuthology.orchestra.console.smithi134:Power off 2024-03-31T05:41:17.359 INFO:teuthology.kill:2024-03-31 05:41:17,359.359 INFO:teuthology.orchestra.console.smithi153:Power off 2024-03-31T05:41:25.693 INFO:teuthology.kill:2024-03-31 05:41:25,693.693 INFO:teuthology.orchestra.console.smithi064:Power off completed 2024-03-31T05:41:25.710 INFO:teuthology.kill:2024-03-31 05:41:25,710.710 INFO:teuthology.orchestra.console.smithi134:Power off completed 2024-03-31T05:41:25.841 INFO:teuthology.kill:2024-03-31 05:41:25,841.841 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com 2024-03-31T05:41:25.854 INFO:teuthology.kill:2024-03-31 05:41:25,854.854 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com 2024-03-31T05:41:29.835 INFO:teuthology.kill:2024-03-31 05:41:29,835.835 INFO:teuthology.orchestra.console.smithi153:Power off completed 2024-03-31T05:41:29.979 INFO:teuthology.kill:2024-03-31 05:41:29,979.979 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com 2024-03-31T05:41:30.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:43:30.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:43:30.300 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2024-03-31T05:43:30.443 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi064 but it was locked by another job: /home/teuthworker/archive/sjust-2024-03-31_04:48:42-rados-wip-sjust-balanced-read-testing-2024-03-30-distro-default-smithi/7631808 2024-03-31T05:43:30.444 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi134 but it was locked by another job: /home/teuthworker/archive/sjust-2024-03-31_04:48:42-rados-wip-sjust-balanced-read-testing-2024-03-30-distro-default-smithi/7631808 2024-03-31T05:43:30.444 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi153 but it was locked by another job: /home/teuthworker/archive/sjust-2024-03-31_04:48:42-rados-wip-sjust-balanced-read-testing-2024-03-30-distro-default-smithi/7631809