2024-03-30T22:47:45.031 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-30T22:47:45.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:47:45.205 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fef79dd6c10>, signals=[15]) 2024-03-30T22:47:45.206 INFO:teuthology.lock.ops:Start node 'smithi070.front.sepia.ceph.com' reimaging 2024-03-30T22:47:45.206 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: reset os type and version on server 2024-03-30T22:47:45.206 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-03-30T22:47:45.231 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2024-03-30T22:47:45.231 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2024-03-30T22:47:45.231 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-03-30T22:47:45.256 INFO:teuthology.lock.ops:Start node 'smithi204.front.sepia.ceph.com' reimaging 2024-03-30T22:47:45.256 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: reset os type and version on server 2024-03-30T22:47:45.256 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2024-03-30T22:47:45.352 DEBUG:teuthology.provision.fog.smithi070:Requesting image smithi_centos_9.stream (ID 10) 2024-03-30T22:47:45.363 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_centos_9.stream (ID 10) 2024-03-30T22:47:45.387 DEBUG:teuthology.provision.fog.smithi204:Requesting image smithi_centos_9.stream (ID 10) 2024-03-30T22:47:45.400 INFO:teuthology.provision.fog.smithi070:Scheduling deploy of centos 9.stream 2024-03-30T22:47:45.406 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of centos 9.stream 2024-03-30T22:47:45.433 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of centos 9.stream 2024-03-30T22:47:45.592 INFO:teuthology.orchestra.console.smithi070:Power off 2024-03-30T22:47:45.592 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T22:47:45.606 INFO:teuthology.orchestra.console.smithi149:Power off 2024-03-30T22:47:45.607 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T22:47:45.619 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2024-03-30T22:47:45.619 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T22:47:45.627 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2024-03-30T22:47:45.627 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T22:47:45.639 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-03-30T22:47:45.645 INFO:teuthology.orchestra.console.smithi204:Power off 2024-03-30T22:47:45.645 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T22:47:45.652 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2024-03-30T22:47:45.664 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off 2024-03-30T22:47:45.664 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T22:47:45.684 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2024-03-30T22:47:45.740 INFO:teuthology.orchestra.console.smithi070:Power off completed 2024-03-30T22:47:45.753 INFO:teuthology.orchestra.console.smithi149:Power off completed 2024-03-30T22:47:45.785 INFO:teuthology.orchestra.console.smithi204:Power off completed 2024-03-30T22:47:45.841 INFO:teuthology.orchestra.console.smithi070:Power on 2024-03-30T22:47:45.841 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-30T22:47:45.853 INFO:teuthology.orchestra.console.smithi149:Power on 2024-03-30T22:47:45.854 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-30T22:47:45.862 DEBUG:teuthology.orchestra.console.smithi070:power on output: Chassis Power Control: Up/On 2024-03-30T22:47:45.862 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T22:47:45.874 DEBUG:teuthology.orchestra.console.smithi149:power on output: Chassis Power Control: Up/On 2024-03-30T22:47:45.875 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T22:47:45.886 INFO:teuthology.orchestra.console.smithi204:Power on 2024-03-30T22:47:45.886 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-30T22:47:45.893 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-03-30T22:47:45.896 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2024-03-30T22:47:45.906 DEBUG:teuthology.orchestra.console.smithi204:power on output: Chassis Power Control: Up/On 2024-03-30T22:47:45.906 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T22:47:45.926 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2024-03-30T22:47:49.894 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T22:47:49.901 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T22:47:49.927 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T22:47:50.003 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-03-30T22:47:50.009 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2024-03-30T22:47:50.035 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2024-03-30T22:47:54.008 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T22:47:54.014 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T22:47:54.036 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T22:47:54.117 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-03-30T22:47:54.123 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-03-30T22:47:54.157 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-03-30T22:47:54.218 INFO:teuthology.orchestra.console.smithi070:Power on completed 2024-03-30T22:47:54.224 INFO:teuthology.orchestra.console.smithi149:Power on completed 2024-03-30T22:47:54.257 INFO:teuthology.orchestra.console.smithi204:Power on completed 2024-03-30T22:47:54.320 INFO:teuthology.provision.fog.smithi070:Waiting for deploy to finish 2024-03-30T22:47:54.325 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2024-03-30T22:47:54.358 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish 2024-03-30T22:50:25.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:50:28.190 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-03-30T22:50:34.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:50:37.278 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-03-30T22:50:40.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:50:40.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:50:43.230 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-03-30T22:50:43.231 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-30T22:50:43.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:50:46.334 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-03-30T22:50:49.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:50:49.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:50:52.286 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-03-30T22:50:52.286 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-30T22:50:52.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:50:55.390 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-03-30T22:50:58.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:50:58.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:51:01.342 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-03-30T22:51:01.343 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-30T22:51:01.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:51:04.446 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-03-30T22:51:07.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:51:07.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:51:10.398 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-03-30T22:51:10.399 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-30T22:51:10.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:51:13.502 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-03-30T22:51:16.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:51:16.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:51:19.454 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-03-30T22:51:19.486 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-30T22:51:19.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:51:25.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:51:25.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:51:28.510 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-03-30T22:51:28.542 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-30T22:51:34.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:51:34.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:51:37.598 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-30T22:51:43.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:51:46.686 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-30T22:51:52.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:51:55.774 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-30T22:52:01.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:52:04.830 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-30T22:52:10.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:52:13.886 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-30T22:52:19.511 WARNING:teuthology.provision.fog.smithi070:timed out 2024-03-30T22:52:19.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:52:22.942 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-30T22:52:25.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:52:25.716 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-30T22:52:25.717 DEBUG:teuthology.orchestra.run.smithi070:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-30T22:52:26.040 INFO:teuthology.provision.fog.smithi070:Node is ready 2024-03-30T22:52:26.041 DEBUG:teuthology.orchestra.run.smithi070:> hostname 2024-03-30T22:52:26.055 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070.front.sepia.ceph.com 2024-03-30T22:52:26.055 DEBUG:teuthology.orchestra.run.smithi070:> grep smithi070.front.sepia.ceph.com /etc/hosts 2024-03-30T22:52:26.111 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70 smithi070.front.sepia.ceph.com smithi070 2024-03-30T22:52:26.111 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2024-03-30T22:52:26.222 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hosts 2024-03-30T22:52:26.251 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/172.21.15.70/172.21.15.70/g' /etc/hosts 2024-03-30T22:52:26.318 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hostname 2024-03-30T22:52:26.385 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2024-03-30T22:52:26.451 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-03-30T22:52:26.505 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-03-30T22:52:26.505 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-03-30T22:52:26.505 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-03-30T22:52:26.505 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-03-30T22:52:26.505 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-03-30T22:52:26.505 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-03-30T22:52:26.506 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T22:52:26.506 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-03-30T22:52:26.506 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-03-30T22:52:26.506 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T22:52:26.506 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-03-30T22:52:26.506 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T22:52:26.506 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T22:52:26.506 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T22:52:26.507 INFO:teuthology.provision.fog.smithi070:Deploy complete! 2024-03-30T22:52:26.508 DEBUG:teuthology.parallel:result is None 2024-03-30T22:52:28.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:52:31.998 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-30T22:52:34.522 WARNING:teuthology.provision.fog.smithi204:timed out 2024-03-30T22:52:38.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:52:40.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:52:40.820 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-30T22:52:40.820 DEBUG:teuthology.orchestra.run.smithi204:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-30T22:52:41.054 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-30T22:52:41.156 INFO:teuthology.provision.fog.smithi204:Node is ready 2024-03-30T22:52:41.157 DEBUG:teuthology.orchestra.run.smithi204:> hostname 2024-03-30T22:52:41.171 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com 2024-03-30T22:52:41.171 DEBUG:teuthology.orchestra.run.smithi204:> grep smithi204.front.sepia.ceph.com /etc/hosts 2024-03-30T22:52:41.226 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204 2024-03-30T22:52:41.226 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2024-03-30T22:52:41.353 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hosts 2024-03-30T22:52:41.381 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/172.21.15.204/172.21.15.204/g' /etc/hosts 2024-03-30T22:52:41.448 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hostname 2024-03-30T22:52:41.515 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2024-03-30T22:52:41.581 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2024-03-30T22:52:41.635 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2024-03-30T22:52:41.635 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="9" 2024-03-30T22:52:41.635 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2024-03-30T22:52:41.635 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2024-03-30T22:52:41.635 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="9" 2024-03-30T22:52:41.635 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el9" 2024-03-30T22:52:41.636 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T22:52:41.636 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2024-03-30T22:52:41.636 INFO:teuthology.orchestra.run.smithi204.stdout:LOGO="fedora-logo-icon" 2024-03-30T22:52:41.636 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T22:52:41.636 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2024-03-30T22:52:41.636 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T22:52:41.636 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T22:52:41.636 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T22:52:41.636 INFO:teuthology.provision.fog.smithi204:Deploy complete! 2024-03-30T22:52:41.637 DEBUG:teuthology.parallel:result is None 2024-03-30T22:52:47.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:53:47.096 WARNING:teuthology.provision.fog.smithi149:timed out 2024-03-30T22:53:53.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:53:53.570 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-30T22:53:53.570 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-30T22:53:53.899 INFO:teuthology.provision.fog.smithi149:Node is ready 2024-03-30T22:53:53.899 DEBUG:teuthology.orchestra.run.smithi149:> hostname 2024-03-30T22:53:53.914 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com 2024-03-30T22:53:53.914 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts 2024-03-30T22:53:53.968 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2024-03-30T22:53:53.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2024-03-30T22:53:54.093 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts 2024-03-30T22:53:54.121 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts 2024-03-30T22:53:54.188 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname 2024-03-30T22:53:54.255 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2024-03-30T22:53:54.321 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-03-30T22:53:54.376 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-03-30T22:53:54.376 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2024-03-30T22:53:54.376 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-03-30T22:53:54.376 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-03-30T22:53:54.376 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2024-03-30T22:53:54.376 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2024-03-30T22:53:54.376 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T22:53:54.376 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-03-30T22:53:54.376 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2024-03-30T22:53:54.376 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T22:53:54.377 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-03-30T22:53:54.377 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T22:53:54.377 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T22:53:54.377 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T22:53:54.377 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2024-03-30T22:53:54.377 DEBUG:teuthology.parallel:result is None 2024-03-30T22:53:54.587 INFO:teuthology.lock.ops:Checking smithi070.front.sepia.ceph.com 2024-03-30T22:53:54.587 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-30T22:53:54.609 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2024-03-30T22:53:54.609 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-30T22:53:54.632 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com 2024-03-30T22:53:54.632 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-30T22:53:54.660 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: set os type and version on server 2024-03-30T22:53:54.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-03-30T22:53:54.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:53:54.750 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-03-30T22:53:54.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-03-30T22:53:54.916 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-03-30T22:53:54.971 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-03-30T22:53:54.971 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-03-30T22:53:55.027 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-03-30T22:53:55.027 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-03-30T22:53:55.027 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-03-30T22:53:55.027 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-03-30T22:53:55.027 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-03-30T22:53:55.027 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-03-30T22:53:55.027 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T22:53:55.027 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-03-30T22:53:55.027 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-03-30T22:53:55.027 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T22:53:55.027 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-03-30T22:53:55.027 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T22:53:55.027 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T22:53:55.027 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T22:53:55.028 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-03-30T22:53:55.051 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2024-03-30T22:53:55.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-03-30T22:53:55.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:53:55.134 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-03-30T22:53:55.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-03-30T22:53:55.200 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2024-03-30T22:53:55.255 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2024-03-30T22:53:55.255 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-03-30T22:53:55.310 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-03-30T22:53:55.310 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2024-03-30T22:53:55.310 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-03-30T22:53:55.310 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-03-30T22:53:55.310 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2024-03-30T22:53:55.310 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2024-03-30T22:53:55.310 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T22:53:55.310 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-03-30T22:53:55.310 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2024-03-30T22:53:55.310 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T22:53:55.310 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-03-30T22:53:55.311 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T22:53:55.311 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T22:53:55.311 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T22:53:55.311 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-03-30T22:53:55.334 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server 2024-03-30T22:53:55.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-30T22:53:55.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T22:53:55.417 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-03-30T22:53:55.584 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-30T22:53:55.584 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2024-03-30T22:53:55.639 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2024-03-30T22:53:55.639 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2024-03-30T22:53:55.693 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2024-03-30T22:53:55.693 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="9" 2024-03-30T22:53:55.693 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2024-03-30T22:53:55.693 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2024-03-30T22:53:55.693 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="9" 2024-03-30T22:53:55.693 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el9" 2024-03-30T22:53:55.693 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T22:53:55.694 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2024-03-30T22:53:55.694 INFO:teuthology.orchestra.run.smithi204.stdout:LOGO="fedora-logo-icon" 2024-03-30T22:53:55.694 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T22:53:55.694 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2024-03-30T22:53:55.694 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T22:53:55.694 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T22:53:55.694 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T22:53:55.697 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2024-03-30T22:53:55.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:53:55.820 INFO:teuthology.dispatcher.supervisor:Running job 7630998 2024-03-30T22:53:55.821 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_mchangir@teuthology --archive /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630998 --name mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/fsx}} -- /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630998/orig.config.yaml 2024-03-30T22:53:55.823 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630998 2024-03-30T22:53:55.824 INFO:teuthology.dispatcher.supervisor:Job PID: 1515819 2024-03-30T22:53:55.824 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-30T22:55:55.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:57:56.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T22:59:56.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:01:56.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:03:56.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:05:56.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:07:56.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:09:57.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:11:57.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:13:57.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:15:57.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:17:57.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:19:58.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:21:58.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:23:58.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:25:58.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:27:58.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:29:58.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:31:59.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:33:59.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:35:59.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:37:59.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:39:59.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:41:59.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:44:00.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:46:00.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:48:00.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:50:00.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:52:00.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:54:01.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:56:01.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T23:58:01.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:00:01.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:02:01.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:04:02.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:06:02.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:08:02.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:10:02.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:12:02.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:14:02.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:16:03.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:18:03.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:20:03.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:22:03.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:24:03.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:26:03.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:28:04.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:30:04.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:32:04.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:34:04.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:36:04.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:38:04.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:40:05.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:42:05.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:44:05.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:46:05.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:48:05.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:50:05.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:52:06.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:54:06.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:56:06.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T00:58:06.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:00:06.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:02:06.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:04:07.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:06:07.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:08:07.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:10:07.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:12:07.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:14:08.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:16:08.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:18:08.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:20:08.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:22:08.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:24:08.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:26:09.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:28:09.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:30:09.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:32:09.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:34:09.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:36:09.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:38:10.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:40:10.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:42:10.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:44:10.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:46:10.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:48:10.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:50:11.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:52:11.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:54:11.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:56:11.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T01:58:11.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:00:12.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:02:12.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:04:12.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:06:12.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:08:12.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:10:12.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:12:13.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:14:13.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:16:13.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:18:13.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:20:13.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:22:13.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:24:14.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:26:14.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:28:14.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:30:14.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:32:14.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:34:14.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:36:14.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:38:15.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:40:15.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:42:15.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:44:15.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:46:15.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:48:15.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:50:16.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:52:16.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:54:16.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:56:16.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T02:58:16.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:00:16.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:02:17.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:04:17.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:06:17.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:08:17.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:10:17.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:12:17.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:14:18.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:16:18.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:18:18.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:20:18.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:22:18.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:24:19.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:26:19.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:28:19.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:30:19.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:32:19.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:34:19.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:36:20.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:38:20.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:40:20.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:42:20.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:44:20.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:46:21.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:48:21.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:50:21.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:52:21.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:54:21.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:56:21.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T03:58:22.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:00:22.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:02:22.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:04:22.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:06:22.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:08:22.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:10:23.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:12:23.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:14:23.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:16:23.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:18:23.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:20:23.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:22:24.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:24:24.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:26:24.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:28:24.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:30:24.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:32:24.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:34:25.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:36:25.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:38:25.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:40:25.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:42:25.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:44:25.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:46:25.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:48:26.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:50:26.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:52:26.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:54:26.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:56:26.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:58:26.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:00:27.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:02:27.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:04:27.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:06:27.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:08:27.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:10:27.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:12:28.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:14:28.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:16:28.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:18:28.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:20:28.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:22:28.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:24:29.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:26:29.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:28:29.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:30:29.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:32:29.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:34:29.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:36:30.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:38:30.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:40:30.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:42:30.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:44:30.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:46:30.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:48:31.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:50:31.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:52:31.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:54:31.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:56:31.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:58:31.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:00:32.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:02:32.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:04:32.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:06:32.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:08:32.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:10:33.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:12:33.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:14:33.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:16:33.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:18:33.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:20:33.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:22:33.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:24:34.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:26:34.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:28:34.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:30:34.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:32:34.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:34:34.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:36:35.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:38:35.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:40:35.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:42:35.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:44:35.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:46:35.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:48:36.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:50:36.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:52:36.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:54:36.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:56:36.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T06:58:36.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:00:37.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:02:37.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:04:37.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:06:37.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:08:37.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:10:37.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:12:38.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:14:38.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:16:38.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:18:38.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:20:38.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:22:38.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:24:39.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:26:39.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:28:39.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:30:39.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:32:39.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:34:39.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:36:40.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:38:40.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:40:40.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:42:40.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:44:40.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:46:41.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:48:41.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:50:41.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:52:41.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:54:41.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:56:41.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T07:58:42.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:00:42.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:02:42.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:04:42.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:06:42.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:08:42.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:10:42.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:12:43.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:14:43.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:16:43.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:18:43.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:20:43.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:22:43.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:24:44.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:26:44.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:28:44.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:30:44.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:32:44.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:34:44.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:36:45.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:38:45.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:40:45.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:42:45.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:44:45.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:46:45.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:48:46.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:50:46.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:52:46.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:54:46.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:56:46.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T08:58:46.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:00:47.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:02:47.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:04:47.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:06:47.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:08:47.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:10:47.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:12:48.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:14:48.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:16:48.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:18:48.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:20:48.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:22:48.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:24:49.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:26:49.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:28:49.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:30:49.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:32:49.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:34:49.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:36:50.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:38:50.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:40:50.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:42:50.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:44:50.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:46:50.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:48:50.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:50:51.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:52:51.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:54:51.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:56:51.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T09:58:51.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:00:51.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:02:52.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:04:52.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:06:52.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:08:52.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:10:52.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:12:52.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:14:53.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:16:53.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:18:53.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:20:53.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:22:53.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:24:53.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:26:54.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:28:54.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:30:54.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:32:54.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:34:54.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:36:57.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:38:57.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:40:58.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:42:58.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:44:58.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:46:58.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:48:58.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:50:58.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:52:59.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T10:54:59.228 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2024-03-31T10:54:59.378 INFO:teuthology.kill:Killing Pids: {1515819} 2024-03-31T10:55:00.535 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-03-31T10:55:00.536 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-03-31T10:55:00.536 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-03-31T10:55:00.536 INFO:teuthology.misc:Compressing logs... 2024-03-31T10:55:00.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-03-31T10:55:00.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T10:55:00.632 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-03-31T10:55:00.728 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-03-31T10:55:00.728 DEBUG:teuthology.orchestra.run.smithi070:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T10:55:00.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-03-31T10:55:00.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T10:55:00.899 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-03-31T10:55:00.987 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-03-31T10:55:00.987 DEBUG:teuthology.orchestra.run.smithi149:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T10:55:01.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-31T10:55:01.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T10:55:01.157 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-03-31T10:55:01.232 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-03-31T10:55:01.232 DEBUG:teuthology.orchestra.run.smithi204:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T10:55:01.306 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630998/remote/smithi070/crash 2024-03-31T10:55:01.307 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-31T10:55:01.349 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630998/remote/smithi149/crash 2024-03-31T10:55:01.350 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-31T10:55:01.391 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630998/remote/smithi204/crash 2024-03-31T10:55:01.392 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-31T10:55:01.436 INFO:teuthology.misc:Compressing logs... 2024-03-31T10:55:01.436 DEBUG:teuthology.orchestra.run.smithi070:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T10:55:01.438 DEBUG:teuthology.orchestra.run.smithi149:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T10:55:01.441 DEBUG:teuthology.orchestra.run.smithi204:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T10:55:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-31T10:55:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-31T10:55:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-03-31T10:55:01.464 INFO:teuthology.orchestra.run.smithi070.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-03-31T10:55:01.476 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-31T10:55:01.476 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-31T10:55:01.476 INFO:teuthology.orchestra.run.smithi149.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-03-31T10:55:01.476 INFO:teuthology.orchestra.run.smithi149.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-03-31T10:55:01.506 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-31T10:55:01.506 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-31T10:55:01.506 INFO:teuthology.orchestra.run.smithi204.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-03-31T10:55:01.507 INFO:teuthology.orchestra.run.smithi204.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-03-31T10:55:01.507 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630998/remote/smithi070/ 2024-03-31T10:55:01.507 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-31T10:55:01.536 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630998/remote/smithi149/ 2024-03-31T10:55:01.537 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-31T10:55:01.565 DEBUG:teuthology.misc:Transferring archived files from smithi204:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630998/remote/smithi204/ 2024-03-31T10:55:01.565 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-31T10:55:01.594 INFO:teuthology.misc:Compressing logs... 2024-03-31T10:55:01.594 DEBUG:teuthology.orchestra.run.smithi070:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T10:55:01.596 DEBUG:teuthology.orchestra.run.smithi149:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T10:55:01.609 DEBUG:teuthology.orchestra.run.smithi204:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-31T10:55:01.621 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-31T10:55:01.621 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.6.log 2024-03-31T10:55:01.621 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mon.a.log 2024-03-31T10:55:01.621 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-03-31T10:55:01.622 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.g.log 2024-03-31T10:55:01.623 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.j.log 2024-03-31T10:55:01.623 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.audit.log: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.3.log 2024-03-31T10:55:01.623 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mgr.x.log 2024-03-31T10:55:01.631 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.3.log: 92.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-31T10:55:01.633 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.0.log 2024-03-31T10:55:01.634 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-31T10:55:01.634 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.10.log 2024-03-31T10:55:01.634 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-03-31T10:55:01.634 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.b.log 2024-03-31T10:55:01.635 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.4.log 2024-03-31T10:55:01.636 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mgr.x.log: 91.8% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-03-31T10:55:01.636 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-03-31T10:55:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.1.log 2024-03-31T10:55:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.k.log 2024-03-31T10:55:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.h.log 2024-03-31T10:55:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.7.log 2024-03-31T10:55:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.e.log 2024-03-31T10:55:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mgr.y.log 2024-03-31T10:55:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-03-31T10:55:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.log 2024-03-31T10:55:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-03-31T10:55:01.637 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mon.b.log 2024-03-31T10:55:01.642 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.log 2024-03-31T10:55:01.649 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.cephadm.log: 89.7% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-03-31T10:55:01.651 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-03-31T10:55:01.665 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-31T10:55:01.665 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.l.log 2024-03-31T10:55:01.665 INFO:teuthology.orchestra.run.smithi204.stderr:gzip/var/log/ceph/cephadm.log: -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-03-31T10:55:01.665 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.i.log 2024-03-31T10:55:01.665 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.l.log: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.11.log 2024-03-31T10:55:01.665 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mgr.z.log 2024-03-31T10:55:01.666 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.i.log: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.8.log 2024-03-31T10:55:01.666 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.5.log 2024-03-31T10:55:01.667 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.8.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-31T10:55:01.668 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.f.log 2024-03-31T10:55:01.669 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-03-31T10:55:01.670 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.log: gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.9.log 2024-03-31T10:55:01.677 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.f.log: 91.9% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-03-31T10:55:01.678 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.log 2024-03-31T10:55:01.679 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.cephadm.log: 90.0% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-03-31T10:55:01.679 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.2.log 2024-03-31T10:55:01.680 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.d.log 2024-03-31T10:55:01.686 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.log: gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.c.log 2024-03-31T10:55:01.690 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.a.log 2024-03-31T10:55:01.703 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-03-31T10:55:01.713 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mon.c.log 2024-03-31T10:55:01.732 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.d.log: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.a.log: 91.4% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-03-31T10:55:01.783 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-volume.log: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mon.c.log: 91.3% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-03-31T10:55:01.792 INFO:teuthology.orchestra.run.smithi204.stderr: 90.5% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-03-31T10:55:01.796 INFO:teuthology.orchestra.run.smithi204.stderr: 94.6% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mgr.z.log.gz 2024-03-31T10:55:01.811 INFO:teuthology.orchestra.run.smithi070.stderr: 90.5% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-03-31T10:55:01.928 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.10.log: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.audit.log: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.b.log: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.4.log: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.1.log: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.k.log: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.h.log: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.7.log: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.e.log: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mgr.y.log: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.cephadm.log: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.log: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-volume.log: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mon.b.log: 90.0% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-03-31T10:55:01.951 INFO:teuthology.orchestra.run.smithi149.stderr: 91.9% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-03-31T10:55:01.966 INFO:teuthology.orchestra.run.smithi149.stderr: 91.3% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-03-31T10:55:02.201 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mgr.y.log: file size changed while zipping 2024-03-31T10:55:02.201 INFO:teuthology.orchestra.run.smithi149.stderr: 94.7% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mgr.y.log.gz 2024-03-31T10:55:02.256 INFO:teuthology.orchestra.run.smithi149.stderr: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-31T10:55:02.764 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.log: file size changed while zipping 2024-03-31T10:55:02.764 INFO:teuthology.orchestra.run.smithi149.stderr: 90.5% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-03-31T10:55:03.116 INFO:teuthology.orchestra.run.smithi070.stderr: 94.9% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.g.log.gz 2024-03-31T10:55:03.120 INFO:teuthology.orchestra.run.smithi070.stderr: 94.8% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.j.log.gz 2024-03-31T10:55:03.163 INFO:teuthology.orchestra.run.smithi070.stderr: 94.9% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.a.log.gz 2024-03-31T10:55:03.466 INFO:teuthology.orchestra.run.smithi204.stderr: 94.9% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.l.log.gz 2024-03-31T10:55:03.493 INFO:teuthology.orchestra.run.smithi070.stderr: 94.8% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.d.log.gz 2024-03-31T10:55:03.686 INFO:teuthology.orchestra.run.smithi204.stderr: 95.1% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.c.log.gz 2024-03-31T10:55:03.770 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.i.log: file size changed while zipping 2024-03-31T10:55:03.771 INFO:teuthology.orchestra.run.smithi204.stderr: 94.5% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.i.log.gz 2024-03-31T10:55:04.096 INFO:teuthology.orchestra.run.smithi204.stderr: 94.9% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.f.log.gz 2024-03-31T10:55:08.899 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mgr.x.log: file size changed while zipping 2024-03-31T10:55:08.899 INFO:teuthology.orchestra.run.smithi070.stderr: 90.2% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mgr.x.log.gz 2024-03-31T10:55:10.432 INFO:teuthology.orchestra.run.smithi149.stderr: 95.0% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.h.log.gz 2024-03-31T10:55:11.728 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.e.log: file size changed while zipping 2024-03-31T10:55:11.728 INFO:teuthology.orchestra.run.smithi149.stderr: 95.3% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.e.log.gz 2024-03-31T10:55:12.189 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.k.log: file size changed while zipping 2024-03-31T10:55:12.189 INFO:teuthology.orchestra.run.smithi149.stderr: 95.1% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.k.log.gz 2024-03-31T10:55:17.382 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mon.c.log: file size changed while zipping 2024-03-31T10:55:17.382 INFO:teuthology.orchestra.run.smithi204.stderr: 92.1% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mon.c.log.gz 2024-03-31T10:55:21.177 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.9.log: file size changed while zipping 2024-03-31T10:55:21.177 INFO:teuthology.orchestra.run.smithi070.stderr: 92.6% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.9.log.gz 2024-03-31T10:55:22.533 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.2.log: file size changed while zipping 2024-03-31T10:55:22.533 INFO:teuthology.orchestra.run.smithi204.stderr: 92.8% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.2.log.gz 2024-03-31T10:55:22.852 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.8.log: file size changed while zipping 2024-03-31T10:55:22.852 INFO:teuthology.orchestra.run.smithi204.stderr: 92.8% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.8.log.gz 2024-03-31T10:55:23.668 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.11.log: file size changed while zipping 2024-03-31T10:55:23.669 INFO:teuthology.orchestra.run.smithi204.stderr: 93.0% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.11.log.gz 2024-03-31T10:55:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mon.a.log: file size changed while zipping 2024-03-31T10:55:24.603 INFO:teuthology.orchestra.run.smithi070.stderr: 89.8% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mon.a.log.gz 2024-03-31T10:55:26.143 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.5.log: file size changed while zipping 2024-03-31T10:55:26.144 INFO:teuthology.orchestra.run.smithi204.stderr: 92.8% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.5.log.gz 2024-03-31T10:55:26.497 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.0.log: file size changed while zipping 2024-03-31T10:55:26.497 INFO:teuthology.orchestra.run.smithi070.stderr: 92.7% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.0.log.gz 2024-03-31T10:55:26.575 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.6.log: file size changed while zipping 2024-03-31T10:55:26.575 INFO:teuthology.orchestra.run.smithi070.stderr: 92.2% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.6.log.gz 2024-03-31T10:55:31.126 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.3.log: file size changed while zipping 2024-03-31T10:55:31.127 INFO:teuthology.orchestra.run.smithi070.stderr: 92.5% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.3.log.gz 2024-03-31T10:56:24.066 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mon.b.log: file size changed while zipping 2024-03-31T10:56:24.067 INFO:teuthology.orchestra.run.smithi149.stderr: 92.1% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mon.b.log.gz 2024-03-31T10:56:33.152 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.b.log: file size changed while zipping 2024-03-31T10:56:33.152 INFO:teuthology.orchestra.run.smithi149.stderr: 93.7% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-mds.b.log.gz 2024-03-31T10:56:51.331 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.1.log: file size changed while zipping 2024-03-31T10:56:51.331 INFO:teuthology.orchestra.run.smithi149.stderr: 92.8% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.1.log.gz 2024-03-31T10:57:04.725 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.4.log: file size changed while zipping 2024-03-31T10:57:04.725 INFO:teuthology.orchestra.run.smithi149.stderr: 92.3% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.4.log.gz 2024-03-31T10:57:05.719 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.7.log: file size changed while zipping 2024-03-31T10:57:05.719 INFO:teuthology.orchestra.run.smithi149.stderr: 93.0% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.7.log.gz 2024-03-31T10:57:13.412 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.10.log: file size changed while zipping 2024-03-31T10:57:13.412 INFO:teuthology.orchestra.run.smithi149.stderr: 92.2% -- replaced with /var/log/ceph/5f9f1bf8-eeea-11ee-b647-cb9ed24678a4/ceph-osd.10.log.gz 2024-03-31T10:57:13.415 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630998/remote/smithi070/log 2024-03-31T10:57:13.416 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-31T10:57:32.072 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630998/remote/smithi149/log 2024-03-31T10:57:32.073 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-31T10:57:50.372 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7630998/remote/smithi204/log 2024-03-31T10:57:50.373 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-31T10:58:04.780 INFO:teuthology.kill:No teuthology processes running 2024-03-31T10:58:05.795 INFO:teuthology.kill:Nuking machines: ['smithi070', 'smithi149', 'smithi204'] 2024-03-31T10:58:06.643 INFO:teuthology.kill:2024-03-31 10:58:06,643.643 INFO:teuthology.nuke:targets: 2024-03-31T10:58:06.643 INFO:teuthology.kill: smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCBA/XK7Byt4BBRoOdDwqNFazMXKsq0vvYv59xrcoLzUez0wZSiqOTdEvC/Ra4a1KdKx/OOJpbL1CTq9Ozq5oH4= 2024-03-31T10:58:06.644 INFO:teuthology.kill: smithi149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIDkEEqP1WoLMgAbZUbfYH+N2MhBQoizVNpNP2uBtI9OczwWpPh6hBA5vxbCDXGOQ08tBdr8vs82QEMqfHjufSg= 2024-03-31T10:58:06.644 INFO:teuthology.kill: smithi204.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEJICJ/i8JtiJ9GXRJsqVQtXt6Tjku7dVr+uh2DFjZmmnZCR395K4+qaCYRgyP+GYs9bGT5iN+k5wR8PlsVnLsc= 2024-03-31T10:58:06.644 INFO:teuthology.kill:2024-03-31 10:58:06,644.644 INFO:teuthology.nuke:Checking targets against current locks 2024-03-31T10:58:06.695 INFO:teuthology.kill:2024-03-31 10:58:06,695.695 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-31T10:58:06.725 INFO:teuthology.kill:2024-03-31 10:58:06,725.725 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-31T10:58:06.755 INFO:teuthology.kill:2024-03-31 10:58:06,755.755 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-31T10:58:06.788 INFO:teuthology.kill:2024-03-31 10:58:06,787.787 INFO:teuthology.orchestra.console.smithi070:Power off 2024-03-31T10:58:06.828 INFO:teuthology.kill:2024-03-31 10:58:06,828.828 INFO:teuthology.orchestra.console.smithi149:Power off 2024-03-31T10:58:06.867 INFO:teuthology.kill:2024-03-31 10:58:06,867.867 INFO:teuthology.orchestra.console.smithi204:Power off 2024-03-31T10:58:19.272 INFO:teuthology.kill:2024-03-31 10:58:19,271.271 INFO:teuthology.orchestra.console.smithi070:Power off completed 2024-03-31T10:58:19.308 INFO:teuthology.kill:2024-03-31 10:58:19,308.308 INFO:teuthology.orchestra.console.smithi149:Power off completed 2024-03-31T10:58:19.340 INFO:teuthology.kill:2024-03-31 10:58:19,340.340 INFO:teuthology.orchestra.console.smithi204:Power off completed 2024-03-31T10:58:19.431 INFO:teuthology.kill:2024-03-31 10:58:19,430.430 INFO:teuthology.lock.ops:unlocked: smithi070.front.sepia.ceph.com 2024-03-31T10:58:19.454 INFO:teuthology.kill:2024-03-31 10:58:19,454.454 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com 2024-03-31T10:58:19.487 INFO:teuthology.kill:2024-03-31 10:58:19,487.487 INFO:teuthology.lock.ops:unlocked: smithi204.front.sepia.ceph.com 2024-03-31T10:58:19.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:00:19.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T11:00:19.805 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2024-03-31T11:00:19.938 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi070 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-30_21:16:02-rbd-squid-distro-default-smithi/7631352 2024-03-31T11:00:19.938 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi149 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-30_21:16:02-rbd-squid-distro-default-smithi/7631353 2024-03-31T11:00:19.938 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi204 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-30_21:16:02-rbd-squid-distro-default-smithi/7631352