2024-04-12T20:34:48.743 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-12T20:34:48.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:34:48.924 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff61f469f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff620408c10>, signals=[15])
2024-04-12T20:34:48.924 INFO:teuthology.lock.ops:Start node 'smithi067.front.sepia.ceph.com' reimaging
2024-04-12T20:34:48.925 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: reset os type and version on server
2024-04-12T20:34:48.925 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server
2024-04-12T20:34:48.949 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging
2024-04-12T20:34:48.949 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server
2024-04-12T20:34:48.949 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server
2024-04-12T20:34:48.975 INFO:teuthology.lock.ops:Start node 'smithi146.front.sepia.ceph.com' reimaging
2024-04-12T20:34:48.975 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: reset os type and version on server
2024-04-12T20:34:48.975 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server
2024-04-12T20:34:49.067 DEBUG:teuthology.provision.fog.smithi067:Requesting image smithi_centos_9.stream (ID 10)
2024-04-12T20:34:49.079 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_centos_9.stream (ID 10)
2024-04-12T20:34:49.113 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of centos 9.stream
2024-04-12T20:34:49.119 DEBUG:teuthology.provision.fog.smithi146:Requesting image smithi_centos_9.stream (ID 10)
2024-04-12T20:34:49.123 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of centos 9.stream
2024-04-12T20:34:49.165 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of centos 9.stream
2024-04-12T20:34:49.353 INFO:teuthology.orchestra.console.smithi103:Power off
2024-04-12T20:34:49.353 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-12T20:34:49.367 INFO:teuthology.orchestra.console.smithi067:Power off
2024-04-12T20:34:49.367 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-12T20:34:49.381 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off
2024-04-12T20:34:49.381 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T20:34:49.392 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off
2024-04-12T20:34:49.393 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T20:34:49.403 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2024-04-12T20:34:49.409 INFO:teuthology.orchestra.console.smithi146:Power off
2024-04-12T20:34:49.410 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-12T20:34:49.418 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on
2024-04-12T20:34:49.431 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off
2024-04-12T20:34:49.431 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T20:34:49.455 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on
2024-04-12T20:34:53.406 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T20:34:53.420 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T20:34:53.456 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T20:34:53.516 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2024-04-12T20:34:53.528 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on
2024-04-12T20:34:53.566 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on
2024-04-12T20:34:57.520 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T20:34:57.529 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T20:34:57.567 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T20:34:57.630 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2024-04-12T20:34:57.638 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on
2024-04-12T20:34:57.675 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on
2024-04-12T20:35:01.634 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T20:35:01.642 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T20:35:01.676 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T20:35:01.744 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2024-04-12T20:35:01.750 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off
2024-04-12T20:35:01.785 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off
2024-04-12T20:35:01.845 INFO:teuthology.orchestra.console.smithi103:Power off completed
2024-04-12T20:35:01.851 INFO:teuthology.orchestra.console.smithi067:Power off completed
2024-04-12T20:35:01.886 INFO:teuthology.orchestra.console.smithi146:Power off completed
2024-04-12T20:35:01.946 INFO:teuthology.orchestra.console.smithi103:Power on
2024-04-12T20:35:01.946 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-12T20:35:01.954 INFO:teuthology.orchestra.console.smithi067:Power on
2024-04-12T20:35:01.954 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-12T20:35:01.967 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On
2024-04-12T20:35:01.967 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T20:35:01.977 DEBUG:teuthology.orchestra.console.smithi067:power on output: Chassis Power Control: Up/On
2024-04-12T20:35:01.978 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T20:35:01.987 INFO:teuthology.orchestra.console.smithi146:Power on
2024-04-12T20:35:01.987 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-12T20:35:01.995 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2024-04-12T20:35:01.999 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off
2024-04-12T20:35:02.007 DEBUG:teuthology.orchestra.console.smithi146:power on output: Chassis Power Control: Up/On
2024-04-12T20:35:02.007 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T20:35:02.031 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off
2024-04-12T20:35:05.998 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T20:35:06.006 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T20:35:06.031 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T20:35:06.108 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2024-04-12T20:35:06.116 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on
2024-04-12T20:35:06.140 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on
2024-04-12T20:35:06.217 INFO:teuthology.orchestra.console.smithi067:Power on completed
2024-04-12T20:35:06.241 INFO:teuthology.orchestra.console.smithi146:Power on completed
2024-04-12T20:35:06.318 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish
2024-04-12T20:35:06.342 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish
2024-04-12T20:35:10.110 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T20:35:10.219 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2024-04-12T20:35:10.319 INFO:teuthology.orchestra.console.smithi103:Power on completed
2024-04-12T20:35:10.420 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish
2024-04-12T20:37:52.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:37:52.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:37:55.326 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-12T20:37:55.327 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2024-04-12T20:37:56.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:37:59.362 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-12T20:38:01.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:01.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:04.382 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-12T20:38:04.383 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2024-04-12T20:38:05.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:08.414 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-12T20:38:10.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:10.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:13.442 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-12T20:38:13.443 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2024-04-12T20:38:14.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:17.470 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-12T20:38:19.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:19.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:22.526 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-12T20:38:22.527 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2024-04-12T20:38:23.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:26.526 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-12T20:38:28.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:28.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:31.582 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-12T20:38:31.583 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2024-04-12T20:38:32.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:35.582 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-12T20:38:37.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:37.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:40.642 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2024-04-12T20:38:40.643 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-12T20:38:41.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:44.638 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-12T20:38:46.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:46.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:49.726 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2024-04-12T20:38:49.727 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-12T20:38:50.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:53.694 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-12T20:38:55.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:55.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:38:59.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:39:02.750 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-12T20:39:08.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:39:14.206 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-12T20:39:20.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:39:23.262 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-12T20:39:29.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:39:32.318 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-12T20:39:38.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:39:38.595 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-12T20:39:38.596 DEBUG:teuthology.orchestra.run.smithi146:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-12T20:39:55.731 WARNING:teuthology.provision.fog.smithi067:timed out
2024-04-12T20:39:58.949 INFO:teuthology.provision.fog.smithi146:Node is ready
2024-04-12T20:39:58.949 DEBUG:teuthology.orchestra.run.smithi146:> hostname
2024-04-12T20:39:59.015 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com
2024-04-12T20:39:59.015 DEBUG:teuthology.orchestra.run.smithi146:> grep smithi146.front.sepia.ceph.com /etc/hosts
2024-04-12T20:39:59.077 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146
2024-04-12T20:39:59.077 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146
2024-04-12T20:39:59.203 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hosts
2024-04-12T20:39:59.237 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/172.21.15.146/172.21.15.146/g' /etc/hosts
2024-04-12T20:39:59.310 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hostname
2024-04-12T20:39:59.384 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146
2024-04-12T20:39:59.455 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release
2024-04-12T20:39:59.512 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream"
2024-04-12T20:39:59.513 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9"
2024-04-12T20:39:59.513 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos"
2024-04-12T20:39:59.513 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora"
2024-04-12T20:39:59.513 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9"
2024-04-12T20:39:59.513 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9"
2024-04-12T20:39:59.513 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-12T20:39:59.513 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31"
2024-04-12T20:39:59.513 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon"
2024-04-12T20:39:59.513 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-12T20:39:59.513 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/"
2024-04-12T20:39:59.513 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T20:39:59.513 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-12T20:39:59.514 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-12T20:39:59.515 INFO:teuthology.provision.fog.smithi146:Deploy complete!
2024-04-12T20:39:59.516 DEBUG:teuthology.parallel:result is None
2024-04-12T20:40:01.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:40:02.011 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-12T20:40:02.011 DEBUG:teuthology.orchestra.run.smithi067:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-12T20:40:02.389 INFO:teuthology.provision.fog.smithi067:Node is ready
2024-04-12T20:40:02.389 DEBUG:teuthology.orchestra.run.smithi067:> hostname
2024-04-12T20:40:02.404 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com
2024-04-12T20:40:02.405 DEBUG:teuthology.orchestra.run.smithi067:> grep smithi067.front.sepia.ceph.com /etc/hosts
2024-04-12T20:40:02.461 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067
2024-04-12T20:40:02.461 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067
2024-04-12T20:40:02.565 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hosts
2024-04-12T20:40:02.597 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/172.21.15.67/172.21.15.67/g' /etc/hosts
2024-04-12T20:40:02.668 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hostname
2024-04-12T20:40:02.738 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067
2024-04-12T20:40:02.808 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release
2024-04-12T20:40:02.863 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream"
2024-04-12T20:40:02.863 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9"
2024-04-12T20:40:02.863 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos"
2024-04-12T20:40:02.863 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora"
2024-04-12T20:40:02.863 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9"
2024-04-12T20:40:02.863 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9"
2024-04-12T20:40:02.863 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-12T20:40:02.863 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31"
2024-04-12T20:40:02.863 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon"
2024-04-12T20:40:02.863 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-12T20:40:02.863 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/"
2024-04-12T20:40:02.863 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T20:40:02.863 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-12T20:40:02.864 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-12T20:40:02.864 INFO:teuthology.provision.fog.smithi067:Deploy complete!
2024-04-12T20:40:02.864 DEBUG:teuthology.parallel:result is None
2024-04-12T20:40:08.762 WARNING:teuthology.provision.fog.smithi103:timed out
2024-04-12T20:40:14.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:40:15.010 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-12T20:40:15.011 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-12T20:40:15.347 INFO:teuthology.provision.fog.smithi103:Node is ready
2024-04-12T20:40:15.348 DEBUG:teuthology.orchestra.run.smithi103:> hostname
2024-04-12T20:40:15.364 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com
2024-04-12T20:40:15.364 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi103.front.sepia.ceph.com /etc/hosts
2024-04-12T20:40:15.421 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103
2024-04-12T20:40:15.421 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103
2024-04-12T20:40:15.537 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hosts
2024-04-12T20:40:15.567 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.103/172.21.15.103/g' /etc/hosts
2024-04-12T20:40:15.637 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hostname
2024-04-12T20:40:15.708 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103
2024-04-12T20:40:15.776 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release
2024-04-12T20:40:15.833 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream"
2024-04-12T20:40:15.833 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9"
2024-04-12T20:40:15.833 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos"
2024-04-12T20:40:15.833 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora"
2024-04-12T20:40:15.833 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9"
2024-04-12T20:40:15.833 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9"
2024-04-12T20:40:15.833 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-12T20:40:15.833 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31"
2024-04-12T20:40:15.833 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon"
2024-04-12T20:40:15.833 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-12T20:40:15.834 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/"
2024-04-12T20:40:15.834 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T20:40:15.834 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-12T20:40:15.834 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-12T20:40:15.834 INFO:teuthology.provision.fog.smithi103:Deploy complete!
2024-04-12T20:40:15.835 DEBUG:teuthology.parallel:result is None
2024-04-12T20:40:16.063 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com
2024-04-12T20:40:16.064 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-12T20:40:16.087 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com
2024-04-12T20:40:16.087 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-12T20:40:16.112 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com
2024-04-12T20:40:16.112 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-12T20:40:16.129 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server
2024-04-12T20:40:16.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com'
2024-04-12T20:40:16.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:40:16.240 DEBUG:teuthology.orchestra.run.smithi067:> true
2024-04-12T20:40:16.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com'
2024-04-12T20:40:16.421 DEBUG:teuthology.orchestra.run.smithi067:> uname -m
2024-04-12T20:40:16.476 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64
2024-04-12T20:40:16.476 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release
2024-04-12T20:40:16.530 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream"
2024-04-12T20:40:16.531 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9"
2024-04-12T20:40:16.531 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos"
2024-04-12T20:40:16.531 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora"
2024-04-12T20:40:16.531 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9"
2024-04-12T20:40:16.531 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9"
2024-04-12T20:40:16.531 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-12T20:40:16.531 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31"
2024-04-12T20:40:16.531 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon"
2024-04-12T20:40:16.531 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-12T20:40:16.531 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/"
2024-04-12T20:40:16.531 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T20:40:16.531 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-12T20:40:16.531 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-12T20:40:16.532 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server
2024-04-12T20:40:16.554 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server
2024-04-12T20:40:16.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com'
2024-04-12T20:40:16.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:40:16.642 DEBUG:teuthology.orchestra.run.smithi103:> true
2024-04-12T20:40:16.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com'
2024-04-12T20:40:16.714 DEBUG:teuthology.orchestra.run.smithi103:> uname -m
2024-04-12T20:40:16.770 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64
2024-04-12T20:40:16.770 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release
2024-04-12T20:40:16.825 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream"
2024-04-12T20:40:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9"
2024-04-12T20:40:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos"
2024-04-12T20:40:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora"
2024-04-12T20:40:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9"
2024-04-12T20:40:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9"
2024-04-12T20:40:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-12T20:40:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31"
2024-04-12T20:40:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon"
2024-04-12T20:40:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-12T20:40:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/"
2024-04-12T20:40:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T20:40:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-12T20:40:16.827 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-12T20:40:16.827 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server
2024-04-12T20:40:16.845 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server
2024-04-12T20:40:16.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com'
2024-04-12T20:40:16.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T20:40:16.935 DEBUG:teuthology.orchestra.run.smithi146:> true
2024-04-12T20:40:17.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com'
2024-04-12T20:40:17.105 DEBUG:teuthology.orchestra.run.smithi146:> uname -m
2024-04-12T20:40:17.159 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64
2024-04-12T20:40:17.160 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release
2024-04-12T20:40:17.214 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream"
2024-04-12T20:40:17.214 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9"
2024-04-12T20:40:17.214 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos"
2024-04-12T20:40:17.214 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora"
2024-04-12T20:40:17.214 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9"
2024-04-12T20:40:17.214 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9"
2024-04-12T20:40:17.214 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-12T20:40:17.215 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31"
2024-04-12T20:40:17.215 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon"
2024-04-12T20:40:17.215 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-12T20:40:17.215 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/"
2024-04-12T20:40:17.215 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T20:40:17.215 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-12T20:40:17.215 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-12T20:40:17.215 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server
2024-04-12T20:40:17.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:40:17.349 INFO:teuthology.dispatcher.supervisor:Running job 7653588
2024-04-12T20:40:17.349 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653588 --name vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653588/orig.config.yaml
2024-04-12T20:40:17.352 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653588
2024-04-12T20:40:17.352 INFO:teuthology.dispatcher.supervisor:Job PID: 419838
2024-04-12T20:40:17.352 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-12T20:42:17.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:44:17.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:46:17.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:48:17.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:50:18.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:52:18.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:54:18.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:56:18.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:58:18.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:00:18.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:02:19.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:04:19.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:06:19.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:08:19.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:10:19.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:12:19.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:14:20.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:16:20.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:18:20.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:20:20.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:22:20.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:24:21.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:26:21.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:28:21.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:30:21.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:32:21.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:34:21.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:36:22.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:38:22.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:40:22.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:42:22.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:44:22.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:46:22.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:48:23.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:50:23.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:52:23.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:54:23.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:56:23.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T21:58:23.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:00:24.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:02:24.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:04:24.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:06:24.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:08:24.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:10:24.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:12:25.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:14:25.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:16:25.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:18:25.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:20:25.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:22:25.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:24:26.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:26:26.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:28:26.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:30:26.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:32:26.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:34:26.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:36:27.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:38:27.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:40:27.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:42:27.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:44:27.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:46:28.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:48:28.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:50:28.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:52:28.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:54:28.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:56:28.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T22:58:29.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:00:29.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:02:29.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:04:29.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:06:29.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:08:29.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:10:29.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:12:30.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:14:30.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:16:30.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:18:30.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:20:30.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:22:30.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:24:31.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:26:31.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:28:31.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:30:31.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:32:31.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:34:31.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:36:32.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:38:32.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:40:32.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:42:32.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:44:32.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:46:32.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:48:33.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:50:33.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:52:33.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:54:33.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:56:33.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T23:58:33.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:00:34.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:02:34.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:04:34.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:06:34.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:08:34.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:10:35.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:12:35.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:14:35.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:16:35.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:18:35.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:20:35.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:22:36.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:24:36.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:26:36.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:28:36.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:30:36.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:32:36.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:34:37.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:36:37.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:38:37.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:40:37.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:42:37.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:44:37.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:46:38.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:48:38.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:50:38.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:52:38.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:54:38.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:56:38.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T00:58:39.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:00:39.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:02:39.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:04:39.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:06:39.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:08:39.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:10:40.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:12:40.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:14:40.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:16:40.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:18:40.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:20:40.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:22:41.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:24:41.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:26:41.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:28:41.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:30:41.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:32:41.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:34:42.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:36:42.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:38:42.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:40:42.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:42:42.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:44:42.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:46:43.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:48:43.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:50:43.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:52:43.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:54:43.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:56:43.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T01:58:44.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:00:44.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:02:44.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:04:44.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:06:44.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:08:45.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:10:45.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:12:45.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:14:45.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:16:45.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:18:45.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:20:46.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:22:46.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:24:46.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:26:46.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:28:46.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:30:46.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:32:47.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:34:47.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:36:47.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:38:47.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:40:47.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:42:47.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:44:48.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:46:48.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:48:48.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:50:48.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:52:48.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:54:48.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:56:49.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T02:58:49.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:00:49.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:02:49.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:04:49.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:06:49.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:08:50.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:10:50.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:12:50.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:14:50.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:16:50.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:18:50.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:20:51.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:22:51.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:24:51.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:26:51.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:28:51.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:30:51.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:32:52.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:34:52.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:36:52.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:38:52.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:40:52.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:42:52.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:44:53.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:46:53.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:48:53.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:50:53.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:52:53.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:54:53.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:56:54.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T03:58:54.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:00:54.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:02:54.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:04:54.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:06:55.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:08:55.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:10:55.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:12:55.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:14:55.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:16:55.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:18:55.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:20:56.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:22:56.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:24:56.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:26:56.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:28:56.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:30:56.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:32:57.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:34:57.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:36:57.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:38:57.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:40:57.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:42:58.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:44:58.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:46:58.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:48:58.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:50:58.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:52:58.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:54:59.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:56:59.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T04:58:59.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:00:59.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:02:59.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:04:59.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:07:00.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:09:00.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:11:00.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:13:00.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:15:00.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:17:00.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:19:01.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:21:01.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:23:01.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:25:01.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:27:01.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:29:01.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:31:02.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:33:02.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:35:02.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:37:02.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:39:02.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:41:02.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:43:03.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:45:03.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:47:03.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:49:03.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:51:03.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:53:04.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:55:04.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:57:04.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T05:59:04.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:01:04.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:03:05.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:05:05.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:07:05.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:09:05.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:11:05.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:13:06.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:15:06.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:17:06.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:19:06.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:21:06.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:23:06.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:25:07.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:27:07.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:29:07.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:31:07.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:33:07.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:35:08.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:37:08.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:39:08.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:41:08.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:43:08.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:45:09.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:47:09.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:49:09.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:51:09.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:53:09.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:55:09.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:57:10.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T06:59:10.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:01:10.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:03:10.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:05:10.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:07:11.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:09:11.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:11:11.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:13:11.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:15:11.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:17:12.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:19:12.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:21:12.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:23:12.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:25:12.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:27:12.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:29:13.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:31:13.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:33:13.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:35:13.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:37:13.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:39:13.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:41:14.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:43:14.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:45:14.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:47:14.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:49:14.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:51:15.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:53:15.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:55:15.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:57:15.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T07:59:15.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:01:15.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:03:16.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:05:16.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:07:16.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:09:16.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:11:16.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:13:16.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:15:17.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:17:17.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:19:17.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:21:17.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:23:17.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:25:18.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:27:18.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:29:18.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:31:18.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:33:18.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:35:18.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:37:19.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:39:19.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:41:19.485 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2024-04-13T08:41:19.708 INFO:teuthology.kill:Killing Pids: {419838}
2024-04-13T08:41:20.917 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0']
2024-04-13T08:41:20.917 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10']
2024-04-13T08:41:20.917 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11']
2024-04-13T08:41:20.917 INFO:teuthology.misc:Compressing logs...
2024-04-13T08:41:20.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com'
2024-04-13T08:41:20.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T08:41:21.144 DEBUG:teuthology.orchestra.run.smithi067:> true
2024-04-13T08:41:21.368 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com'
2024-04-13T08:41:21.368 DEBUG:teuthology.orchestra.run.smithi067:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2024-04-13T08:41:21.373 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com'
2024-04-13T08:41:21.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T08:41:21.512 DEBUG:teuthology.orchestra.run.smithi103:> true
2024-04-13T08:41:21.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com'
2024-04-13T08:41:21.668 DEBUG:teuthology.orchestra.run.smithi103:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2024-04-13T08:41:21.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com'
2024-04-13T08:41:21.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T08:41:22.191 DEBUG:teuthology.orchestra.run.smithi146:> true
2024-04-13T08:41:22.384 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com'
2024-04-13T08:41:22.384 DEBUG:teuthology.orchestra.run.smithi146:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2024-04-13T08:41:22.533 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653588/remote/smithi067/crash
2024-04-13T08:41:22.534 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/lib/ceph/crash -- .
2024-04-13T08:41:22.627 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653588/remote/smithi103/crash
2024-04-13T08:41:22.628 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/crash -- .
2024-04-13T08:41:22.721 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653588/remote/smithi146/crash
2024-04-13T08:41:22.722 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/crash -- .
2024-04-13T08:41:22.835 INFO:teuthology.misc:Compressing logs...
2024-04-13T08:41:22.836 DEBUG:teuthology.orchestra.run.smithi067:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2024-04-13T08:41:22.843 DEBUG:teuthology.orchestra.run.smithi103:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2024-04-13T08:41:22.850 DEBUG:teuthology.orchestra.run.smithi146:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2024-04-13T08:41:22.924 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2024-04-13T08:41:22.924 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2024-04-13T08:41:22.925 INFO:teuthology.orchestra.run.smithi067.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2024-04-13T08:41:22.926 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2024-04-13T08:41:22.927 INFO:teuthology.orchestra.run.smithi067.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2024-04-13T08:41:22.927 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2024-04-13T08:41:22.927 INFO:teuthology.orchestra.run.smithi103.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2024-04-13T08:41:22.928 INFO:teuthology.orchestra.run.smithi103.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2024-04-13T08:41:22.943 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2024-04-13T08:41:22.944 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2024-04-13T08:41:22.945 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2024-04-13T08:41:22.946 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	  0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2024-04-13T08:41:22.951 DEBUG:teuthology.misc:Transferring archived files from smithi067:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653588/remote/smithi067/
2024-04-13T08:41:22.951 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- .
2024-04-13T08:41:23.048 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653588/remote/smithi103/
2024-04-13T08:41:23.048 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- .
2024-04-13T08:41:23.135 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653588/remote/smithi146/
2024-04-13T08:41:23.135 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- .
2024-04-13T08:41:23.231 INFO:teuthology.misc:Compressing logs...
2024-04-13T08:41:23.231 DEBUG:teuthology.orchestra.run.smithi067:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2024-04-13T08:41:23.239 DEBUG:teuthology.orchestra.run.smithi103:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2024-04-13T08:41:23.246 DEBUG:teuthology.orchestra.run.smithi146:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose --
2024-04-13T08:41:23.327 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log
2024-04-13T08:41:23.328 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log
2024-04-13T08:41:23.328 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log
2024-04-13T08:41:23.328 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.10.log
2024-04-13T08:41:23.329 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/cephadm.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.audit.log
2024-04-13T08:41:23.330 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/cephadm.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log
2024-04-13T08:41:23.331 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.10.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.b.log
2024-04-13T08:41:23.332 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.6.log
2024-04-13T08:41:23.332 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mon.a.log
2024-04-13T08:41:23.332 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.audit.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.4.log
2024-04-13T08:41:23.334 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.b.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.1.log
2024-04-13T08:41:23.334 INFO:teuthology.orchestra.run.smithi103.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz
2024-04-13T08:41:23.334 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.6.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.audit.log
2024-04-13T08:41:23.334 INFO:teuthology.orchestra.run.smithi067.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.log.gz
2024-04-13T08:41:23.336 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.4.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.k.log
2024-04-13T08:41:23.336 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mon.a.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.g.log
2024-04-13T08:41:23.337 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.audit.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.j.log
2024-04-13T08:41:23.337 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.g.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.3.log
2024-04-13T08:41:23.337 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.1.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.h.log
2024-04-13T08:41:23.338 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.j.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mgr.x.log
2024-04-13T08:41:23.338 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log
2024-04-13T08:41:23.339 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.3.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.0.log
2024-04-13T08:41:23.339 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mgr.x.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.cephadm.log
2024-04-13T08:41:23.340 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.l.log
2024-04-13T08:41:23.340 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/cephadm.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.audit.log
2024-04-13T08:41:23.340 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.k.log:	/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.h.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.7.log
2024-04-13T08:41:23.341 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.0.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.log
2024-04-13T08:41:23.341 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.cephadm.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-volume.log
2024-04-13T08:41:23.341 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.l.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.i.log
2024-04-13T08:41:23.342 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.9.log
2024-04-13T08:41:23.345 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.e.log
2024-04-13T08:41:23.345 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.7.log:	 92.2% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.audit.log.gz
2024-04-13T08:41:23.345 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.audit.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.11.log
2024-04-13T08:41:23.345 INFO:teuthology.orchestra.run.smithi146.stderr: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz
2024-04-13T08:41:23.345 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.i.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mgr.z.log
2024-04-13T08:41:23.346 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.11.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.8.log
2024-04-13T08:41:23.346 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mgr.z.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.5.log
2024-04-13T08:41:23.347 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-volume.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.d.log
2024-04-13T08:41:23.347 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.a.log
2024-04-13T08:41:23.347 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.8.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.f.log
2024-04-13T08:41:23.347 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.5.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.cephadm.log
2024-04-13T08:41:23.349 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.f.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.log
2024-04-13T08:41:23.349 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.cephadm.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.2.log
2024-04-13T08:41:23.349 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mgr.y.log
2024-04-13T08:41:23.349 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.c.log
2024-04-13T08:41:23.350 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.2.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-volume.log
2024-04-13T08:41:23.351 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.c.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mon.c.log
2024-04-13T08:41:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.e.log:	/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mgr.y.log:	gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.cephadm.log
2024-04-13T08:41:23.356 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.log
2024-04-13T08:41:23.362 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.cephadm.log:	/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.log:	 90.5% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.cephadm.log.gz
2024-04-13T08:41:23.362 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-volume.log
2024-04-13T08:41:23.366 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mon.b.log
2024-04-13T08:41:23.464 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-volume.log:	/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mon.b.log:	 91.1% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-volume.log.gz
2024-04-13T08:41:23.497 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.9.log:	/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.d.log:	/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.a.log:	 90.0% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.cephadm.log.gz
2024-04-13T08:41:23.522 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.log: file size changed while zipping
2024-04-13T08:41:23.522 INFO:teuthology.orchestra.run.smithi103.stderr: 90.5% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.log.gz
2024-04-13T08:41:23.606 INFO:teuthology.orchestra.run.smithi067.stderr: 92.8% -- replaced with /var/log/ceph/cephadm.log.gz
2024-04-13T08:41:23.643 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-volume.log:	/var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mon.c.log:	 94.6% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mgr.z.log.gz
2024-04-13T08:41:23.652 INFO:teuthology.orchestra.run.smithi146.stderr: 90.4% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.cephadm.log.gz
2024-04-13T08:41:23.697 INFO:teuthology.orchestra.run.smithi103.stderr: 94.6% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mgr.y.log.gz
2024-04-13T08:41:23.773 INFO:teuthology.orchestra.run.smithi067.stderr: 92.1% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.audit.log.gz
2024-04-13T08:41:24.048 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.log: file size changed while zipping
2024-04-13T08:41:24.048 INFO:teuthology.orchestra.run.smithi067.stderr: 90.5% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.log.gz
2024-04-13T08:41:24.302 INFO:teuthology.orchestra.run.smithi146.stderr: 92.2% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.audit.log.gz
2024-04-13T08:41:24.352 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.log: file size changed while zipping
2024-04-13T08:41:24.352 INFO:teuthology.orchestra.run.smithi146.stderr: 90.5% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph.log.gz
2024-04-13T08:41:25.544 INFO:teuthology.orchestra.run.smithi067.stderr: 91.1% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-volume.log.gz
2024-04-13T08:41:27.133 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-volume.log.gz
2024-04-13T08:41:27.259 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.b.log: file size changed while zipping
2024-04-13T08:41:27.263 INFO:teuthology.orchestra.run.smithi103.stderr: 94.7% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.b.log.gz
2024-04-13T08:41:27.825 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.k.log: file size changed while zipping
2024-04-13T08:41:27.825 INFO:teuthology.orchestra.run.smithi103.stderr: 95.2% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.k.log.gz
2024-04-13T08:41:35.023 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.a.log: file size changed while zipping
2024-04-13T08:41:35.024 INFO:teuthology.orchestra.run.smithi067.stderr: 94.8% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.a.log.gz
2024-04-13T08:41:38.635 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.g.log: file size changed while zipping
2024-04-13T08:41:38.636 INFO:teuthology.orchestra.run.smithi067.stderr: 94.8% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.g.log.gz
2024-04-13T08:41:39.470 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mon.b.log: file size changed while zipping
2024-04-13T08:41:39.471 INFO:teuthology.orchestra.run.smithi103.stderr: 92.0% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mon.b.log.gz
2024-04-13T08:41:41.356 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.e.log: file size changed while zipping
2024-04-13T08:41:41.357 INFO:teuthology.orchestra.run.smithi103.stderr: 90.3% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.e.log.gz
2024-04-13T08:41:45.605 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.h.log: file size changed while zipping
2024-04-13T08:41:45.605 INFO:teuthology.orchestra.run.smithi103.stderr: 91.4% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.h.log.gz
2024-04-13T08:41:49.064 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mgr.x.log: file size changed while zipping
2024-04-13T08:41:49.064 INFO:teuthology.orchestra.run.smithi067.stderr: 91.3% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mgr.x.log.gz
2024-04-13T08:41:56.240 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.f.log: file size changed while zipping
2024-04-13T08:41:56.240 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.f.log.gz
2024-04-13T08:42:04.082 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.1.log: file size changed while zipping
2024-04-13T08:42:04.082 INFO:teuthology.orchestra.run.smithi103.stderr: 92.4% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.1.log.gz
2024-04-13T08:42:05.922 INFO:teuthology.orchestra.run.smithi067.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz
2024-04-13T08:42:08.380 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.4.log: file size changed while zipping
2024-04-13T08:42:08.380 INFO:teuthology.orchestra.run.smithi103.stderr: 92.2% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.4.log.gz
2024-04-13T08:42:10.678 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.10.log: file size changed while zipping
2024-04-13T08:42:10.678 INFO:teuthology.orchestra.run.smithi103.stderr: 92.2% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.10.log.gz
2024-04-13T08:42:10.903 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.c.log: file size changed while zipping
2024-04-13T08:42:10.904 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.c.log.gz
2024-04-13T08:42:16.036 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.7.log: file size changed while zipping
2024-04-13T08:42:16.036 INFO:teuthology.orchestra.run.smithi103.stderr: 92.2% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.7.log.gz
2024-04-13T08:42:36.572 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mon.c.log: file size changed while zipping
2024-04-13T08:42:36.572 INFO:teuthology.orchestra.run.smithi146.stderr: 92.0% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mon.c.log.gz
2024-04-13T08:43:25.755 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.6.log: file size changed while zipping
2024-04-13T08:43:25.755 INFO:teuthology.orchestra.run.smithi067.stderr: 92.3% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.6.log.gz
2024-04-13T08:43:26.100 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.3.log: file size changed while zipping
2024-04-13T08:43:26.100 INFO:teuthology.orchestra.run.smithi067.stderr: 92.5% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.3.log.gz
2024-04-13T08:43:26.545 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.0.log: file size changed while zipping
2024-04-13T08:43:26.545 INFO:teuthology.orchestra.run.smithi067.stderr: 92.5% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.0.log.gz
2024-04-13T08:43:30.223 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mon.a.log: file size changed while zipping
2024-04-13T08:43:30.223 INFO:teuthology.orchestra.run.smithi067.stderr: 89.8% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mon.a.log.gz
2024-04-13T08:43:58.265 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.9.log: file size changed while zipping
2024-04-13T08:43:58.265 INFO:teuthology.orchestra.run.smithi067.stderr: 91.8% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.9.log.gz
2024-04-13T08:44:04.298 INFO:teuthology.orchestra.run.smithi067.stderr: 95.1% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.j.log.gz
2024-04-13T08:44:10.284 INFO:teuthology.orchestra.run.smithi067.stderr: 95.1% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.d.log.gz
2024-04-13T08:44:30.555 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.11.log: file size changed while zipping
2024-04-13T08:44:30.555 INFO:teuthology.orchestra.run.smithi146.stderr: 92.6% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.11.log.gz
2024-04-13T08:45:03.961 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.8.log: file size changed while zipping
2024-04-13T08:45:03.961 INFO:teuthology.orchestra.run.smithi146.stderr: 92.0% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.8.log.gz
2024-04-13T08:45:39.478 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.2.log: file size changed while zipping
2024-04-13T08:45:39.478 INFO:teuthology.orchestra.run.smithi146.stderr: 92.1% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.2.log.gz
2024-04-13T08:45:59.856 INFO:teuthology.orchestra.run.smithi146.stderr: 95.1% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.l.log.gz
2024-04-13T08:46:27.665 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.5.log: file size changed while zipping
2024-04-13T08:46:27.665 INFO:teuthology.orchestra.run.smithi146.stderr: 92.1% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-osd.5.log.gz
2024-04-13T08:47:22.723 INFO:teuthology.orchestra.run.smithi146.stderr: 93.7% -- replaced with /var/log/ceph/d947ea38-f90e-11ee-bc8d-c7b262605968/ceph-mds.i.log.gz
2024-04-13T08:47:22.730 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653588/remote/smithi067/log
2024-04-13T08:47:22.731 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/log/ceph -- .
2024-04-13T08:48:04.978 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653588/remote/smithi103/log
2024-04-13T08:48:04.979 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- .
2024-04-13T08:48:34.623 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653588/remote/smithi146/log
2024-04-13T08:48:34.624 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- .
2024-04-13T08:49:19.811 INFO:teuthology.kill:No teuthology processes running
2024-04-13T08:49:21.483 INFO:teuthology.kill:Nuking machines: ['smithi067', 'smithi103', 'smithi146']
2024-04-13T08:49:22.371 INFO:teuthology.kill:2024-04-13 08:49:22,371.371 INFO:teuthology.nuke:targets:
2024-04-13T08:49:22.371 INFO:teuthology.kill:  smithi067.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMViNe0BptAwAUgMbjYVxzb2Tu0MRdaKqJ1/M0nOFPgmCk14Qm/1YU0yc/QNgKK63F79d8q24NLu6x4v1VdONKM=
2024-04-13T08:49:22.372 INFO:teuthology.kill:  smithi103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJn4RxOcYpVY4BRWuz0QPWg9bQygFqTW3gEr+V/Csny9EyaChTw4y3mAtw+ZvnHiyCC/0c+RBkk103bnXgI3XnE=
2024-04-13T08:49:22.372 INFO:teuthology.kill:  smithi146.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPVmRqcikWMztciCtXodcIcjl58EyNBDM2eJXRAWs7nQuyFjjsx+ehjbhFpy4/tpBcTUKcFmoHfASyT/UQje3TE=
2024-04-13T08:49:22.372 INFO:teuthology.kill:2024-04-13 08:49:22,371.371 INFO:teuthology.nuke:Checking targets against current locks
2024-04-13T08:49:22.419 INFO:teuthology.kill:2024-04-13 08:49:22,418.418 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-13T08:49:22.446 INFO:teuthology.kill:2024-04-13 08:49:22,446.446 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-13T08:49:22.468 INFO:teuthology.kill:2024-04-13 08:49:22,468.468 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-13T08:49:22.486 INFO:teuthology.kill:2024-04-13 08:49:22,486.486 INFO:teuthology.orchestra.console.smithi067:Power off
2024-04-13T08:49:22.528 INFO:teuthology.kill:2024-04-13 08:49:22,528.528 INFO:teuthology.orchestra.console.smithi103:Power off
2024-04-13T08:49:22.560 INFO:teuthology.kill:2024-04-13 08:49:22,560.560 INFO:teuthology.orchestra.console.smithi146:Power off
2024-04-13T08:49:30.887 INFO:teuthology.kill:2024-04-13 08:49:30,886.886 INFO:teuthology.orchestra.console.smithi103:Power off completed
2024-04-13T08:49:31.036 INFO:teuthology.kill:2024-04-13 08:49:31,036.036 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com
2024-04-13T08:49:34.976 INFO:teuthology.kill:2024-04-13 08:49:34,975.975 INFO:teuthology.orchestra.console.smithi067:Power off completed
2024-04-13T08:49:35.027 INFO:teuthology.kill:2024-04-13 08:49:35,027.027 INFO:teuthology.orchestra.console.smithi146:Power off completed
2024-04-13T08:49:35.131 INFO:teuthology.kill:2024-04-13 08:49:35,130.130 INFO:teuthology.lock.ops:unlocked: smithi067.front.sepia.ceph.com
2024-04-13T08:49:35.179 INFO:teuthology.kill:2024-04-13 08:49:35,179.179 INFO:teuthology.lock.ops:unlocked: smithi146.front.sepia.ceph.com
2024-04-13T08:49:35.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:51:35.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T08:51:35.524 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2024-04-13T08:51:35.678 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi067 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-04-08_22:08:01-orch-reef-distro-default-smithi/7646482
2024-04-13T08:51:35.678 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi103 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-04-08_22:08:01-orch-reef-distro-default-smithi/7646481
2024-04-13T08:51:35.678 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi146 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-04-08_22:08:01-orch-reef-distro-default-smithi/7646481