2022-01-14T05:51:08.308 INFO:root:teuthology version: 1.1.0-6fc20113
2022-01-14T05:51:08.429 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi008.front.sepia.ceph.com' reimaging
2022-01-14T05:51:08.430 INFO:teuthology.lock.ops:Updating [ubuntu@smithi008.front.sepia.ceph.com]: reset os type and version on server
2022-01-14T05:51:08.431 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server
2022-01-14T05:51:08.449 INFO:teuthology.lock.ops:Node 'ubuntu@smithi008.front.sepia.ceph.com' reimaging is complete
2022-01-14T05:51:08.449 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi027.front.sepia.ceph.com' reimaging
2022-01-14T05:51:08.450 INFO:teuthology.lock.ops:Updating [ubuntu@smithi027.front.sepia.ceph.com]: reset os type and version on server
2022-01-14T05:51:08.450 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2022-01-14T05:51:08.471 INFO:teuthology.lock.ops:Node 'ubuntu@smithi027.front.sepia.ceph.com' reimaging is complete
2022-01-14T05:51:08.672 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of centos 8.3
2022-01-14T05:51:08.682 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 8.3
2022-01-14T05:51:09.035 INFO:teuthology.orchestra.console:Power off smithi027
2022-01-14T05:51:09.049 INFO:teuthology.orchestra.console:Power off smithi008
2022-01-14T05:51:09.177 INFO:teuthology.orchestra.console:Power off for smithi027 completed
2022-01-14T05:51:09.186 INFO:teuthology.orchestra.console:Power off for smithi008 completed
2022-01-14T05:51:09.278 INFO:teuthology.orchestra.console:Power on smithi027
2022-01-14T05:51:09.287 INFO:teuthology.orchestra.console:Power on smithi008
2022-01-14T05:51:17.647 INFO:teuthology.orchestra.console:Power on for smithi027 completed
2022-01-14T05:51:17.652 INFO:teuthology.orchestra.console:Power on for smithi008 completed
2022-01-14T05:51:17.749 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish
2022-01-14T05:51:17.753 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish
2022-01-14T05:56:07.431 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-14T05:56:07.755 INFO:teuthology.provision.fog.smithi008:Node is ready
2022-01-14T05:56:07.771 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com
2022-01-14T05:56:07.828 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008
2022-01-14T05:56:08.158 INFO:teuthology.provision.fog.smithi008:Deploy complete!
2022-01-14T05:56:37.701 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-14T05:56:37.961 INFO:teuthology.provision.fog.smithi027:Node is ready
2022-01-14T05:56:38.016 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com
2022-01-14T05:56:38.073 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027
2022-01-14T05:56:38.417 INFO:teuthology.provision.fog.smithi027:Deploy complete!
2022-01-14T05:56:38.604 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com
2022-01-14T05:56:38.605 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-14T05:56:38.627 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com
2022-01-14T05:56:38.627 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-14T05:56:38.645 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server
2022-01-14T05:56:38.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com'
2022-01-14T05:56:38.922 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64
2022-01-14T05:56:38.978 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Linux"
2022-01-14T05:56:38.978 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8"
2022-01-14T05:56:38.978 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos"
2022-01-14T05:56:38.979 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora"
2022-01-14T05:56:38.979 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8"
2022-01-14T05:56:38.979 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8"
2022-01-14T05:56:38.979 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Linux 8"
2022-01-14T05:56:38.980 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31"
2022-01-14T05:56:38.980 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-14T05:56:38.980 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/"
2022-01-14T05:56:38.980 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2022-01-14T05:56:38.981 INFO:teuthology.orchestra.run.smithi008.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2022-01-14T05:56:38.981 INFO:teuthology.orchestra.run.smithi008.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2022-01-14T05:56:38.982 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server
2022-01-14T05:56:39.000 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server
2022-01-14T05:56:39.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2022-01-14T05:56:39.202 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64
2022-01-14T05:56:39.258 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Linux"
2022-01-14T05:56:39.258 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8"
2022-01-14T05:56:39.259 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos"
2022-01-14T05:56:39.259 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora"
2022-01-14T05:56:39.259 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8"
2022-01-14T05:56:39.259 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8"
2022-01-14T05:56:39.260 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Linux 8"
2022-01-14T05:56:39.260 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2022-01-14T05:56:39.260 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-14T05:56:39.260 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/"
2022-01-14T05:56:39.261 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2022-01-14T05:56:39.261 INFO:teuthology.orchestra.run.smithi027.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2022-01-14T05:56:39.261 INFO:teuthology.orchestra.run.smithi027.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2022-01-14T05:56:39.262 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2022-01-14T05:56:39.354 INFO:teuthology.dispatcher.supervisor:Running job 6615130
2022-01-14T05:56:39.355 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6fc2011361437a9dfe4e45b50de224392eed8abc/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2022-01-13_23:13:28-rados:cephadm-wip-guits-testing-2022-01-13-001-pacific-distro-default-smithi/6615130 --name gabrioux-2022-01-13_23:13:28-rados:cephadm-wip-guits-testing-2022-01-13-001-pacific-distro-default-smithi --description rados:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.3_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/gabrioux-2022-01-13_23:13:28-rados:cephadm-wip-guits-testing-2022-01-13-001-pacific-distro-default-smithi/6615130/orig.config.yaml
2022-01-14T05:56:39.358 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2022-01-13_23:13:28-rados:cephadm-wip-guits-testing-2022-01-13-001-pacific-distro-default-smithi/6615130
2022-01-14T05:56:39.360 INFO:teuthology.dispatcher.supervisor:Job PID: 10051
2022-01-14T05:56:39.360 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-14T12:27:08.791 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-14T12:27:08.992 INFO:teuthology.kill:Killing Pids: {10051}
2022-01-14T12:27:10.137 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-01-14T12:27:10.138 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-01-14T12:27:10.139 INFO:teuthology.misc:Compressing logs...
2022-01-14T12:27:10.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com'
2022-01-14T12:27:10.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2022-01-14T12:27:10.384 INFO:teuthology.orchestra.run.smithi008.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-14T12:27:10.610 INFO:teuthology.orchestra.run.smithi027.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-14T12:27:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-14T12:27:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:tar: Error is not recoverable: exiting now
2022-01-14T12:27:10.700 INFO:teuthology.orchestra.run.smithi027.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-14T12:27:10.700 INFO:teuthology.orchestra.run.smithi027.stderr:tar: Error is not recoverable: exiting now
2022-01-14T12:27:10.702 INFO:teuthology.misc:Compressing logs...
2022-01-14T12:27:10.962 INFO:teuthology.misc:Compressing logs...
2022-01-14T12:27:38.997 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/22f2b78e-7500-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-14T12:27:43.610 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/22f2b78e-7500-11ec-8c32-001a4aab830c/ceph-mgr.smithi008.pslipk.log: file size changed while zipping
2022-01-14T12:27:44.358 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/22f2b78e-7500-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-14T12:28:07.943 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/22f2b78e-7500-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-14T12:28:13.393 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/22f2b78e-7500-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-14T12:28:27.103 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/22f2b78e-7500-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-14T12:28:37.356 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/22f2b78e-7500-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-14T12:28:40.368 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/22f2b78e-7500-11ec-8c32-001a4aab830c/ceph-mon.smithi027.log: file size changed while zipping
2022-01-14T12:28:54.364 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/22f2b78e-7500-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-14T12:29:04.369 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/22f2b78e-7500-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-14T12:29:05.618 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/22f2b78e-7500-11ec-8c32-001a4aab830c/ceph-mon.smithi008.log: file size changed while zipping
2022-01-14T12:29:50.466 INFO:teuthology.kill:No teuthology processes running
2022-01-14T12:29:51.636 INFO:teuthology.kill:Nuking machines: ['smithi008', 'smithi027']
2022-01-14T12:29:52.624 INFO:teuthology.kill:2022-01-14 12:29:52,624.624 INFO:teuthology.nuke:targets:
2022-01-14T12:29:52.625 INFO:teuthology.kill:  smithi008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDP1HNcWnoTXAbsdzOfcqEQjYb3lVxcJNYk3TAKxfpgfXV2i52ePJBs9QE5eUMe12Jaq+Lghq/4Mrp+ub7z9udhlGJhGx+1/utLSqcGlc3lFnAmC1c+yO/fN0OLwbSxi6KZIKdFxghNe41zz+tUaXQWjQda3QOxek6/gjwu/IHAEXng/F19pOddxrDZEhZnvMQOdonB0eFuoAV1glorVfgppmmVILrMWsfriiG3dM8jAAfswL+AfiJpTxa3XnJzPglZfUo5A2LYtqWjgPSIZo1d3skvbPPHHiE7Dhy1ZrVq30m5vDtUq/P81/94PHQy5oGLHfM+VYiuj5lxEAFV5nqijy6WIDFFpcCKaPcBjTF8VWc/v9Z2lnmwu8fad076KqsFBAAcWisA3y0zms4KCzCWfvxr7o7f8aUYtStq6RL9KR5SUcBXuawcUvomLmAbCJC0oPdzHTsBFnVYGwi/tfX56/33m0Ougkg3avn+VSjOYhWmuD446cdjhogOfcG+f9U=
2022-01-14T12:29:52.626 INFO:teuthology.kill:  smithi027.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcwi/+v4wVBYMthxbCfDlnqTXxf8zLZt91VaLarOrz4bYpyBqEMNhn/Lj6bwWIN49Opx5df7LoFfVw3gnSfuNhV7jyzTOurnqQ+0i2ZnMmWERTd7UlYeZ4gs6HA1UZNKMXdoKPPmIK8q7oAY1Wc4D4cmJssCzHFBxTz0vIhg3YLOWv7m14ZHzUrzAyWg7gJiEUnT/Bb4g+zkh3Cxf/h2WldjQt9Ihh/dfDbhMIHzT6XX4k0f3k7EwHEaxHDJdd/Fwb47UlXzLJLmpPrNfYkt3DdXkC6PiW7dtH0sWu75B83A5WlgMfNM0HOSDwgrN1Wc2Nts71t3TOqHCsJRKcWJ7O42RhMnOYuwuVH/KZBwSVku13B0lVz5I1cOmvmheAXjYr7k1oAOoBAKUDNC0zjneGy/wA1YU8VXVlnh60AspDGHv/mfipH7LxfDw8LqA6dHfXAbY5kuM8H6SWvvHNzYknNkY+f8Y2fqLxIn2XnxEicKR2x5KNtoetBY04hs/yb1s=
2022-01-14T12:29:52.652 INFO:teuthology.kill:2022-01-14 12:29:52,652.652 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-14T12:29:52.656 INFO:teuthology.kill:2022-01-14 12:29:52,656.656 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-14T12:29:52.736 INFO:teuthology.kill:2022-01-14 12:29:52,736.736 INFO:teuthology.orchestra.console:Power off smithi008
2022-01-14T12:29:52.751 INFO:teuthology.kill:2022-01-14 12:29:52,750.750 INFO:teuthology.orchestra.console:Power off smithi027
2022-01-14T12:30:01.114 INFO:teuthology.kill:2022-01-14 12:30:01,114.114 INFO:teuthology.orchestra.console:Power off for smithi027 completed
2022-01-14T12:30:01.261 INFO:teuthology.kill:2022-01-14 12:30:01,260.260 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com
2022-01-14T12:30:05.220 INFO:teuthology.kill:2022-01-14 12:30:05,219.219 INFO:teuthology.orchestra.console:Power off for smithi008 completed
2022-01-14T12:30:05.364 INFO:teuthology.kill:2022-01-14 12:30:05,364.364 INFO:teuthology.lock.ops:unlocked: smithi008.front.sepia.ceph.com
2022-01-14T12:32:05.657 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-14T12:32:05.764 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi008 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-14_05:17:01-krbd-pacific-testing-default-smithi/6615624
2022-01-14T12:32:05.765 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi027 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-14_05:17:01-krbd-pacific-testing-default-smithi/6615623