2022-04-07T22:05:56.612 INFO:root:teuthology version: 1.1.0-a347b2ac
2022-04-07T22:05:56.736 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi081.front.sepia.ceph.com' reimaging
2022-04-07T22:05:56.737 INFO:teuthology.lock.ops:Updating [ubuntu@smithi081.front.sepia.ceph.com]: reset os type and version on server
2022-04-07T22:05:56.738 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2022-04-07T22:05:56.757 INFO:teuthology.lock.ops:Node 'ubuntu@smithi081.front.sepia.ceph.com' reimaging is complete
2022-04-07T22:05:56.757 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging
2022-04-07T22:05:56.758 INFO:teuthology.lock.ops:Updating [ubuntu@smithi163.front.sepia.ceph.com]: reset os type and version on server
2022-04-07T22:05:56.758 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2022-04-07T22:05:56.779 INFO:teuthology.lock.ops:Node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging is complete
2022-04-07T22:05:56.964 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of centos 8.stream
2022-04-07T22:05:56.977 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 8.stream
2022-04-07T22:05:57.290 INFO:teuthology.orchestra.console:Power off smithi081
2022-04-07T22:05:57.338 INFO:teuthology.orchestra.console:Power off smithi163
2022-04-07T22:05:57.431 INFO:teuthology.orchestra.console:Power off for smithi081 completed
2022-04-07T22:05:57.479 INFO:teuthology.orchestra.console:Power off for smithi163 completed
2022-04-07T22:05:57.533 INFO:teuthology.orchestra.console:Power on smithi081
2022-04-07T22:05:57.580 INFO:teuthology.orchestra.console:Power on smithi163
2022-04-07T22:06:01.792 INFO:teuthology.orchestra.console:Power on for smithi081 completed
2022-04-07T22:06:01.893 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish
2022-04-07T22:06:05.939 INFO:teuthology.orchestra.console:Power on for smithi163 completed
2022-04-07T22:06:06.041 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish
2022-04-07T22:10:08.533 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-07T22:10:34.226 INFO:teuthology.provision.fog.smithi081:Node is ready
2022-04-07T22:10:34.246 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com
2022-04-07T22:10:34.302 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081
2022-04-07T22:10:34.724 INFO:teuthology.provision.fog.smithi081:Deploy complete!
2022-04-07T22:11:26.332 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-07T22:11:26.660 INFO:teuthology.provision.fog.smithi163:Node is ready
2022-04-07T22:11:26.679 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com
2022-04-07T22:11:26.738 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163
2022-04-07T22:11:27.104 INFO:teuthology.provision.fog.smithi163:Deploy complete!
2022-04-07T22:11:27.349 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com
2022-04-07T22:11:27.350 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-07T22:11:27.369 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com
2022-04-07T22:11:27.369 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-07T22:11:27.388 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server
2022-04-07T22:11:27.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com'
2022-04-07T22:11:27.640 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64
2022-04-07T22:11:27.698 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream"
2022-04-07T22:11:27.698 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8"
2022-04-07T22:11:27.698 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos"
2022-04-07T22:11:27.699 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora"
2022-04-07T22:11:27.699 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8"
2022-04-07T22:11:27.699 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2022-04-07T22:11:27.699 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 8"
2022-04-07T22:11:27.700 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2022-04-07T22:11:27.700 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-04-07T22:11:27.700 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/"
2022-04-07T22:11:27.700 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-07T22:11:27.701 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-07T22:11:27.701 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-04-07T22:11:27.702 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2022-04-07T22:11:27.721 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server
2022-04-07T22:11:27.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com'
2022-04-07T22:11:27.921 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64
2022-04-07T22:11:27.980 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream"
2022-04-07T22:11:27.980 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8"
2022-04-07T22:11:27.980 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos"
2022-04-07T22:11:27.980 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora"
2022-04-07T22:11:27.981 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8"
2022-04-07T22:11:27.981 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8"
2022-04-07T22:11:27.981 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 8"
2022-04-07T22:11:27.981 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31"
2022-04-07T22:11:27.982 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-04-07T22:11:27.982 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/"
2022-04-07T22:11:27.982 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-07T22:11:27.982 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-07T22:11:27.983 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-04-07T22:11:27.983 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2022-04-07T22:11:28.070 INFO:teuthology.dispatcher.supervisor:Running job 6781545
2022-04-07T22:11:28.071 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-04-07_20:11:42-orch-wip-yuri2-testing-2022-04-05-1453-pacific-distro-default-smithi/6781545 --name yuriw-2022-04-07_20:11:42-orch-wip-yuri2-testing-2022-04-05-1453-pacific-distro-default-smithi --description orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2022-04-07_20:11:42-orch-wip-yuri2-testing-2022-04-05-1453-pacific-distro-default-smithi/6781545/orig.config.yaml
2022-04-07T22:11:28.075 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-04-07_20:11:42-orch-wip-yuri2-testing-2022-04-05-1453-pacific-distro-default-smithi/6781545
2022-04-07T22:11:28.076 INFO:teuthology.dispatcher.supervisor:Job PID: 14338
2022-04-07T22:11:28.076 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-04-08T04:41:57.183 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-04-08T04:41:57.328 INFO:teuthology.kill:Killing Pids: {14338}
2022-04-08T04:41:58.503 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-04-08T04:41:58.504 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-04-08T04:41:58.504 INFO:teuthology.misc:Compressing logs...
2022-04-08T04:41:58.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com'
2022-04-08T04:41:58.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com'
2022-04-08T04:41:58.751 INFO:teuthology.orchestra.run.smithi081.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-04-08T04:41:58.945 INFO:teuthology.orchestra.run.smithi163.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-04-08T04:41:58.985 INFO:teuthology.orchestra.run.smithi081.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-04-08T04:41:58.985 INFO:teuthology.orchestra.run.smithi081.stderr:tar: Error is not recoverable: exiting now
2022-04-08T04:41:59.025 INFO:teuthology.orchestra.run.smithi163.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-04-08T04:41:59.025 INFO:teuthology.orchestra.run.smithi163.stderr:tar: Error is not recoverable: exiting now
2022-04-08T04:41:59.026 INFO:teuthology.misc:Compressing logs...
2022-04-08T04:41:59.206 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-04-08T04:41:59.331 INFO:teuthology.misc:Compressing logs...
2022-04-08T04:42:00.975 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/4b9834f0-b6c0-11ec-8c36-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-04-08T04:42:01.882 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/4b9834f0-b6c0-11ec-8c36-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-04-08T04:42:03.353 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/4b9834f0-b6c0-11ec-8c36-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-04-08T04:42:03.564 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/4b9834f0-b6c0-11ec-8c36-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-04-08T04:42:05.136 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/4b9834f0-b6c0-11ec-8c36-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-04-08T04:42:05.970 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/4b9834f0-b6c0-11ec-8c36-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-04-08T04:42:06.601 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/4b9834f0-b6c0-11ec-8c36-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-04-08T04:42:07.931 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/4b9834f0-b6c0-11ec-8c36-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-04-08T04:42:08.434 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/4b9834f0-b6c0-11ec-8c36-001a4aab830c/ceph-mgr.smithi081.tongvj.log: file size changed while zipping
2022-04-08T04:42:10.827 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/4b9834f0-b6c0-11ec-8c36-001a4aab830c/ceph-mon.smithi081.log: file size changed while zipping
2022-04-08T04:42:41.211 INFO:teuthology.kill:No teuthology processes running
2022-04-08T04:42:42.381 INFO:teuthology.kill:Nuking machines: ['smithi081', 'smithi163']
2022-04-08T04:42:43.355 INFO:teuthology.kill:2022-04-08 04:42:43,355.355 INFO:teuthology.nuke:targets:
2022-04-08T04:42:43.356 INFO:teuthology.kill:  smithi081.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVfm9M0vDt4LVQVSd4nkG/BU4XQ0DHtOOK56P8MeJ8sMiioEJgBEaUjgtm7xwR+1jJHdeuEIhJOSehuq0aUD+tUTIhe0i5cWA7JJu7B7eVm4fOG+pQAMq6as7vdxzFP4nOReOxpZN+Xq7pw/NzC/6RaQI4tRc2V/XdBEJsV9ry5TT6G/XHVU4j0l3tAdRAvrtzyhTepWnR5SRRuT7WEyq16JdmN0nm9iKorsbmNOdhFDX17VFkbwDi9m0Za1Go2OObvLofuPMt8bDGE5kIgOXfBYHjzAGJ+Q1ChvOSxDV8Ow9LJ12kdehyy8t2+5BgHtGfgbpeY6c6FX3GwWPZUa8OQRK2MCvQsvO0oNw/oKgoC9Dm+Xrdwi4cgcKGskY/yVpUt90KcejZJlLKYYn6vnfcIUDWvbZAPonCqwVr2yREQ+uktwIPoR/T9jXk5Noc44khdFFYgTlbHqEFzE/52QHkrVzkBJVGS9UURx99og7PEfGs2wkSFD2by6CHKCdyZ/U=
2022-04-08T04:42:43.356 INFO:teuthology.kill:  smithi163.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9EmNRm0i4SaDHHkTnTRqGYqnMA08w1QajnbzJ8wY1TEW89QqNYUClAP2/JPO9ZMJBBBFWbQYPMR+G0MnfNvCxoUisQTqpT0e0gw3vcG28p2f/V7AjxZVpy87MDAxzKsBMEmk45OPhGI+AJs9fzJcecdfqnv48TItBrrNvKdggMzWw82fSitSyOQbYtMx+UTJ5/r1Qs0j6KQxB2isdz/KRH4GX/C0+ToV9KosgUf0hpTp1FD1dcRADWgTjKZoymsnpcAvIfNEBKlg5hioCtfNnJfmuKIn6zHOFJgs9J5kyyy+UPOqTn0EebdrVltt6d1zUiLyyxNfJXRM/K3jna6r9gTYaJTKm8gRpGlOx1EyuNbQrW0P0L5VxGKfSIC8LbjbGk/YQiVOndSK4FR8n3n98OmXF0/6Vy5CU7I326ssQbBAqK0gLef4yIcWXGZ8xpDyrO7IAbIJfQkxR/XxOFbpB9s8avebRGsXm0Y2QXu4CtenkP4EMYn5I7Tvidx0zOoM=
2022-04-08T04:42:43.384 INFO:teuthology.kill:2022-04-08 04:42:43,384.384 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-08T04:42:43.387 INFO:teuthology.kill:2022-04-08 04:42:43,387.387 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-08T04:42:43.475 INFO:teuthology.kill:2022-04-08 04:42:43,475.475 INFO:teuthology.orchestra.console:Power off smithi163
2022-04-08T04:42:43.491 INFO:teuthology.kill:2022-04-08 04:42:43,491.491 INFO:teuthology.orchestra.console:Power off smithi081
2022-04-08T04:42:51.855 INFO:teuthology.kill:2022-04-08 04:42:51,854.854 INFO:teuthology.orchestra.console:Power off for smithi081 completed
2022-04-08T04:42:52.001 INFO:teuthology.kill:2022-04-08 04:42:52,001.001 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com
2022-04-08T04:42:55.955 INFO:teuthology.kill:2022-04-08 04:42:55,955.955 INFO:teuthology.orchestra.console:Power off for smithi163 completed
2022-04-08T04:42:56.100 INFO:teuthology.kill:2022-04-08 04:42:56,100.100 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com
2022-04-08T04:44:56.448 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-04-08T04:44:56.555 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi081 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-04-07_17:56:57-fs-wip-vshankar-testing-55110-20220407-173953-testing-default-smithi/6781193
2022-04-08T04:44:56.555 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi163 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-04-07_17:56:57-fs-wip-vshankar-testing-55110-20220407-173953-testing-default-smithi/6781193