2022-03-25T18:41:41.872 INFO:root:teuthology version: 1.1.0-70390753
2022-03-25T18:41:41.999 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi131.front.sepia.ceph.com' reimaging
2022-03-25T18:41:42.000 INFO:teuthology.lock.ops:Updating [ubuntu@smithi131.front.sepia.ceph.com]: reset os type and version on server
2022-03-25T18:41:42.000 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2022-03-25T18:41:42.025 INFO:teuthology.lock.ops:Node 'ubuntu@smithi131.front.sepia.ceph.com' reimaging is complete
2022-03-25T18:41:42.025 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging
2022-03-25T18:41:42.026 INFO:teuthology.lock.ops:Updating [ubuntu@smithi163.front.sepia.ceph.com]: reset os type and version on server
2022-03-25T18:41:42.026 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2022-03-25T18:41:42.045 INFO:teuthology.lock.ops:Node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging is complete
2022-03-25T18:41:42.243 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of centos 8.stream
2022-03-25T18:41:42.252 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 8.stream
2022-03-25T18:41:42.541 INFO:teuthology.orchestra.console:Power off smithi163
2022-03-25T18:41:42.557 INFO:teuthology.orchestra.console:Power off smithi131
2022-03-25T18:41:55.028 INFO:teuthology.orchestra.console:Power off for smithi163 completed
2022-03-25T18:41:55.033 INFO:teuthology.orchestra.console:Power off for smithi131 completed
2022-03-25T18:41:55.129 INFO:teuthology.orchestra.console:Power on smithi163
2022-03-25T18:41:55.136 INFO:teuthology.orchestra.console:Power on smithi131
2022-03-25T18:41:59.385 INFO:teuthology.orchestra.console:Power on for smithi163 completed
2022-03-25T18:41:59.392 INFO:teuthology.orchestra.console:Power on for smithi131 completed
2022-03-25T18:41:59.486 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish
2022-03-25T18:41:59.493 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish
2022-03-25T18:46:37.582 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-25T18:46:37.848 INFO:teuthology.provision.fog.smithi131:Node is ready
2022-03-25T18:46:37.866 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com
2022-03-25T18:46:37.925 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131
2022-03-25T18:46:38.273 INFO:teuthology.provision.fog.smithi131:Deploy complete!
2022-03-25T18:47:25.584 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-25T18:47:25.859 INFO:teuthology.provision.fog.smithi163:Node is ready
2022-03-25T18:47:25.876 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com
2022-03-25T18:47:25.934 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163
2022-03-25T18:47:26.269 INFO:teuthology.provision.fog.smithi163:Deploy complete!
2022-03-25T18:47:26.433 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com
2022-03-25T18:47:26.434 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-25T18:47:26.455 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com
2022-03-25T18:47:26.455 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-25T18:47:26.477 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server
2022-03-25T18:47:26.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com'
2022-03-25T18:47:26.724 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64
2022-03-25T18:47:26.781 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream"
2022-03-25T18:47:26.781 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8"
2022-03-25T18:47:26.782 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos"
2022-03-25T18:47:26.782 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora"
2022-03-25T18:47:26.782 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8"
2022-03-25T18:47:26.782 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8"
2022-03-25T18:47:26.783 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-25T18:47:26.783 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31"
2022-03-25T18:47:26.783 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-25T18:47:26.783 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/"
2022-03-25T18:47:26.784 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-25T18:47:26.784 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-25T18:47:26.784 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-25T18:47:26.785 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2022-03-25T18:47:26.804 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server
2022-03-25T18:47:26.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com'
2022-03-25T18:47:26.998 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64
2022-03-25T18:47:27.055 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream"
2022-03-25T18:47:27.056 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8"
2022-03-25T18:47:27.056 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos"
2022-03-25T18:47:27.057 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora"
2022-03-25T18:47:27.058 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8"
2022-03-25T18:47:27.058 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8"
2022-03-25T18:47:27.058 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-25T18:47:27.058 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31"
2022-03-25T18:47:27.058 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-25T18:47:27.059 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/"
2022-03-25T18:47:27.059 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-25T18:47:27.059 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-25T18:47:27.059 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-25T18:47:27.060 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2022-03-25T18:47:27.174 INFO:teuthology.dispatcher.supervisor:Running job 6760302
2022-03-25T18:47:27.174 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-03-25_14:51:16-orch-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6760302 --name yuriw-2022-03-25_14:51:16-orch-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi --description orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2022-03-25_14:51:16-orch-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6760302/orig.config.yaml
2022-03-25T18:47:27.178 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-03-25_14:51:16-orch-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6760302
2022-03-25T18:47:27.179 INFO:teuthology.dispatcher.supervisor:Job PID: 26439
2022-03-25T18:47:27.180 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-26T01:17:56.419 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-26T01:17:56.591 INFO:teuthology.kill:Killing Pids: {26439}
2022-03-26T01:17:57.807 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-26T01:17:57.808 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-26T01:17:57.808 INFO:teuthology.misc:Compressing logs...
2022-03-26T01:17:57.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com'
2022-03-26T01:17:57.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com'
2022-03-26T01:17:58.033 INFO:teuthology.orchestra.run.smithi131.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-03-26T01:17:58.229 INFO:teuthology.orchestra.run.smithi163.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-03-26T01:17:58.269 INFO:teuthology.orchestra.run.smithi131.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-26T01:17:58.270 INFO:teuthology.orchestra.run.smithi131.stderr:tar: Error is not recoverable: exiting now
2022-03-26T01:17:58.307 INFO:teuthology.orchestra.run.smithi163.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-26T01:17:58.307 INFO:teuthology.orchestra.run.smithi163.stderr:tar: Error is not recoverable: exiting now
2022-03-26T01:17:58.308 INFO:teuthology.misc:Compressing logs...
2022-03-26T01:17:58.604 INFO:teuthology.misc:Compressing logs...
2022-03-26T01:18:11.598 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/47c29c7e-ac6d-11ec-8c35-001a4aab830c/ceph-mon.smithi131.log: file size changed while zipping
2022-03-26T01:18:18.282 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/47c29c7e-ac6d-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-03-26T01:18:30.074 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/47c29c7e-ac6d-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-03-26T01:18:41.530 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/47c29c7e-ac6d-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-03-26T01:18:42.507 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/47c29c7e-ac6d-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-03-26T01:18:57.653 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/47c29c7e-ac6d-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-03-26T01:19:01.824 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/47c29c7e-ac6d-11ec-8c35-001a4aab830c/ceph-mon.smithi163.log: file size changed while zipping
2022-03-26T01:19:02.950 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/47c29c7e-ac6d-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-03-26T01:19:04.768 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/47c29c7e-ac6d-11ec-8c35-001a4aab830c/ceph-mgr.smithi131.madrff.log: file size changed while zipping
2022-03-26T01:19:19.554 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/47c29c7e-ac6d-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-03-26T01:19:26.672 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/47c29c7e-ac6d-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-03-26T01:20:01.809 INFO:teuthology.kill:No teuthology processes running
2022-03-26T01:20:03.012 INFO:teuthology.kill:Nuking machines: ['smithi131', 'smithi163']
2022-03-26T01:20:04.002 INFO:teuthology.kill:2022-03-26 01:20:04,002.002 INFO:teuthology.nuke:targets:
2022-03-26T01:20:04.003 INFO:teuthology.kill:  smithi131.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmmOFW77a+bsAKzim0+8JnvxJRqq1IBiIuLA35S2HtGObShP/uUGmBJeoxQ2bXwz6yKwey/zmAFSWBmGBUI3Msy8rR9Q3ywrmN8V8EMNv+7mVFpWxIwe4/rmSPiA/GAVoNbexGJcecLh2ItIacXr4Rs0pHtzSjvKiJgRGO/WuH8o+uACO5VddIaNrE37Du4pf1Zi++AdJQdMsMIMzpX2KEyFpx3Ie6UAAe0LQt0WEQMhIPCN414U3P0hp9e34j0lxWA6Advl0Al2lVoZhV7y9UilHZRpgJSM35IvlsdYNOQjT+fWTZm4jhfFmuCOY2uUdC2K+0dG4A/+LTiLDsW2zJSzhDSIDOQOUF9laazrU+99aazWsnSdgJ9VEpPJ19wOJLnwJbh3A8afmYbUoLpx/pL5XiOw87dyWTbq6aulQk5i594V1FH7BNxTFShroanw1RafBE/cohibAgpsIhzVi0zYfVE6ConT/Vo5rqHlaXZRyS1Rx6hfQG833iSQyIvys=
2022-03-26T01:20:04.004 INFO:teuthology.kill:  smithi163.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDO0i77w+8p9TqJfzTNCFpPj7JDJJg+dp+n10ll2fmcNFmfuAhmfwUKCKJd+vXqdh/b60f7r2s24T74NUl2UpZR6yKMU2QRrv3+MkW1+1HNY74D5t0witZBjhlxOtc+5pnGHqCmrJISJuJOpT+grNqphiumQ3Rnfve0eCU6LF98VKJdcyWLHRAjvWfk/kUVfR2cbSRtHzbCNX4Twsjs4VwD22PqjXKKvG3rLV+qeJNGIgTEyTL+aEKZZSnZMGa9BK0LKljCA2A9JttSrdwlLF8V1wcQyTZd9inl4NYLUCvlQWBBgXFmmXzLjjW+1JiSU4BDxjODTao/iJ+BUnp7RQGbuenVdDdwNFSifNDq9QkF4g7nzZ+u5gQhWfFBwHaS/2lTLn9sUK6SyRg0KfG+my9w/J8IU8uiF3khT1OBmNtFIfzSIpHO4ZNeK7wsv+Ko8UApT3Ex4HAGeI1V94pWvxImMS7JYXUs0QPEMFGQKBlHaH/YY7m02zoHLtT8CRs8jps=
2022-03-26T01:20:04.036 INFO:teuthology.kill:2022-03-26 01:20:04,036.036 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-26T01:20:04.039 INFO:teuthology.kill:2022-03-26 01:20:04,039.039 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-26T01:20:04.117 INFO:teuthology.kill:2022-03-26 01:20:04,117.117 INFO:teuthology.orchestra.console:Power off smithi131
2022-03-26T01:20:04.137 INFO:teuthology.kill:2022-03-26 01:20:04,137.137 INFO:teuthology.orchestra.console:Power off smithi163
2022-03-26T01:20:12.498 INFO:teuthology.kill:2022-03-26 01:20:12,498.498 INFO:teuthology.orchestra.console:Power off for smithi131 completed
2022-03-26T01:20:12.644 INFO:teuthology.kill:2022-03-26 01:20:12,643.643 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com
2022-03-26T01:20:16.616 INFO:teuthology.kill:2022-03-26 01:20:16,615.615 INFO:teuthology.orchestra.console:Power off for smithi163 completed
2022-03-26T01:20:16.759 INFO:teuthology.kill:2022-03-26 01:20:16,759.759 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com
2022-03-26T01:22:17.067 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-26T01:22:17.173 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi131 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-25_18:41:47-rados-wip-yuri11-testing-2022-03-25-0930-quincy-distro-default-smithi/6760978
2022-03-26T01:22:17.173 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi163 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-25_18:41:47-rados-wip-yuri11-testing-2022-03-25-0930-quincy-distro-default-smithi/6760976