2021-12-22T23:32:10.727 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-22T23:32:10.851 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi022.front.sepia.ceph.com' reimaging
2021-12-22T23:32:10.852 INFO:teuthology.lock.ops:Updating [ubuntu@smithi022.front.sepia.ceph.com]: reset os type and version on server
2021-12-22T23:32:10.853 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server
2021-12-22T23:32:10.871 INFO:teuthology.lock.ops:Node 'ubuntu@smithi022.front.sepia.ceph.com' reimaging is complete
2021-12-22T23:32:10.872 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi137.front.sepia.ceph.com' reimaging
2021-12-22T23:32:10.872 INFO:teuthology.lock.ops:Updating [ubuntu@smithi137.front.sepia.ceph.com]: reset os type and version on server
2021-12-22T23:32:10.872 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server
2021-12-22T23:32:10.892 INFO:teuthology.lock.ops:Node 'ubuntu@smithi137.front.sepia.ceph.com' reimaging is complete
2021-12-22T23:32:11.089 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of centos 8.stream
2021-12-22T23:32:11.102 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of centos 8.stream
2021-12-22T23:32:11.436 INFO:teuthology.orchestra.console:Power off smithi022
2021-12-22T23:32:11.450 INFO:teuthology.orchestra.console:Power off smithi137
2021-12-22T23:32:19.817 INFO:teuthology.orchestra.console:Power off for smithi022 completed
2021-12-22T23:32:19.822 INFO:teuthology.orchestra.console:Power off for smithi137 completed
2021-12-22T23:32:19.919 INFO:teuthology.orchestra.console:Power on smithi022
2021-12-22T23:32:19.927 INFO:teuthology.orchestra.console:Power on smithi137
2021-12-22T23:32:28.295 INFO:teuthology.orchestra.console:Power on for smithi137 completed
2021-12-22T23:32:28.390 INFO:teuthology.orchestra.console:Power on for smithi022 completed
2021-12-22T23:32:28.397 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish
2021-12-22T23:32:28.491 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish
2021-12-22T23:37:18.231 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-22T23:37:18.261 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-22T23:37:18.536 INFO:teuthology.provision.fog.smithi137:Node is ready
2021-12-22T23:37:18.551 INFO:teuthology.provision.fog.smithi022:Node is ready
2021-12-22T23:37:18.552 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137.front.sepia.ceph.com
2021-12-22T23:37:18.570 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com
2021-12-22T23:37:18.609 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137
2021-12-22T23:37:18.629 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2021-12-22T23:37:18.933 INFO:teuthology.provision.fog.smithi137:Deploy complete!
2021-12-22T23:37:18.992 INFO:teuthology.provision.fog.smithi022:Deploy complete!
2021-12-22T23:37:19.145 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com
2021-12-22T23:37:19.146 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-22T23:37:19.166 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com
2021-12-22T23:37:19.167 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-22T23:37:19.184 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server
2021-12-22T23:37:19.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com'
2021-12-22T23:37:19.373 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64
2021-12-22T23:37:19.431 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream"
2021-12-22T23:37:19.431 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8"
2021-12-22T23:37:19.432 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos"
2021-12-22T23:37:19.432 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora"
2021-12-22T23:37:19.432 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8"
2021-12-22T23:37:19.432 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8"
2021-12-22T23:37:19.433 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-22T23:37:19.433 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31"
2021-12-22T23:37:19.433 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-22T23:37:19.433 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/"
2021-12-22T23:37:19.434 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-22T23:37:19.434 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-22T23:37:19.434 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-22T23:37:19.435 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server
2021-12-22T23:37:19.458 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server
2021-12-22T23:37:19.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com'
2021-12-22T23:37:19.645 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64
2021-12-22T23:37:19.701 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream"
2021-12-22T23:37:19.701 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8"
2021-12-22T23:37:19.702 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos"
2021-12-22T23:37:19.702 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora"
2021-12-22T23:37:19.702 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8"
2021-12-22T23:37:19.702 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8"
2021-12-22T23:37:19.703 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-22T23:37:19.703 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31"
2021-12-22T23:37:19.703 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-22T23:37:19.703 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/"
2021-12-22T23:37:19.704 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-22T23:37:19.704 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-22T23:37:19.704 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-22T23:37:19.705 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server
2021-12-22T23:37:19.814 INFO:teuthology.dispatcher.supervisor:Running job 6580078
2021-12-22T23:37:19.815 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-12-22_22:11:35-rados-wip-yuri3-testing-2021-12-22-1047-distro-default-smithi/6580078 --name yuriw-2021-12-22_22:11:35-rados-wip-yuri3-testing-2021-12-22-1047-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2021-12-22_22:11:35-rados-wip-yuri3-testing-2021-12-22-1047-distro-default-smithi/6580078/orig.config.yaml
2021-12-22T23:37:19.818 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-12-22_22:11:35-rados-wip-yuri3-testing-2021-12-22-1047-distro-default-smithi/6580078
2021-12-22T23:37:19.819 INFO:teuthology.dispatcher.supervisor:Job PID: 19452
2021-12-22T23:37:19.820 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-23T11:38:14.244 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-23T11:38:14.548 INFO:teuthology.kill:Killing Pids: {19452}
2021-12-23T11:38:15.847 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-12-23T11:38:15.848 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-12-23T11:38:15.849 INFO:teuthology.misc:Compressing logs...
2021-12-23T11:38:15.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com'
2021-12-23T11:38:16.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com'
2021-12-23T11:38:16.170 INFO:teuthology.orchestra.run.smithi022.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-23T11:38:16.406 INFO:teuthology.orchestra.run.smithi137.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-23T11:38:16.447 INFO:teuthology.orchestra.run.smithi022.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-23T11:38:16.448 INFO:teuthology.orchestra.run.smithi022.stderr:tar: Error is not recoverable: exiting now
2021-12-23T11:38:16.484 INFO:teuthology.orchestra.run.smithi137.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-23T11:38:16.485 INFO:teuthology.orchestra.run.smithi137.stderr:tar: Error is not recoverable: exiting now
2021-12-23T11:38:16.486 INFO:teuthology.misc:Compressing logs...
2021-12-23T11:38:16.754 INFO:teuthology.orchestra.run.smithi137.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-23T11:38:16.870 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-23T11:38:17.070 INFO:teuthology.misc:Compressing logs...
2021-12-23T11:38:21.501 INFO:teuthology.orchestra.run.smithi137.stderr:gzip: /var/log/ceph/d642c4aa-6380-11ec-8c31-001a4aab830c/ceph-mgr.smithi137.bmbdzx.log: file size changed while zipping
2021-12-23T11:38:27.349 INFO:teuthology.orchestra.run.smithi137.stderr:gzip: /var/log/ceph/d642c4aa-6380-11ec-8c31-001a4aab830c/ceph-mon.smithi137.log: file size changed while zipping
2021-12-23T11:38:37.678 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/d642c4aa-6380-11ec-8c31-001a4aab830c/ceph-mon.smithi022.log: file size changed while zipping
2021-12-23T11:38:57.109 INFO:teuthology.orchestra.run.smithi137.stderr:gzip: /var/log/ceph/d642c4aa-6380-11ec-8c31-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-12-23T11:39:06.478 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/d642c4aa-6380-11ec-8c31-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-12-23T11:39:22.188 INFO:teuthology.orchestra.run.smithi137.stderr:gzip: /var/log/ceph/d642c4aa-6380-11ec-8c31-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-12-23T11:39:33.257 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/d642c4aa-6380-11ec-8c31-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-12-23T11:39:47.499 INFO:teuthology.orchestra.run.smithi137.stderr:gzip: /var/log/ceph/d642c4aa-6380-11ec-8c31-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-12-23T11:39:51.606 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/d642c4aa-6380-11ec-8c31-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-12-23T11:40:09.475 INFO:teuthology.orchestra.run.smithi137.stderr:gzip: /var/log/ceph/d642c4aa-6380-11ec-8c31-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-12-23T11:40:19.667 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/d642c4aa-6380-11ec-8c31-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-12-23T11:41:08.125 INFO:teuthology.kill:No teuthology processes running
2021-12-23T11:41:09.351 INFO:teuthology.kill:Nuking machines: ['smithi022', 'smithi137']
2021-12-23T11:41:10.389 INFO:teuthology.kill:2021-12-23 11:41:10,389.389 INFO:teuthology.nuke:targets:
2021-12-23T11:41:10.390 INFO:teuthology.kill:  smithi022.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCcPPT3Okd/6XE/mipWeWE1G0elF14vxKHnWMBqZRnIxUv2YcD19tNdCUpo+VkxfQsHA6yg/N4z+voY2vEC2h7U8ki0I8iCW5ArlDg/DjbWo1uS7hUIYbBbR2kWBZ+FmLd84s3138wZC5woNkTUOZ1EC0QyGXixPxiW+yS/j+EX3Jh7tPIiVM0OCj1MpxhIs1CX0nx9PjsH/c4D1PxqKAuuXpOxyKUwC2GcXJX+ap5qkkKJoamqiIA9dbOQnHaRYbF/RU2b0K03sV8cekuWoOXPL3T8ULXLF44oKTMUl/7A8deNrJM0iH8FHB/fIouxWL2N1UjwN9nYYLvX9d5EBym497Me+cQYLsV1drRqlySb2N5UGIfDK2u368S/S1qpSS/qb4/BkVZHly/HaFR/usP89bvDznyJwRfrFmABWISOI7E7wHeJKF7Sp/sSc6ORNpX6+GfGFBFLGnYlUKne2i9pph7SCJ5C0wRacWanjD1le6EboFHW1E4EMoywsPUaWGc=
2021-12-23T11:41:10.391 INFO:teuthology.kill:  smithi137.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCcaoqjRynSULBTNap31Jq0w1+JQAohgqw9EDt6ZM+fBc8Pz+/nM99eO1HGwi3khb0bxUrVW7kOd2imaPwFpNWcmzQ1qMaPGEPGbLkMpoiV315rmS9S0Yn9HEJ6B620lcndnYsd+egUiZRZEVShnzVVMRqi3hWzz4Y/wYsVRRbnculjbqU7lfDqJ+/BhZxlT7C/68+7MkQOM1AWuKz1ob24rx3w7QUp/FG58mGgkLQ+Eezu+jqDkykjBUpWfrcDAQkg+7R5oa9hrx/3EZJjO9Au16m5OYZe0eBYx8Zr2ifh9GbByfQA1F13dgDV9YOjQFS7rVPyji+E2o4xRGal+RhY6ARdxFmq5GJUGzMNW2EhrDNTKDmAzcqYUUmOIX7HeNodFAdp4X8l5XWGV1dU6goT5D+nVW69XleixeWFnfp4gMbX6lpg3hn76C2/D3ribQnJq0dW5/XbK3CJv/Gc22watjz5f8Tszxchmhr1GU76mY36SoEXe+gwKMBRkmgjEw0=
2021-12-23T11:41:10.420 INFO:teuthology.kill:2021-12-23 11:41:10,419.419 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-23T11:41:10.424 INFO:teuthology.kill:2021-12-23 11:41:10,424.424 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-23T11:41:10.512 INFO:teuthology.kill:2021-12-23 11:41:10,512.512 INFO:teuthology.orchestra.console:Power off smithi022
2021-12-23T11:41:10.532 INFO:teuthology.kill:2021-12-23 11:41:10,532.532 INFO:teuthology.orchestra.console:Power off smithi137
2021-12-23T11:41:18.921 INFO:teuthology.kill:2021-12-23 11:41:18,920.920 INFO:teuthology.orchestra.console:Power off for smithi022 completed
2021-12-23T11:41:18.932 INFO:teuthology.kill:2021-12-23 11:41:18,931.931 INFO:teuthology.orchestra.console:Power off for smithi137 completed
2021-12-23T11:41:19.084 INFO:teuthology.kill:2021-12-23 11:41:19,083.083 INFO:teuthology.lock.ops:unlocked: smithi137.front.sepia.ceph.com
2021-12-23T11:41:19.096 INFO:teuthology.kill:2021-12-23 11:41:19,095.095 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com
2021-12-23T11:43:19.554 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-23T11:43:19.653 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi022 but it was locked by another job: /home/teuthworker/archive/sage-2021-12-22_18:02:12-rados-wip-sage2-testing-2021-12-22-1100-distro-basic-smithi/6579569
2021-12-23T11:43:19.655 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi137 but it was locked by another job: /home/teuthworker/archive/sage-2021-12-22_18:02:12-rados-wip-sage2-testing-2021-12-22-1100-distro-basic-smithi/6579569