2022-02-18T20:35:12.469 INFO:root:teuthology version: 1.1.0-c6442aa9
2022-02-18T20:35:12.584 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi017.front.sepia.ceph.com' reimaging
2022-02-18T20:35:12.586 INFO:teuthology.lock.ops:Updating [ubuntu@smithi017.front.sepia.ceph.com]: reset os type and version on server
2022-02-18T20:35:12.586 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2022-02-18T20:35:12.604 INFO:teuthology.lock.ops:Node 'ubuntu@smithi017.front.sepia.ceph.com' reimaging is complete
2022-02-18T20:35:12.604 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi125.front.sepia.ceph.com' reimaging
2022-02-18T20:35:12.604 INFO:teuthology.lock.ops:Updating [ubuntu@smithi125.front.sepia.ceph.com]: reset os type and version on server
2022-02-18T20:35:12.605 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2022-02-18T20:35:12.624 INFO:teuthology.lock.ops:Node 'ubuntu@smithi125.front.sepia.ceph.com' reimaging is complete
2022-02-18T20:35:12.812 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 8.stream
2022-02-18T20:35:12.831 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of centos 8.stream
2022-02-18T20:35:13.150 INFO:teuthology.orchestra.console:Power off smithi125
2022-02-18T20:35:13.168 INFO:teuthology.orchestra.console:Power off smithi017
2022-02-18T20:35:21.532 INFO:teuthology.orchestra.console:Power off for smithi017 completed
2022-02-18T20:35:21.633 INFO:teuthology.orchestra.console:Power on smithi017
2022-02-18T20:35:25.636 INFO:teuthology.orchestra.console:Power off for smithi125 completed
2022-02-18T20:35:25.737 INFO:teuthology.orchestra.console:Power on smithi125
2022-02-18T20:35:29.987 INFO:teuthology.orchestra.console:Power on for smithi125 completed
2022-02-18T20:35:29.993 INFO:teuthology.orchestra.console:Power on for smithi017 completed
2022-02-18T20:35:30.089 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish
2022-02-18T20:35:30.094 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish
2022-02-18T20:39:44.018 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-18T20:39:44.255 INFO:teuthology.provision.fog.smithi017:Node is ready
2022-02-18T20:39:44.273 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com
2022-02-18T20:39:44.332 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017
2022-02-18T20:39:44.695 INFO:teuthology.provision.fog.smithi017:Deploy complete!
2022-02-18T20:40:08.186 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-18T20:40:08.416 INFO:teuthology.provision.fog.smithi125:Node is ready
2022-02-18T20:40:08.475 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com
2022-02-18T20:40:08.534 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125
2022-02-18T20:40:08.888 INFO:teuthology.provision.fog.smithi125:Deploy complete!
2022-02-18T20:40:09.035 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com
2022-02-18T20:40:09.036 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-18T20:40:09.055 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com
2022-02-18T20:40:09.055 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-18T20:40:09.073 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server
2022-02-18T20:40:09.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com'
2022-02-18T20:40:09.321 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64
2022-02-18T20:40:09.379 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream"
2022-02-18T20:40:09.380 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8"
2022-02-18T20:40:09.380 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos"
2022-02-18T20:40:09.380 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora"
2022-02-18T20:40:09.380 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8"
2022-02-18T20:40:09.381 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8"
2022-02-18T20:40:09.381 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 8"
2022-02-18T20:40:09.381 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31"
2022-02-18T20:40:09.381 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-02-18T20:40:09.382 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/"
2022-02-18T20:40:09.382 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-18T20:40:09.382 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-18T20:40:09.382 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-02-18T20:40:09.383 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2022-02-18T20:40:09.400 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server
2022-02-18T20:40:09.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com'
2022-02-18T20:40:09.590 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64
2022-02-18T20:40:09.647 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream"
2022-02-18T20:40:09.648 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8"
2022-02-18T20:40:09.648 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos"
2022-02-18T20:40:09.648 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora"
2022-02-18T20:40:09.648 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8"
2022-02-18T20:40:09.648 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8"
2022-02-18T20:40:09.649 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 8"
2022-02-18T20:40:09.649 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31"
2022-02-18T20:40:09.649 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-02-18T20:40:09.649 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/"
2022-02-18T20:40:09.649 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-18T20:40:09.650 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-18T20:40:09.650 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-02-18T20:40:09.650 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2022-02-18T20:40:09.737 INFO:teuthology.dispatcher.supervisor:Running job 6691015
2022-02-18T20:40:09.738 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c6442aa9e509aace1201390ea4c2d6a80e3d0800/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2022-02-17_13:32:19-orch:cephadm-wip-adk2-testing-2022-02-17-0044-pacific-distro-basic-smithi/6691015 --name adking-2022-02-17_13:32:19-orch:cephadm-wip-adk2-testing-2022-02-17-0044-pacific-distro-basic-smithi --description orch:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/adking-2022-02-17_13:32:19-orch:cephadm-wip-adk2-testing-2022-02-17-0044-pacific-distro-basic-smithi/6691015/orig.config.yaml
2022-02-18T20:40:09.741 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2022-02-17_13:32:19-orch:cephadm-wip-adk2-testing-2022-02-17-0044-pacific-distro-basic-smithi/6691015
2022-02-18T20:40:09.742 INFO:teuthology.dispatcher.supervisor:Job PID: 28023
2022-02-18T20:40:09.743 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-02-19T03:10:38.451 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-02-19T03:10:38.628 INFO:teuthology.kill:Killing Pids: {28023}
2022-02-19T03:10:40.537 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-02-19T03:10:40.539 INFO:teuthology.task.internal:roles: ubuntu@smithi125.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-02-19T03:10:40.540 INFO:teuthology.misc:Compressing logs...
2022-02-19T03:10:40.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com'
2022-02-19T03:10:40.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com'
2022-02-19T03:10:40.775 INFO:teuthology.orchestra.run.smithi017.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-02-19T03:10:40.949 INFO:teuthology.orchestra.run.smithi125.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-02-19T03:10:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-02-19T03:10:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:tar: Error is not recoverable: exiting now
2022-02-19T03:10:41.028 INFO:teuthology.orchestra.run.smithi125.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-02-19T03:10:41.029 INFO:teuthology.orchestra.run.smithi125.stderr:tar: Error is not recoverable: exiting now
2022-02-19T03:10:41.030 INFO:teuthology.misc:Compressing logs...
2022-02-19T03:10:41.353 INFO:teuthology.misc:Compressing logs...
2022-02-19T03:10:41.524 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/166a2764-90fc-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-02-19T03:11:37.632 INFO:teuthology.orchestra.run.smithi017.stderr:tar: ./166a2764-90fc-11ec-8c35-001a4aab830c/ceph-osd.1.log-20220219: file changed as we read it
2022-02-19T03:12:06.038 INFO:teuthology.orchestra.run.smithi017.stderr:tar: ./166a2764-90fc-11ec-8c35-001a4aab830c/ceph-osd.3.log-20220219: file changed as we read it
2022-02-19T03:12:06.390 INFO:teuthology.orchestra.run.smithi017.stderr:tar: ./166a2764-90fc-11ec-8c35-001a4aab830c/ceph-osd.0.log-20220219: File removed before we read it
2022-02-19T03:12:06.390 INFO:teuthology.orchestra.run.smithi017.stderr:tar: ./166a2764-90fc-11ec-8c35-001a4aab830c: file changed as we read it
2022-02-19T03:12:06.411 INFO:teuthology.orchestra.run.smithi017.stderr:tar: .: file changed as we read it
2022-02-19T03:12:26.802 INFO:teuthology.kill:No teuthology processes running
2022-02-19T03:12:27.977 INFO:teuthology.kill:Nuking machines: ['smithi017', 'smithi125']
2022-02-19T03:12:28.974 INFO:teuthology.kill:2022-02-19 03:12:28,973.973 INFO:teuthology.nuke:targets:
2022-02-19T03:12:28.975 INFO:teuthology.kill:  smithi017.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUv42Cku14iMqvSuemCMp5qq71CIYaHtZPNsUYxL/bjPkJW3XqV7pQy8IRk5hVyi/pNFdKL2BWSLJtZYvL5+nhtcNKu4JThzSPVGvOvDtgYME2tBx7n3rh664LT0p+9TQVWfVtz9lbum3a+vZA5zrzvd9h9OcDV4AR44e64kiQP24LihmaItaSF77HX9XYwCph9j+XjwnP0+zwRBtJ50HmCg4hvW8OBhXRRxAnYWOTdK92NRNDejL1wmj2VnKLhWJLjLhVzqT55rMNtgq7dT21LqZlEj+t5DqkSf8KVBcbtW565iu7zp36G/KtKnURziypRz8aI19XRHw3TG8opfRObw/mC+C7M6LfpnKTG93E5//r5SJvMMzCzrGAMQNVR7GmztjDYGK9dTCcp7O5YEuOBlU67pM2VycwfFep922VEoXDn0umgfqWbrr0JbEJ8iUAwfTzedbHeJ3r3Xl5VyPOTRoYgLY+xzWYEOd5Im1xcOt6Tc6WtMSmz5azt1FhTwM=
2022-02-19T03:12:28.976 INFO:teuthology.kill:  smithi125.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzQ4l0ez/R7DhEbYTSL+Ak6gah09QBe7I+2cvLPO+1axatbIfTAP4nkjpvXDZ7FXDxIjy86duB/mQqVbISziPYjzPIpmh9VjOyAEC78Vi7QQfl9ulMHfLi7ec0V4F9vn6pSB6fuKXXReU0dgt4y2SczFgmhE3NCPG395wHKB6AyzJ42BzkXxWSF2WLT+0FTqwxPDa5ysyYH8GoaI3KCitocmWHOohkTZwXEYac9b6S6gbhFTL9Fl8fpg/1SodF0GGo1p1OZ35OdtMczmVMbfJsHMeJBVoR5pVjf3JwGkaYhIjgQN8wS4DLrfey0BQS0eHNqKo6vP6DY6RsS4zFYM7SjafPqfBE7BxV0dNpZNhSpbQHf62jNyKsZ+qHYSfdfCQu4P/FO8tCmVSJ5AnrWZPP7fa06gT7sWApBNfF1c1KELQM6nhVlg5rR6WNOI2iqIIKjqIt0VN/1uedUQpPIWM30aDSmQCd1LsLwfZ5bH0tUFZC28QkTE0z68yKH4jSfi8=
2022-02-19T03:12:29.003 INFO:teuthology.kill:2022-02-19 03:12:29,002.002 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-19T03:12:29.006 INFO:teuthology.kill:2022-02-19 03:12:29,006.006 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-19T03:12:29.084 INFO:teuthology.kill:2022-02-19 03:12:29,084.084 INFO:teuthology.orchestra.console:Power off smithi017
2022-02-19T03:12:29.101 INFO:teuthology.kill:2022-02-19 03:12:29,100.100 INFO:teuthology.orchestra.console:Power off smithi125
2022-02-19T03:12:37.467 INFO:teuthology.kill:2022-02-19 03:12:37,466.466 INFO:teuthology.orchestra.console:Power off for smithi017 completed
2022-02-19T03:12:37.473 INFO:teuthology.kill:2022-02-19 03:12:37,473.473 INFO:teuthology.orchestra.console:Power off for smithi125 completed
2022-02-19T03:12:37.630 INFO:teuthology.kill:2022-02-19 03:12:37,629.629 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com
2022-02-19T03:12:37.634 INFO:teuthology.kill:2022-02-19 03:12:37,634.634 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com
2022-02-19T03:14:37.966 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-02-19T03:14:38.074 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi017 but it was locked by another job: /home/teuthworker/archive/dis-2022-02-19_01:15:34-krbd-wip-dis-testing-testing-default-smithi/6695827
2022-02-19T03:14:38.074 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi125 but it was locked by another job: /home/teuthworker/archive/dis-2022-02-19_01:15:34-krbd-wip-dis-testing-testing-default-smithi/6695827