2022-02-12T20:20:31.139 INFO:root:teuthology version: 1.1.0-7cebb3f2
2022-02-12T20:20:31.276 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi058.front.sepia.ceph.com' reimaging
2022-02-12T20:20:31.278 INFO:teuthology.lock.ops:Updating [ubuntu@smithi058.front.sepia.ceph.com]: reset os type and version on server
2022-02-12T20:20:31.278 INFO:teuthology.lock.ops:Updating smithi058.front.sepia.ceph.com on lock server
2022-02-12T20:20:31.300 INFO:teuthology.lock.ops:Node 'ubuntu@smithi058.front.sepia.ceph.com' reimaging is complete
2022-02-12T20:20:31.301 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi153.front.sepia.ceph.com' reimaging
2022-02-12T20:20:31.301 INFO:teuthology.lock.ops:Updating [ubuntu@smithi153.front.sepia.ceph.com]: reset os type and version on server
2022-02-12T20:20:31.301 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2022-02-12T20:20:31.322 INFO:teuthology.lock.ops:Node 'ubuntu@smithi153.front.sepia.ceph.com' reimaging is complete
2022-02-12T20:20:31.557 INFO:teuthology.provision.fog.smithi058:Scheduling deploy of centos 8.stream
2022-02-12T20:20:31.569 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of centos 8.stream
2022-02-12T20:20:32.023 INFO:teuthology.orchestra.console:Power off smithi058
2022-02-12T20:20:32.091 INFO:teuthology.orchestra.console:Power off smithi153
2022-02-12T20:20:32.166 INFO:teuthology.orchestra.console:Power off for smithi058 completed
2022-02-12T20:20:32.233 INFO:teuthology.orchestra.console:Power off for smithi153 completed
2022-02-12T20:20:32.268 INFO:teuthology.orchestra.console:Power on smithi058
2022-02-12T20:20:32.334 INFO:teuthology.orchestra.console:Power on smithi153
2022-02-12T20:20:36.593 INFO:teuthology.orchestra.console:Power on for smithi153 completed
2022-02-12T20:20:36.694 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish
2022-02-12T20:20:40.637 INFO:teuthology.orchestra.console:Power on for smithi058 completed
2022-02-12T20:20:40.738 INFO:teuthology.provision.fog.smithi058:Waiting for deploy to finish
2022-02-12T20:24:48.649 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-12T20:24:48.896 INFO:teuthology.provision.fog.smithi058:Node is ready
2022-02-12T20:24:48.914 INFO:teuthology.orchestra.run.smithi058.stdout:smithi058.front.sepia.ceph.com
2022-02-12T20:24:48.973 INFO:teuthology.orchestra.run.smithi058.stdout:172.21.15.58 smithi058.front.sepia.ceph.com smithi058
2022-02-12T20:24:49.310 INFO:teuthology.provision.fog.smithi058:Deploy complete!
2022-02-12T20:24:58.551 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-12T20:25:23.450 INFO:teuthology.provision.fog.smithi153:Node is ready
2022-02-12T20:25:23.473 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com
2022-02-12T20:25:23.531 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153
2022-02-12T20:25:23.905 INFO:teuthology.provision.fog.smithi153:Deploy complete!
2022-02-12T20:25:24.048 INFO:teuthology.lock.ops:Checking smithi058.front.sepia.ceph.com
2022-02-12T20:25:24.049 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-12T20:25:24.067 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com
2022-02-12T20:25:24.068 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-12T20:25:24.085 INFO:teuthology.lock.ops:Updating [smithi058.front.sepia.ceph.com]: set os type and version on server
2022-02-12T20:25:24.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi058.front.sepia.ceph.com'
2022-02-12T20:25:24.335 INFO:teuthology.orchestra.run.smithi058.stdout:x86_64
2022-02-12T20:25:24.392 INFO:teuthology.orchestra.run.smithi058.stdout:NAME="CentOS Stream"
2022-02-12T20:25:24.392 INFO:teuthology.orchestra.run.smithi058.stdout:VERSION="8"
2022-02-12T20:25:24.393 INFO:teuthology.orchestra.run.smithi058.stdout:ID="centos"
2022-02-12T20:25:24.393 INFO:teuthology.orchestra.run.smithi058.stdout:ID_LIKE="rhel fedora"
2022-02-12T20:25:24.393 INFO:teuthology.orchestra.run.smithi058.stdout:VERSION_ID="8"
2022-02-12T20:25:24.394 INFO:teuthology.orchestra.run.smithi058.stdout:PLATFORM_ID="platform:el8"
2022-02-12T20:25:24.394 INFO:teuthology.orchestra.run.smithi058.stdout:PRETTY_NAME="CentOS Stream 8"
2022-02-12T20:25:24.394 INFO:teuthology.orchestra.run.smithi058.stdout:ANSI_COLOR="0;31"
2022-02-12T20:25:24.395 INFO:teuthology.orchestra.run.smithi058.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-02-12T20:25:24.395 INFO:teuthology.orchestra.run.smithi058.stdout:HOME_URL="https://centos.org/"
2022-02-12T20:25:24.395 INFO:teuthology.orchestra.run.smithi058.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-12T20:25:24.395 INFO:teuthology.orchestra.run.smithi058.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-12T20:25:24.395 INFO:teuthology.orchestra.run.smithi058.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-02-12T20:25:24.397 INFO:teuthology.lock.ops:Updating smithi058.front.sepia.ceph.com on lock server
2022-02-12T20:25:24.416 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server
2022-02-12T20:25:24.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com'
2022-02-12T20:25:24.613 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64
2022-02-12T20:25:24.669 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream"
2022-02-12T20:25:24.670 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8"
2022-02-12T20:25:24.670 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos"
2022-02-12T20:25:24.670 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora"
2022-02-12T20:25:24.670 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8"
2022-02-12T20:25:24.670 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8"
2022-02-12T20:25:24.671 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 8"
2022-02-12T20:25:24.671 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2022-02-12T20:25:24.671 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-02-12T20:25:24.671 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/"
2022-02-12T20:25:24.672 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-12T20:25:24.672 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-12T20:25:24.672 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-02-12T20:25:24.673 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2022-02-12T20:25:24.783 INFO:teuthology.dispatcher.supervisor:Running job 6678555
2022-02-12T20:25:24.783 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7cebb3f2319fd6c8340c0f7cd15a137e747fd32e/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2022-02-12_16:39:52-orch:cephadm-wip-adk-testing-2022-02-12-0153-pacific-distro-basic-smithi/6678555 --name adking-2022-02-12_16:39:52-orch:cephadm-wip-adk-testing-2022-02-12-0153-pacific-distro-basic-smithi --description orch:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/adking-2022-02-12_16:39:52-orch:cephadm-wip-adk-testing-2022-02-12-0153-pacific-distro-basic-smithi/6678555/orig.config.yaml
2022-02-12T20:25:24.787 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2022-02-12_16:39:52-orch:cephadm-wip-adk-testing-2022-02-12-0153-pacific-distro-basic-smithi/6678555
2022-02-12T20:25:24.788 INFO:teuthology.dispatcher.supervisor:Job PID: 4617
2022-02-12T20:25:24.788 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-02-13T02:55:51.041 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-02-13T02:55:51.255 INFO:teuthology.kill:Killing Pids: {4617}
2022-02-13T02:55:52.385 INFO:teuthology.task.internal:roles: ubuntu@smithi058.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-02-13T02:55:52.386 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-02-13T02:55:52.386 INFO:teuthology.misc:Compressing logs...
2022-02-13T02:55:52.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi058.front.sepia.ceph.com'
2022-02-13T02:55:52.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com'
2022-02-13T02:55:52.613 INFO:teuthology.orchestra.run.smithi058.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-02-13T02:55:52.813 INFO:teuthology.orchestra.run.smithi153.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-02-13T02:55:52.857 INFO:teuthology.orchestra.run.smithi058.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-02-13T02:55:52.857 INFO:teuthology.orchestra.run.smithi058.stderr:tar: Error is not recoverable: exiting now
2022-02-13T02:55:52.896 INFO:teuthology.orchestra.run.smithi153.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-02-13T02:55:52.897 INFO:teuthology.orchestra.run.smithi153.stderr:tar: Error is not recoverable: exiting now
2022-02-13T02:55:52.898 INFO:teuthology.misc:Compressing logs...
2022-02-13T02:55:53.212 INFO:teuthology.misc:Compressing logs...
2022-02-13T02:55:56.646 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/d199fa1e-8c42-11ec-8c35-001a4aab830c/ceph-mon.smithi153.log: file size changed while zipping
2022-02-13T02:56:10.227 INFO:teuthology.orchestra.run.smithi058.stderr:gzip: /var/log/ceph/d199fa1e-8c42-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-02-13T02:56:12.438 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/d199fa1e-8c42-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-02-13T02:56:22.599 INFO:teuthology.orchestra.run.smithi058.stderr:gzip: /var/log/ceph/d199fa1e-8c42-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-02-13T02:56:31.514 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/d199fa1e-8c42-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-02-13T02:56:34.572 INFO:teuthology.orchestra.run.smithi058.stderr:gzip: /var/log/ceph/d199fa1e-8c42-11ec-8c35-001a4aab830c/ceph-mon.smithi058.log: file size changed while zipping
2022-02-13T02:56:39.441 INFO:teuthology.orchestra.run.smithi058.stderr:gzip: /var/log/ceph/d199fa1e-8c42-11ec-8c35-001a4aab830c/ceph-mgr.smithi058.pztcfe.log: file size changed while zipping
2022-02-13T02:56:45.169 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/d199fa1e-8c42-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-02-13T02:56:58.370 INFO:teuthology.orchestra.run.smithi058.stderr:gzip: /var/log/ceph/d199fa1e-8c42-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-02-13T02:56:59.833 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/d199fa1e-8c42-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-02-13T02:57:16.393 INFO:teuthology.orchestra.run.smithi058.stderr:gzip: /var/log/ceph/d199fa1e-8c42-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-02-13T02:57:46.827 INFO:teuthology.orchestra.run.smithi153.stderr:tar: .: file changed as we read it
2022-02-13T02:57:46.891 INFO:teuthology.kill:No teuthology processes running
2022-02-13T02:57:48.024 INFO:teuthology.kill:Nuking machines: ['smithi058', 'smithi153']
2022-02-13T02:57:48.957 INFO:teuthology.kill:2022-02-13 02:57:48,956.956 INFO:teuthology.nuke:targets:
2022-02-13T02:57:48.958 INFO:teuthology.kill:  smithi058.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdl705TlC0k68uUXdvLCzWcGUnCFQ18Y9OtU6+pKScuYxHFuFV9D5MaPzVkHRKSPWgQvPimMBMRW2NKW7VHhN+dEOZPCFIY97peOlUWVOTOzS8cAlWMYKch34qCcqxHvkMnD9PqrgCCn+4vXRNLPeIVf6+k13BuUwpZcNgeT0ZusfU5Brs+3GhR99f78ph00DhdscCrxbzWKHtFuwIY5lbcHbtR018x3q91jslrEw1tnZn53JsyGq4jcYZ/L8zyZxiGsjtHNVliFZw736enW/js2pMAJqnSIvidHaMWZb5buMuAvXfgb5hRXyd7UnVTDWh2yHDMCci0iM8Wh6zjOpYaLA54iIyJ8U83JMiqs7r89VMAqE7osB94T8JGQeVLJ9KG9Gz9EKDnrZ5MP41o0fHAuZsZFHObiFT1oQ28vxRnl2EWrTFlRIg1eBZXEtVxRRJ45I7oFgFRNyFMF88jGslehHbWzLC5PRuRAcu/Hy67VvZpQ0f3CbpCQ4KMYLHbTM=
2022-02-13T02:57:48.958 INFO:teuthology.kill:  smithi153.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDxDIP+Yr9iYhq2HkDA6PLRCOPfV0zsn3T/fcqcdY66SyxFUZLfHz/S3A/BRVr1v0+8yxrPgBP6LumsKZvb/FqbPuhv9+NyhnVQTumrvx13vFX3231hQ2OYJF7s9tPB+kfFtdtOuhlBDDkbbbMT8pqRxzKVvDPmkxH6z/y4anR7KLs0a3dseVQldMxbpjyP2RTN8smI311qiBnzdihkEgcLN4bk+MEkJ12+vGNVNvJjsrKpaThAPbYQchMDSzwhAw2DOoxW27/vJZwU2WRL0h9LVl21BBZ0RJkxH229uEVqi6K5Xuhx91sNzVxxlc9trHgbjsKGmE66DoJ7TcG/VYgGPs28PGCpeURhJDCo3uzm8ZuLW19TXM0THDdqTca0gCTg320kYYLhYVac+Q/qUcdwuQPWCnAqRuyBig1th68WM6AeHVY+rK9jzCEz0CEd+23iy90Yvsl0lwCMN4BvcCSjuYvKdRcGWl6Yh2XP5mqeSy7jCjvBnib9AWxB0uyFOhs=
2022-02-13T02:57:48.982 INFO:teuthology.kill:2022-02-13 02:57:48,982.982 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-13T02:57:48.985 INFO:teuthology.kill:2022-02-13 02:57:48,985.985 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-13T02:57:49.056 INFO:teuthology.kill:2022-02-13 02:57:49,056.056 INFO:teuthology.orchestra.console:Power off smithi153
2022-02-13T02:57:49.067 INFO:teuthology.kill:2022-02-13 02:57:49,067.067 INFO:teuthology.orchestra.console:Power off smithi058
2022-02-13T02:58:01.546 INFO:teuthology.kill:2022-02-13 02:58:01,546.546 INFO:teuthology.orchestra.console:Power off for smithi153 completed
2022-02-13T02:58:01.552 INFO:teuthology.kill:2022-02-13 02:58:01,552.552 INFO:teuthology.orchestra.console:Power off for smithi058 completed
2022-02-13T02:58:01.696 INFO:teuthology.kill:2022-02-13 02:58:01,696.696 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com
2022-02-13T02:58:01.700 INFO:teuthology.kill:2022-02-13 02:58:01,700.700 INFO:teuthology.lock.ops:unlocked: smithi058.front.sepia.ceph.com
2022-02-13T03:00:01.990 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15