2022-03-18T06:46:08.144 INFO:root:teuthology version: 1.1.0-aa078dbe
2022-03-18T06:46:08.283 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi059.front.sepia.ceph.com' reimaging
2022-03-18T06:46:08.284 INFO:teuthology.lock.ops:Updating [ubuntu@smithi059.front.sepia.ceph.com]: reset os type and version on server
2022-03-18T06:46:08.285 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server
2022-03-18T06:46:08.304 INFO:teuthology.lock.ops:Node 'ubuntu@smithi059.front.sepia.ceph.com' reimaging is complete
2022-03-18T06:46:08.305 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi195.front.sepia.ceph.com' reimaging
2022-03-18T06:46:08.305 INFO:teuthology.lock.ops:Updating [ubuntu@smithi195.front.sepia.ceph.com]: reset os type and version on server
2022-03-18T06:46:08.306 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server
2022-03-18T06:46:08.325 INFO:teuthology.lock.ops:Node 'ubuntu@smithi195.front.sepia.ceph.com' reimaging is complete
2022-03-18T06:46:08.520 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of centos 8.stream
2022-03-18T06:46:08.543 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of centos 8.stream
2022-03-18T06:46:08.834 INFO:teuthology.orchestra.console:Power off smithi059
2022-03-18T06:46:08.851 INFO:teuthology.orchestra.console:Power off smithi195
2022-03-18T06:46:17.217 INFO:teuthology.orchestra.console:Power off for smithi195 completed
2022-03-18T06:46:17.318 INFO:teuthology.orchestra.console:Power on smithi195
2022-03-18T06:46:21.320 INFO:teuthology.orchestra.console:Power off for smithi059 completed
2022-03-18T06:46:21.422 INFO:teuthology.orchestra.console:Power on smithi059
2022-03-18T06:46:25.676 INFO:teuthology.orchestra.console:Power on for smithi059 completed
2022-03-18T06:46:25.684 INFO:teuthology.orchestra.console:Power on for smithi195 completed
2022-03-18T06:46:25.778 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish
2022-03-18T06:46:25.785 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish
2022-03-18T06:50:07.956 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-18T06:50:28.258 INFO:teuthology.provision.fog.smithi059:Node is ready
2022-03-18T06:50:28.281 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com
2022-03-18T06:50:28.342 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059
2022-03-18T06:50:28.731 INFO:teuthology.provision.fog.smithi059:Deploy complete!
2022-03-18T06:50:32.019 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-18T06:50:57.491 INFO:teuthology.provision.fog.smithi195:Node is ready
2022-03-18T06:50:57.514 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com
2022-03-18T06:50:57.572 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195
2022-03-18T06:50:57.934 INFO:teuthology.provision.fog.smithi195:Deploy complete!
2022-03-18T06:50:58.086 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com
2022-03-18T06:50:58.087 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-18T06:50:58.106 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com
2022-03-18T06:50:58.106 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-18T06:50:58.123 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server
2022-03-18T06:50:58.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com'
2022-03-18T06:50:58.378 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64
2022-03-18T06:50:58.436 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream"
2022-03-18T06:50:58.436 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8"
2022-03-18T06:50:58.437 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos"
2022-03-18T06:50:58.437 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora"
2022-03-18T06:50:58.437 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8"
2022-03-18T06:50:58.438 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8"
2022-03-18T06:50:58.438 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-18T06:50:58.438 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31"
2022-03-18T06:50:58.438 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-18T06:50:58.439 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/"
2022-03-18T06:50:58.439 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-18T06:50:58.439 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-18T06:50:58.439 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-18T06:50:58.441 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server
2022-03-18T06:50:58.460 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server
2022-03-18T06:50:58.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com'
2022-03-18T06:50:58.649 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64
2022-03-18T06:50:58.706 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream"
2022-03-18T06:50:58.707 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8"
2022-03-18T06:50:58.707 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos"
2022-03-18T06:50:58.707 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora"
2022-03-18T06:50:58.708 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8"
2022-03-18T06:50:58.708 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8"
2022-03-18T06:50:58.708 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-18T06:50:58.708 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31"
2022-03-18T06:50:58.709 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-18T06:50:58.709 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/"
2022-03-18T06:50:58.709 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-18T06:50:58.709 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-18T06:50:58.709 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-18T06:50:58.710 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server
2022-03-18T06:50:58.808 INFO:teuthology.dispatcher.supervisor:Running job 6743943
2022-03-18T06:50:58.809 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_aa078dbed6d14c1ad98beb5a02b956bbe0a741c8/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2022-03-18_02:57:32-orch:cephadm-wip-adk-testing-2022-03-17-1930-distro-basic-smithi/6743943 --name adking-2022-03-18_02:57:32-orch:cephadm-wip-adk-testing-2022-03-17-1930-distro-basic-smithi --description orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/adking-2022-03-18_02:57:32-orch:cephadm-wip-adk-testing-2022-03-17-1930-distro-basic-smithi/6743943/orig.config.yaml
2022-03-18T06:50:58.813 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2022-03-18_02:57:32-orch:cephadm-wip-adk-testing-2022-03-17-1930-distro-basic-smithi/6743943
2022-03-18T06:50:58.814 INFO:teuthology.dispatcher.supervisor:Job PID: 20048
2022-03-18T06:50:58.814 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-18T13:21:27.671 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-18T13:21:27.841 INFO:teuthology.kill:Killing Pids: {20048}
2022-03-18T13:21:29.010 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-18T13:21:29.011 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-18T13:21:29.011 INFO:teuthology.misc:Compressing logs...
2022-03-18T13:21:29.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com'
2022-03-18T13:21:29.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com'
2022-03-18T13:21:29.237 INFO:teuthology.orchestra.run.smithi059.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-03-18T13:21:29.424 INFO:teuthology.orchestra.run.smithi195.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-03-18T13:21:29.478 INFO:teuthology.orchestra.run.smithi059.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-18T13:21:29.478 INFO:teuthology.orchestra.run.smithi059.stderr:tar: Error is not recoverable: exiting now
2022-03-18T13:21:29.561 INFO:teuthology.orchestra.run.smithi195.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-18T13:21:29.561 INFO:teuthology.orchestra.run.smithi195.stderr:tar: Error is not recoverable: exiting now
2022-03-18T13:21:29.563 INFO:teuthology.misc:Compressing logs...
2022-03-18T13:21:29.826 INFO:teuthology.misc:Compressing logs...
2022-03-18T13:21:33.772 INFO:teuthology.orchestra.run.smithi195.stderr:gzip: /var/log/ceph/f51a45e2-a688-11ec-8c35-001a4aab830c/ceph-mon.smithi195.log: file size changed while zipping
2022-03-18T13:21:46.892 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/f51a45e2-a688-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-03-18T13:21:49.799 INFO:teuthology.orchestra.run.smithi195.stderr:gzip: /var/log/ceph/f51a45e2-a688-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-03-18T13:21:58.527 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/f51a45e2-a688-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-03-18T13:22:01.209 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/f51a45e2-a688-11ec-8c35-001a4aab830c/ceph-mgr.smithi059.ljzccz.log: file size changed while zipping
2022-03-18T13:22:09.506 INFO:teuthology.orchestra.run.smithi195.stderr:gzip: /var/log/ceph/f51a45e2-a688-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-03-18T13:22:20.791 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/f51a45e2-a688-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-03-18T13:22:23.003 INFO:teuthology.orchestra.run.smithi195.stderr:gzip: /var/log/ceph/f51a45e2-a688-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-03-18T13:22:32.467 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/f51a45e2-a688-11ec-8c35-001a4aab830c/ceph-mon.smithi059.log: file size changed while zipping
2022-03-18T13:22:38.979 INFO:teuthology.orchestra.run.smithi195.stderr:gzip: /var/log/ceph/f51a45e2-a688-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-03-18T13:22:51.264 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/f51a45e2-a688-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-03-18T13:23:15.204 INFO:teuthology.orchestra.run.smithi195.stderr:tar: ./f51a45e2-a688-11ec-8c35-001a4aab830c/ceph-osd.5.log.gz: file changed as we read it
2022-03-18T13:23:21.779 INFO:teuthology.orchestra.run.smithi195.stderr:tar: ./f51a45e2-a688-11ec-8c35-001a4aab830c: file changed as we read it
2022-03-18T13:23:21.847 INFO:teuthology.kill:No teuthology processes running
2022-03-18T13:23:22.968 INFO:teuthology.kill:Nuking machines: ['smithi059', 'smithi195']
2022-03-18T13:23:23.934 INFO:teuthology.kill:2022-03-18 13:23:23,933.933 INFO:teuthology.nuke:targets:
2022-03-18T13:23:23.935 INFO:teuthology.kill:  smithi059.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZygGbOrZAtSz2M2kyxLCr3RAncq6C4LaUz7DWCWlNPmsd6N2hBOTyQAAx6EV4bxpXA6kjEfzK2sSw7P9+8O5cVHO5L5a+u8w7g/nts9puytxWPIROv4zcp+LQIPtS0U3aEB9iSG52diXtcXORVq+f3Fjoh4jvIHkeCg8ZjhevN4hdm/xuU7OlqOHJmDrLXE5WOfy3AaNq5OnBoVynsgVKmM3+1YH4gJ/p25G8R2pd5nnO4GctGks4p4XQvedSRcpdW1OL4WUppXjZYoDpOOJ7ou9L1myc0+9W4veVZFYEqVUjQRsxHMaM/bnVc/k7ievnsfwBe1INTdd5no+Sop3GN31OQkxjGMIoSsbM2HTZ+4Arr3S7dLdF7zv7xhPIoMEgz7k6z1dxh3BfPpUy/ZhHEi0HIIeze0NH1YV0smdooRy1Kcc24FKgUDg/QWyLqdMDA11kgU+QHIR0TwF1b0Ir3Y2SDqyevlG9EllOPGMpo8tnipAV6BG1jD9stob98wk=
2022-03-18T13:23:23.935 INFO:teuthology.kill:  smithi195.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwmmj6K7YbsqFfBDEPBwDyOfXIerchnT4jRFVZ/i6cE4D+clV6fdkdnSkUHH4uaile68ZP7CntfMEw4mw26x2AxL1ATwEjQYqAxJ/QI9Vw8utnzo0RuDr2Mj2HZKUwNlBFN6wzEw4rVQcRtM7qfLWkRxCam5lgVHPCPs6jjAK1S3ty6E44gVJusS/2bI+OU3zV1hUhgnFVvKV6sGe09MsAt97zc/3ys61NyInzCkXBNJpIwB6O27VDH3axQoogXHP7UIHUlq81NEsjZZE2OcrBcvsSB1aVUWYGN3zM1Fh/Lsq5QKq7Nvg0qFbY9kL3yyVCZ0CL247fZnMo29GGckEGbX1myxzLoi9YrFuaJfhm62TfKYw8ghTR1ga9TTjaFq4XGtGoytmeC8oCC1DDyop2cqksrjpym4qKXf2k1Ziav2DDn+yRwDF2mdet1q4w7PfL3U69hMfqLN5BQ2KtRItTrQhhT5f96N5/EAoH0siVIVqpkDjJYnl9ZeiCP8htsus=
2022-03-18T13:23:23.960 INFO:teuthology.kill:2022-03-18 13:23:23,960.960 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-18T13:23:23.963 INFO:teuthology.kill:2022-03-18 13:23:23,962.962 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-18T13:23:24.039 INFO:teuthology.kill:2022-03-18 13:23:24,039.039 INFO:teuthology.orchestra.console:Power off smithi059
2022-03-18T13:23:24.052 INFO:teuthology.kill:2022-03-18 13:23:24,051.051 INFO:teuthology.orchestra.console:Power off smithi195
2022-03-18T13:23:32.412 INFO:teuthology.kill:2022-03-18 13:23:32,411.411 INFO:teuthology.orchestra.console:Power off for smithi059 completed
2022-03-18T13:23:32.417 INFO:teuthology.kill:2022-03-18 13:23:32,417.417 INFO:teuthology.orchestra.console:Power off for smithi195 completed
2022-03-18T13:23:32.559 INFO:teuthology.kill:2022-03-18 13:23:32,558.558 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com
2022-03-18T13:23:32.562 INFO:teuthology.kill:2022-03-18 13:23:32,562.562 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com
2022-03-18T13:25:32.851 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-18T13:25:32.947 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi059 but it was locked by another job: /home/teuthworker/archive/gabrioux-2022-03-18_13:09:47-orch:cephadm-wip-guits-testing-2022-03-17-1934-distro-default-smithi/6745087
2022-03-18T13:25:32.947 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi195 but it was locked by another job: /home/teuthworker/archive/gabrioux-2022-03-18_13:09:47-orch:cephadm-wip-guits-testing-2022-03-17-1934-distro-default-smithi/6745086