2022-01-10T19:36:52.476 INFO:root:teuthology version: 1.1.0-00e09f05
2022-01-10T19:36:52.604 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi101.front.sepia.ceph.com' reimaging
2022-01-10T19:36:52.606 INFO:teuthology.lock.ops:Updating [ubuntu@smithi101.front.sepia.ceph.com]: reset os type and version on server
2022-01-10T19:36:52.606 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server
2022-01-10T19:36:52.627 INFO:teuthology.lock.ops:Node 'ubuntu@smithi101.front.sepia.ceph.com' reimaging is complete
2022-01-10T19:36:52.627 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi197.front.sepia.ceph.com' reimaging
2022-01-10T19:36:52.628 INFO:teuthology.lock.ops:Updating [ubuntu@smithi197.front.sepia.ceph.com]: reset os type and version on server
2022-01-10T19:36:52.628 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server
2022-01-10T19:36:52.646 INFO:teuthology.lock.ops:Node 'ubuntu@smithi197.front.sepia.ceph.com' reimaging is complete
2022-01-10T19:36:52.847 INFO:teuthology.provision.fog.smithi101:Scheduling deploy of rhel 8.4
2022-01-10T19:36:52.870 INFO:teuthology.provision.fog.smithi197:Scheduling deploy of rhel 8.4
2022-01-10T19:36:53.271 INFO:teuthology.orchestra.console:Power off smithi101
2022-01-10T19:36:53.287 INFO:teuthology.orchestra.console:Power off smithi197
2022-01-10T19:37:01.657 INFO:teuthology.orchestra.console:Power off for smithi197 completed
2022-01-10T19:37:01.758 INFO:teuthology.orchestra.console:Power on smithi197
2022-01-10T19:37:05.756 INFO:teuthology.orchestra.console:Power off for smithi101 completed
2022-01-10T19:37:05.858 INFO:teuthology.orchestra.console:Power on smithi101
2022-01-10T19:37:06.007 INFO:teuthology.orchestra.console:Power on for smithi197 completed
2022-01-10T19:37:06.109 INFO:teuthology.provision.fog.smithi197:Waiting for deploy to finish
2022-01-10T19:37:10.119 INFO:teuthology.orchestra.console:Power on for smithi101 completed
2022-01-10T19:37:10.221 INFO:teuthology.provision.fog.smithi101:Waiting for deploy to finish
2022-01-10T19:41:18.400 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-10T19:41:33.817 INFO:teuthology.provision.fog.smithi197:Node is ready
2022-01-10T19:41:33.848 INFO:teuthology.orchestra.run.smithi197.stdout:smithi197.front.sepia.ceph.com
2022-01-10T19:41:33.910 INFO:teuthology.orchestra.run.smithi197.stdout:172.21.15.197 smithi197.front.sepia.ceph.com smithi197
2022-01-10T19:41:34.254 INFO:teuthology.provision.fog.smithi197:Deploy complete!
2022-01-10T19:42:15.279 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-10T19:42:15.540 INFO:teuthology.provision.fog.smithi101:Node is ready
2022-01-10T19:42:15.564 INFO:teuthology.orchestra.run.smithi101.stdout:smithi101.front.sepia.ceph.com
2022-01-10T19:42:15.628 INFO:teuthology.orchestra.run.smithi101.stdout:172.21.15.101 smithi101.front.sepia.ceph.com smithi101
2022-01-10T19:42:15.967 INFO:teuthology.provision.fog.smithi101:Deploy complete!
2022-01-10T19:42:16.145 INFO:teuthology.lock.ops:Checking smithi101.front.sepia.ceph.com
2022-01-10T19:42:16.146 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-10T19:42:16.166 INFO:teuthology.lock.ops:Checking smithi197.front.sepia.ceph.com
2022-01-10T19:42:16.166 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-10T19:42:16.184 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: set os type and version on server
2022-01-10T19:42:16.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com'
2022-01-10T19:42:16.370 INFO:teuthology.orchestra.run.smithi101.stdout:x86_64
2022-01-10T19:42:16.425 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="Red Hat Enterprise Linux"
2022-01-10T19:42:16.425 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="8.4 (Ootpa)"
2022-01-10T19:42:16.426 INFO:teuthology.orchestra.run.smithi101.stdout:ID="rhel"
2022-01-10T19:42:16.426 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE="fedora"
2022-01-10T19:42:16.427 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="8.4"
2022-01-10T19:42:16.427 INFO:teuthology.orchestra.run.smithi101.stdout:PLATFORM_ID="platform:el8"
2022-01-10T19:42:16.428 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-01-10T19:42:16.428 INFO:teuthology.orchestra.run.smithi101.stdout:ANSI_COLOR="0;31"
2022-01-10T19:42:16.428 INFO:teuthology.orchestra.run.smithi101.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-01-10T19:42:16.429 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://www.redhat.com/"
2022-01-10T19:42:16.430 INFO:teuthology.orchestra.run.smithi101.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-01-10T19:42:16.430 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-10T19:42:16.431 INFO:teuthology.orchestra.run.smithi101.stdout:
2022-01-10T19:42:16.431 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-10T19:42:16.432 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-01-10T19:42:16.432 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-01-10T19:42:16.432 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-01-10T19:42:16.434 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server
2022-01-10T19:42:16.453 INFO:teuthology.lock.ops:Updating [smithi197.front.sepia.ceph.com]: set os type and version on server
2022-01-10T19:42:16.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com'
2022-01-10T19:42:16.692 INFO:teuthology.orchestra.run.smithi197.stdout:x86_64
2022-01-10T19:42:16.747 INFO:teuthology.orchestra.run.smithi197.stdout:NAME="Red Hat Enterprise Linux"
2022-01-10T19:42:16.748 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION="8.4 (Ootpa)"
2022-01-10T19:42:16.748 INFO:teuthology.orchestra.run.smithi197.stdout:ID="rhel"
2022-01-10T19:42:16.748 INFO:teuthology.orchestra.run.smithi197.stdout:ID_LIKE="fedora"
2022-01-10T19:42:16.749 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION_ID="8.4"
2022-01-10T19:42:16.749 INFO:teuthology.orchestra.run.smithi197.stdout:PLATFORM_ID="platform:el8"
2022-01-10T19:42:16.750 INFO:teuthology.orchestra.run.smithi197.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-01-10T19:42:16.750 INFO:teuthology.orchestra.run.smithi197.stdout:ANSI_COLOR="0;31"
2022-01-10T19:42:16.751 INFO:teuthology.orchestra.run.smithi197.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-01-10T19:42:16.751 INFO:teuthology.orchestra.run.smithi197.stdout:HOME_URL="https://www.redhat.com/"
2022-01-10T19:42:16.751 INFO:teuthology.orchestra.run.smithi197.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-01-10T19:42:16.752 INFO:teuthology.orchestra.run.smithi197.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-10T19:42:16.752 INFO:teuthology.orchestra.run.smithi197.stdout:
2022-01-10T19:42:16.753 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-10T19:42:16.753 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-01-10T19:42:16.753 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-01-10T19:42:16.754 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-01-10T19:42:16.755 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server
2022-01-10T19:42:16.847 INFO:teuthology.dispatcher.supervisor:Running job 6604574
2022-01-10T19:42:16.847 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_00e09f05e9fb2ab7c7f497f5e446613531743ae2/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-01-09_07:01:02-rados-master-distro-default-smithi/6604574 --name teuthology-2022-01-09_07:01:02-rados-master-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/teuthology-2022-01-09_07:01:02-rados-master-distro-default-smithi/6604574/orig.config.yaml
2022-01-10T19:42:16.851 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-01-09_07:01:02-rados-master-distro-default-smithi/6604574
2022-01-10T19:42:16.851 INFO:teuthology.dispatcher.supervisor:Job PID: 4307
2022-01-10T19:42:16.852 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-11T07:42:37.100 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-01-11T07:42:37.326 INFO:teuthology.kill:Killing Pids: {4307}
2022-01-11T07:42:38.490 INFO:teuthology.task.internal:roles: ubuntu@smithi101.front.sepia.ceph.com - ['host.a', 'client.0']
2022-01-11T07:42:38.491 INFO:teuthology.task.internal:roles: ubuntu@smithi197.front.sepia.ceph.com - ['host.b', 'client.1']
2022-01-11T07:42:38.491 INFO:teuthology.misc:Compressing logs...
2022-01-11T07:42:38.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com'
2022-01-11T07:42:38.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com'
2022-01-11T07:42:38.728 INFO:teuthology.orchestra.run.smithi101.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-11T07:42:38.962 INFO:teuthology.orchestra.run.smithi197.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-11T07:42:38.999 INFO:teuthology.orchestra.run.smithi101.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-11T07:42:39.000 INFO:teuthology.orchestra.run.smithi101.stderr:tar: Error is not recoverable: exiting now
2022-01-11T07:42:39.057 INFO:teuthology.orchestra.run.smithi197.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-11T07:42:39.057 INFO:teuthology.orchestra.run.smithi197.stderr:tar: Error is not recoverable: exiting now
2022-01-11T07:42:39.059 INFO:teuthology.misc:Compressing logs...
2022-01-11T07:42:39.253 INFO:teuthology.misc:Compressing logs...
2022-01-11T07:42:40.427 INFO:teuthology.orchestra.run.smithi101.stderr:gzip: /var/log/ceph/e08c913e-724e-11ec-8c32-001a4aab830c/ceph-mgr.smithi101.nrousi.log: file size changed while zipping
2022-01-11T07:42:45.313 INFO:teuthology.orchestra.run.smithi101.stderr:gzip: /var/log/ceph/e08c913e-724e-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-11T07:42:45.840 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/e08c913e-724e-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-11T07:42:50.168 INFO:teuthology.orchestra.run.smithi101.stderr:gzip: /var/log/ceph/e08c913e-724e-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-11T07:42:50.926 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/e08c913e-724e-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-11T07:42:55.581 INFO:teuthology.orchestra.run.smithi101.stderr:gzip: /var/log/ceph/e08c913e-724e-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-11T07:42:57.399 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/e08c913e-724e-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-11T07:42:59.879 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/e08c913e-724e-11ec-8c32-001a4aab830c/ceph-mon.smithi197.log: file size changed while zipping
2022-01-11T07:43:02.073 INFO:teuthology.orchestra.run.smithi101.stderr:gzip: /var/log/ceph/e08c913e-724e-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-11T07:43:05.175 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/e08c913e-724e-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-11T07:43:08.190 INFO:teuthology.orchestra.run.smithi101.stderr:gzip: /var/log/ceph/e08c913e-724e-11ec-8c32-001a4aab830c/ceph-mon.smithi101.log: file size changed while zipping
2022-01-11T07:43:39.756 INFO:teuthology.kill:No teuthology processes running
2022-01-11T07:43:40.929 INFO:teuthology.kill:Nuking machines: ['smithi101', 'smithi197']
2022-01-11T07:43:41.941 INFO:teuthology.kill:2022-01-11 07:43:41,940.940 INFO:teuthology.nuke:targets:
2022-01-11T07:43:41.942 INFO:teuthology.kill:  smithi101.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0QgqiXGDUTZhrINiNbsa2B6ziDCslRv891L/qbQ8LsfwP/58HhGnA++33PQ/zqV6wDUn55GbDf34l2AJkGpsh8CVtTmP7pFjl6htSaI4x2T+LdyICmhk1GmSrjnZ1j+Xhcb5FeoXkVCX2F0qk5A7jsYjPxQvt27Hy51Pe/5uEGtivRr/toh4RFpFA2M+WwrSQKWKv72UPAvOiCQhpVpoRs/mXZOEYIqvY2C/VazuugtWrwziwi+1Hs2169Rl+w/Yo66i0LMxMoCPZg3AJcVabqa+6sp/oFs8KxOOlPfb3ko0aI3pTTBR76lCxqhKVW4BE9SFMGej65flcZwYd2yzmhKoKtG05RsyY+ZaYB6cQurhjrr06wRYoeGU7pMOYJOSjREcVWy9WlaLlBp0gswJ+1DUinic6mnlNVCv2M5NbNDx1zEaqfxespsVSc/xIsHm06JSVpR8hlTQYoZtGjaOab/4FgTU9wNeeo5zkw3+R5F/ci+eFlhBQYyxzjBBiI6M=
2022-01-11T07:43:41.942 INFO:teuthology.kill:  smithi197.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCgEq6mcNxqC4W5G9tPFTwUNvP+aYsY57EHBOVmwNuhw/+6O4ia9y3uDm4FM69IO/PAnVlATAVTKCSiYyITUfyRM3817XJx71LqF+3j8WGNdfPHzOseN00K3lV2bPD68E6wc4z5tgQR6RJvZDLdGLMnZTjE06CY5LQZKZh/6VLJ4FtgmBaj9OkETdW30PgmVhBqqdcszzJUpir8e2d/gDBAEYClm+h5YILA6bZyL+2/Xr+1OYCyoz2KWjMEF0iWwYSBhZ5LSjYSgnxq/W9+RaHogUZDutNV3C/AV6tZPFGS0AJL3jWE0q/FtOcVbC7m0C0CeJDDZLovOkjXpUKpjZImybF1AwKNCy/QRDJBfbtN/p1SPII9WdPE5utQaUnzR3TRiog0wB3FY8pHIgvnAGIqSPMeAgG80gMuFsf/Dl6X7dkN/X+nYDFvtM8KJFWzom0ZcrZdq3i8jigtLmtHtYmvSlv/h4FTvEBS2QxDhdNBiO5W88YsL15b2zcCUr7q60s=
2022-01-11T07:43:41.968 INFO:teuthology.kill:2022-01-11 07:43:41,967.967 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-11T07:43:41.971 INFO:teuthology.kill:2022-01-11 07:43:41,971.971 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-11T07:43:42.051 INFO:teuthology.kill:2022-01-11 07:43:42,050.050 INFO:teuthology.orchestra.console:Power off smithi101
2022-01-11T07:43:42.066 INFO:teuthology.kill:2022-01-11 07:43:42,065.065 INFO:teuthology.orchestra.console:Power off smithi197
2022-01-11T07:43:50.423 INFO:teuthology.kill:2022-01-11 07:43:50,422.422 INFO:teuthology.orchestra.console:Power off for smithi101 completed
2022-01-11T07:43:50.568 INFO:teuthology.kill:2022-01-11 07:43:50,567.567 INFO:teuthology.lock.ops:unlocked: smithi101.front.sepia.ceph.com
2022-01-11T07:43:54.543 INFO:teuthology.kill:2022-01-11 07:43:54,542.542 INFO:teuthology.orchestra.console:Power off for smithi197 completed
2022-01-11T07:43:54.689 INFO:teuthology.kill:2022-01-11 07:43:54,688.688 INFO:teuthology.lock.ops:unlocked: smithi197.front.sepia.ceph.com
2022-01-11T07:45:54.997 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-11T07:45:55.093 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi101 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-11_04:17:02-fs-pacific-distro-default-smithi/6607266
2022-01-11T07:45:55.093 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi197 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-11_04:17:02-fs-pacific-distro-default-smithi/6607266