2022-01-25T15:39:39.059 INFO:root:teuthology version: 1.1.0-75f1bcd2 2022-01-25T15:39:39.266 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi074.front.sepia.ceph.com' reimaging 2022-01-25T15:39:39.267 INFO:teuthology.lock.ops:Updating [ubuntu@smithi074.front.sepia.ceph.com]: reset os type and version on server 2022-01-25T15:39:39.268 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server 2022-01-25T15:39:39.295 INFO:teuthology.lock.ops:Node 'ubuntu@smithi074.front.sepia.ceph.com' reimaging is complete 2022-01-25T15:39:39.296 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi196.front.sepia.ceph.com' reimaging 2022-01-25T15:39:39.296 INFO:teuthology.lock.ops:Updating [ubuntu@smithi196.front.sepia.ceph.com]: reset os type and version on server 2022-01-25T15:39:39.296 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2022-01-25T15:39:39.321 INFO:teuthology.lock.ops:Node 'ubuntu@smithi196.front.sepia.ceph.com' reimaging is complete 2022-01-25T15:39:39.563 INFO:teuthology.provision.fog.smithi074:Scheduling deploy of centos 8.stream 2022-01-25T15:39:39.568 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 8.stream 2022-01-25T15:39:39.923 INFO:teuthology.orchestra.console:Power off smithi074 2022-01-25T15:39:39.940 INFO:teuthology.orchestra.console:Power off smithi196 2022-01-25T15:39:48.300 INFO:teuthology.orchestra.console:Power off for smithi074 completed 2022-01-25T15:39:48.309 INFO:teuthology.orchestra.console:Power off for smithi196 completed 2022-01-25T15:39:48.402 INFO:teuthology.orchestra.console:Power on smithi074 2022-01-25T15:39:48.411 INFO:teuthology.orchestra.console:Power on smithi196 2022-01-25T15:39:52.667 INFO:teuthology.orchestra.console:Power on for smithi196 completed 2022-01-25T15:39:52.772 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish 2022-01-25T15:39:56.768 INFO:teuthology.orchestra.console:Power on for smithi074 completed 2022-01-25T15:39:56.869 INFO:teuthology.provision.fog.smithi074:Waiting for deploy to finish 2022-01-25T15:43:59.235 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-25T15:44:24.789 INFO:teuthology.provision.fog.smithi196:Node is ready 2022-01-25T15:44:24.810 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com 2022-01-25T15:44:24.869 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196 2022-01-25T15:44:25.232 INFO:teuthology.provision.fog.smithi196:Deploy complete! 2022-01-25T15:44:43.712 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-25T15:44:44.007 INFO:teuthology.provision.fog.smithi074:Node is ready 2022-01-25T15:44:44.025 INFO:teuthology.orchestra.run.smithi074.stdout:smithi074.front.sepia.ceph.com 2022-01-25T15:44:44.082 INFO:teuthology.orchestra.run.smithi074.stdout:172.21.15.74 smithi074.front.sepia.ceph.com smithi074 2022-01-25T15:44:44.430 INFO:teuthology.provision.fog.smithi074:Deploy complete! 2022-01-25T15:44:44.668 INFO:teuthology.lock.ops:Checking smithi074.front.sepia.ceph.com 2022-01-25T15:44:44.670 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-25T15:44:44.705 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com 2022-01-25T15:44:44.705 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-25T15:44:44.730 INFO:teuthology.lock.ops:Updating [smithi074.front.sepia.ceph.com]: set os type and version on server 2022-01-25T15:44:44.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi074.front.sepia.ceph.com' 2022-01-25T15:44:44.925 INFO:teuthology.orchestra.run.smithi074.stdout:x86_64 2022-01-25T15:44:44.981 INFO:teuthology.orchestra.run.smithi074.stdout:NAME="CentOS Stream" 2022-01-25T15:44:44.983 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION="8" 2022-01-25T15:44:44.983 INFO:teuthology.orchestra.run.smithi074.stdout:ID="centos" 2022-01-25T15:44:44.983 INFO:teuthology.orchestra.run.smithi074.stdout:ID_LIKE="rhel fedora" 2022-01-25T15:44:44.984 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION_ID="8" 2022-01-25T15:44:44.984 INFO:teuthology.orchestra.run.smithi074.stdout:PLATFORM_ID="platform:el8" 2022-01-25T15:44:44.984 INFO:teuthology.orchestra.run.smithi074.stdout:PRETTY_NAME="CentOS Stream 8" 2022-01-25T15:44:44.985 INFO:teuthology.orchestra.run.smithi074.stdout:ANSI_COLOR="0;31" 2022-01-25T15:44:44.985 INFO:teuthology.orchestra.run.smithi074.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-25T15:44:44.985 INFO:teuthology.orchestra.run.smithi074.stdout:HOME_URL="https://centos.org/" 2022-01-25T15:44:44.985 INFO:teuthology.orchestra.run.smithi074.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-25T15:44:44.985 INFO:teuthology.orchestra.run.smithi074.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-25T15:44:44.986 INFO:teuthology.orchestra.run.smithi074.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-01-25T15:44:44.988 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server 2022-01-25T15:44:45.009 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server 2022-01-25T15:44:45.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2022-01-25T15:44:45.256 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2022-01-25T15:44:45.312 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2022-01-25T15:44:45.312 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8" 2022-01-25T15:44:45.313 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2022-01-25T15:44:45.313 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2022-01-25T15:44:45.313 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8" 2022-01-25T15:44:45.314 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8" 2022-01-25T15:44:45.314 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 8" 2022-01-25T15:44:45.314 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2022-01-25T15:44:45.315 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-25T15:44:45.315 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2022-01-25T15:44:45.315 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-25T15:44:45.315 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-25T15:44:45.316 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-01-25T15:44:45.316 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2022-01-25T15:44:45.412 INFO:teuthology.dispatcher.supervisor:Running job 6637084 2022-01-25T15:44:45.413 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-01-23_07:01:07-rados-master-distro-default-smithi/6637084 --name teuthology-2022-01-23_07:01:07-rados-master-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/teuthology-2022-01-23_07:01:07-rados-master-distro-default-smithi/6637084/orig.config.yaml 2022-01-25T15:44:45.417 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-01-23_07:01:07-rados-master-distro-default-smithi/6637084 2022-01-25T15:44:45.418 INFO:teuthology.dispatcher.supervisor:Job PID: 13782 2022-01-25T15:44:45.418 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-25T22:15:14.523 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-25T22:15:14.760 INFO:teuthology.kill:Killing Pids: {13782} 2022-01-25T22:15:15.870 INFO:teuthology.task.internal:roles: ubuntu@smithi074.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-25T22:15:15.870 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-25T22:15:15.871 INFO:teuthology.misc:Compressing logs... 2022-01-25T22:15:15.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi074.front.sepia.ceph.com' 2022-01-25T22:15:16.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2022-01-25T22:15:16.108 INFO:teuthology.orchestra.run.smithi074.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-25T22:15:16.303 INFO:teuthology.orchestra.run.smithi196.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-25T22:15:16.347 INFO:teuthology.orchestra.run.smithi074.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-25T22:15:16.347 INFO:teuthology.orchestra.run.smithi074.stderr:tar: Error is not recoverable: exiting now 2022-01-25T22:15:16.386 INFO:teuthology.orchestra.run.smithi196.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-25T22:15:16.387 INFO:teuthology.orchestra.run.smithi196.stderr:tar: Error is not recoverable: exiting now 2022-01-25T22:15:16.388 INFO:teuthology.misc:Compressing logs... 2022-01-25T22:15:16.589 INFO:teuthology.misc:Compressing logs... 2022-01-25T22:15:20.197 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/e140be9e-7df6-11ec-8c35-001a4aab830c/ceph-mon.smithi196.log: file size changed while zipping 2022-01-25T22:15:24.447 INFO:teuthology.orchestra.run.smithi074.stderr:gzip: /var/log/ceph/e140be9e-7df6-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-25T22:15:26.157 INFO:teuthology.orchestra.run.smithi074.stderr:gzip: /var/log/ceph/e140be9e-7df6-11ec-8c35-001a4aab830c/ceph-mgr.smithi074.lwrpsw.log: file size changed while zipping 2022-01-25T22:15:27.638 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/e140be9e-7df6-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-25T22:15:33.174 INFO:teuthology.orchestra.run.smithi074.stderr:gzip: /var/log/ceph/e140be9e-7df6-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-25T22:15:36.080 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/e140be9e-7df6-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-25T22:15:41.766 INFO:teuthology.orchestra.run.smithi074.stderr:gzip: /var/log/ceph/e140be9e-7df6-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-25T22:15:43.423 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/e140be9e-7df6-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-25T22:15:49.706 INFO:teuthology.orchestra.run.smithi074.stderr:gzip: /var/log/ceph/e140be9e-7df6-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-25T22:15:53.229 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/e140be9e-7df6-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-25T22:15:58.859 INFO:teuthology.orchestra.run.smithi074.stderr:gzip: /var/log/ceph/e140be9e-7df6-11ec-8c35-001a4aab830c/ceph-mon.smithi074.log: file size changed while zipping 2022-01-25T22:16:15.779 INFO:teuthology.kill:No teuthology processes running 2022-01-25T22:16:16.946 INFO:teuthology.kill:Nuking machines: ['smithi074', 'smithi196'] 2022-01-25T22:16:17.936 INFO:teuthology.kill:2022-01-25 22:16:17,936.936 INFO:teuthology.nuke:targets: 2022-01-25T22:16:17.937 INFO:teuthology.kill: smithi074.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDD4msxiZJph5ysWL1N/9s+Ky8k3FiogGE6zCMb6lBiPhTpEdS7HmQ/bkauG6eQftOncb8DrJ1bbU+B64okLxYQdpluqjQlqr4Cswf89dd3A0OOQb982Hs/fpv0RkTDn5d8cbU5wnt7A5bYl01+619/butADBYVj9o+1rQpHwXyT/WFVQE5UgnYFo3SDPZonpkn+CLrBGqJd9uVZVkS7xeVGmKMpj0q2BE1rLscIiv0QYkElE2p1DNlqMl6FcffTXT5AiWXHHKpRNWUZyZJ+OlzKe2lDkButqqRR8oWZUitQIwuW6CKEjHAJbQRQpt4DG8Tqtdro2C6/q7YLuzVLh0p4+fosz3sRkP2QCOuxrVNzcSF/to8Vixzx9Xl4H7zoGRi4eGNX/134dG+iIdWa8PZCBFMZY47uVOjB/nhzT0uQYWHZsK6tx1XpA2HdrIcX4BHN7huztkvu+CiafjgEW8fpDEtAOxIOEDzrwvkPBIz2JvfdQKlhFMhbqy5qBmN+G8= 2022-01-25T22:16:17.938 INFO:teuthology.kill: smithi196.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbcl0WAq15xtnwbztSEwXf83FQ0NN5/Px2Dnv0tfZ0iNOXmi91ybb2OSO8GW6D8zu33Qk5JuMa7XVjLhFjlPAXJx6jhvDqNi6/+Edf6ySVuzcVYKRGwx4EG2OnH/0ceCzhV/XbJFDI1Epgq84X1lOdkkziGemZdNV9FEll94Z13NNScVoSGmJzhGs8mlSRYGLECfIma7VmXrCvKofKs/eZkCsxlug3bl+qvsio4VP4Y4YSeFOV7CfKj9r8IHBQOdE0nELjVQM3J87NILETv1msAl26I5A6eEc2iTOM1IjeAJeDoC2Ggp6GCYHveE5hkKmX4hFTteNpKV/kzKVORvrFOjDnwi6ufD3nRBMjuQXH9YbmzynQrukAfrCgPL2jQeK8Z+pTQP7mISLhqJF9TAVupDMcRPaXT6sM2HomgMY8cy2jQioUyIAH0HJ6SM/p6ngfqaxvwWobLePBmqS5uoKk7OSnJGOPa5K5NfKf/VN/Ce3YihJFCjjR9+mZQJSSK8k= 2022-01-25T22:16:17.963 INFO:teuthology.kill:2022-01-25 22:16:17,963.963 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-25T22:16:17.966 INFO:teuthology.kill:2022-01-25 22:16:17,966.966 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-25T22:16:18.041 INFO:teuthology.kill:2022-01-25 22:16:18,040.040 INFO:teuthology.orchestra.console:Power off smithi074 2022-01-25T22:16:18.054 INFO:teuthology.kill:2022-01-25 22:16:18,053.053 INFO:teuthology.orchestra.console:Power off smithi196 2022-01-25T22:16:26.409 INFO:teuthology.kill:2022-01-25 22:16:26,408.408 INFO:teuthology.orchestra.console:Power off for smithi074 completed 2022-01-25T22:16:26.560 INFO:teuthology.kill:2022-01-25 22:16:26,559.559 INFO:teuthology.lock.ops:unlocked: smithi074.front.sepia.ceph.com 2022-01-25T22:16:30.528 INFO:teuthology.kill:2022-01-25 22:16:30,527.527 INFO:teuthology.orchestra.console:Power off for smithi196 completed 2022-01-25T22:16:30.673 INFO:teuthology.kill:2022-01-25 22:16:30,673.673 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com 2022-01-25T22:18:30.982 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-25T22:18:31.075 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi074 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-24_05:05:03-rgw-octopus-distro-default-smithi/6637412 2022-01-25T22:18:31.075 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi196 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-24_05:05:03-rgw-octopus-distro-default-smithi/6637412