2022-02-11T18:36:48.376 INFO:root:teuthology version: 1.1.0-7cebb3f2 2022-02-11T18:36:48.501 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi023.front.sepia.ceph.com' reimaging 2022-02-11T18:36:48.502 INFO:teuthology.lock.ops:Updating [ubuntu@smithi023.front.sepia.ceph.com]: reset os type and version on server 2022-02-11T18:36:48.503 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2022-02-11T18:36:48.534 INFO:teuthology.lock.ops:Node 'ubuntu@smithi023.front.sepia.ceph.com' reimaging is complete 2022-02-11T18:36:48.535 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi042.front.sepia.ceph.com' reimaging 2022-02-11T18:36:48.535 INFO:teuthology.lock.ops:Updating [ubuntu@smithi042.front.sepia.ceph.com]: reset os type and version on server 2022-02-11T18:36:48.536 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2022-02-11T18:36:48.554 INFO:teuthology.lock.ops:Node 'ubuntu@smithi042.front.sepia.ceph.com' reimaging is complete 2022-02-11T18:36:48.749 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of centos 8.stream 2022-02-11T18:36:48.756 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of centos 8.stream 2022-02-11T18:36:49.073 INFO:teuthology.orchestra.console:Power off smithi023 2022-02-11T18:36:49.088 INFO:teuthology.orchestra.console:Power off smithi042 2022-02-11T18:36:57.445 INFO:teuthology.orchestra.console:Power off for smithi023 completed 2022-02-11T18:36:57.546 INFO:teuthology.orchestra.console:Power on smithi023 2022-02-11T18:37:01.561 INFO:teuthology.orchestra.console:Power off for smithi042 completed 2022-02-11T18:37:01.663 INFO:teuthology.orchestra.console:Power on smithi042 2022-02-11T18:37:05.911 INFO:teuthology.orchestra.console:Power on for smithi023 completed 2022-02-11T18:37:05.918 INFO:teuthology.orchestra.console:Power on for smithi042 completed 2022-02-11T18:37:06.012 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish 2022-02-11T18:37:06.019 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish 2022-02-11T18:41:19.897 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-11T18:41:20.163 INFO:teuthology.provision.fog.smithi042:Node is ready 2022-02-11T18:41:20.182 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com 2022-02-11T18:41:20.241 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042 2022-02-11T18:41:20.632 INFO:teuthology.provision.fog.smithi042:Deploy complete! 2022-02-11T18:42:35.512 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-11T18:42:35.790 INFO:teuthology.provision.fog.smithi023:Node is ready 2022-02-11T18:42:35.848 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com 2022-02-11T18:42:35.906 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023 2022-02-11T18:42:36.249 INFO:teuthology.provision.fog.smithi023:Deploy complete! 2022-02-11T18:42:36.436 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com 2022-02-11T18:42:36.437 INFO:teuthology.lock.ops:New key found. Updating... 2022-02-11T18:42:36.457 INFO:teuthology.lock.ops:Checking smithi042.front.sepia.ceph.com 2022-02-11T18:42:36.457 INFO:teuthology.lock.ops:New key found. Updating... 2022-02-11T18:42:36.475 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server 2022-02-11T18:42:36.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2022-02-11T18:42:36.667 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64 2022-02-11T18:42:36.723 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream" 2022-02-11T18:42:36.724 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8" 2022-02-11T18:42:36.724 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2022-02-11T18:42:36.724 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2022-02-11T18:42:36.724 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8" 2022-02-11T18:42:36.725 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8" 2022-02-11T18:42:36.725 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 8" 2022-02-11T18:42:36.725 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2022-02-11T18:42:36.725 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-02-11T18:42:36.726 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/" 2022-02-11T18:42:36.726 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-02-11T18:42:36.726 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-02-11T18:42:36.726 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-02-11T18:42:36.727 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2022-02-11T18:42:36.746 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: set os type and version on server 2022-02-11T18:42:36.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2022-02-11T18:42:36.995 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2022-02-11T18:42:37.053 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2022-02-11T18:42:37.054 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="8" 2022-02-11T18:42:37.054 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2022-02-11T18:42:37.054 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2022-02-11T18:42:37.055 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="8" 2022-02-11T18:42:37.055 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el8" 2022-02-11T18:42:37.055 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 8" 2022-02-11T18:42:37.055 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2022-02-11T18:42:37.056 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-02-11T18:42:37.056 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2022-02-11T18:42:37.056 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-02-11T18:42:37.056 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-02-11T18:42:37.056 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-02-11T18:42:37.057 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2022-02-11T18:42:37.156 INFO:teuthology.dispatcher.supervisor:Running job 6676930 2022-02-11T18:42:37.157 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7cebb3f2319fd6c8340c0f7cd15a137e747fd32e/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2022-02-11_16:35:44-orch:cephadm-wip-adk-testing-2022-02-10-1637-distro-basic-smithi/6676930 --name adking-2022-02-11_16:35:44-orch:cephadm-wip-adk-testing-2022-02-10-1637-distro-basic-smithi --description orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/adking-2022-02-11_16:35:44-orch:cephadm-wip-adk-testing-2022-02-10-1637-distro-basic-smithi/6676930/orig.config.yaml 2022-02-11T18:42:37.161 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2022-02-11_16:35:44-orch:cephadm-wip-adk-testing-2022-02-10-1637-distro-basic-smithi/6676930 2022-02-11T18:42:37.162 INFO:teuthology.dispatcher.supervisor:Job PID: 16844 2022-02-11T18:42:37.162 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-02-12T01:13:05.267 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-02-12T01:13:05.969 INFO:teuthology.kill:Killing Pids: {16844} 2022-02-12T01:13:07.239 INFO:teuthology.task.internal:roles: ubuntu@smithi023.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-02-12T01:13:07.240 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-02-12T01:13:07.240 INFO:teuthology.misc:Compressing logs... 2022-02-12T01:13:07.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2022-02-12T01:13:07.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2022-02-12T01:13:07.474 INFO:teuthology.orchestra.run.smithi023.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-02-12T01:13:07.685 INFO:teuthology.orchestra.run.smithi042.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-02-12T01:13:07.723 INFO:teuthology.orchestra.run.smithi023.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-02-12T01:13:07.723 INFO:teuthology.orchestra.run.smithi023.stderr:tar: Error is not recoverable: exiting now 2022-02-12T01:13:07.755 INFO:teuthology.orchestra.run.smithi042.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-02-12T01:13:07.755 INFO:teuthology.orchestra.run.smithi042.stderr:tar: Error is not recoverable: exiting now 2022-02-12T01:13:07.757 INFO:teuthology.misc:Compressing logs... 2022-02-12T01:13:07.967 INFO:teuthology.misc:Compressing logs... 2022-02-12T01:13:15.859 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/441d86ce-8b6b-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-02-12T01:13:17.879 INFO:teuthology.orchestra.run.smithi042.stderr:gzip: /var/log/ceph/441d86ce-8b6b-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-02-12T01:13:24.639 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/441d86ce-8b6b-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-02-12T01:13:25.484 INFO:teuthology.orchestra.run.smithi042.stderr:gzip: /var/log/ceph/441d86ce-8b6b-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-02-12T01:13:35.209 INFO:teuthology.orchestra.run.smithi042.stderr:gzip: /var/log/ceph/441d86ce-8b6b-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-02-12T01:13:35.295 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/441d86ce-8b6b-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-02-12T01:13:38.972 INFO:teuthology.orchestra.run.smithi042.stderr:gzip: /var/log/ceph/441d86ce-8b6b-11ec-8c35-001a4aab830c/ceph-mon.smithi042.log: file size changed while zipping 2022-02-12T01:13:45.278 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/441d86ce-8b6b-11ec-8c35-001a4aab830c/ceph-mon.smithi023.log: file size changed while zipping 2022-02-12T01:13:46.867 INFO:teuthology.orchestra.run.smithi042.stderr:gzip: /var/log/ceph/441d86ce-8b6b-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-02-12T01:13:53.209 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/441d86ce-8b6b-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-02-12T01:13:55.129 INFO:teuthology.orchestra.run.smithi023.stderr:gzip: /var/log/ceph/441d86ce-8b6b-11ec-8c35-001a4aab830c/ceph-mgr.smithi023.tpvdyl.log: file size changed while zipping 2022-02-12T01:14:12.871 INFO:teuthology.kill:No teuthology processes running 2022-02-12T01:14:13.978 INFO:teuthology.kill:Nuking machines: ['smithi023', 'smithi042'] 2022-02-12T01:14:14.951 INFO:teuthology.kill:2022-02-12 01:14:14,950.950 INFO:teuthology.nuke:targets: 2022-02-12T01:14:14.952 INFO:teuthology.kill: smithi023.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKdMgTPWniTqk+nZ4M5dFF+2CdC5Nl1aJvply/bx9GRX7S+FMoaE5aw/w0win8ju7NBlcMaOdreTE9bjy8ZrIMzCIs1OYr6P/eEzTmJN3abA0oyOK5BXW3DTqv2VRWTwlcBecI6oLSc3AtBuYMDRQrOIezaPToxfe6UOU+Ic61YrQ9Nze7OjTJDE8Vz/gwuorOSiMdwncNYIo8crpKjNakaFRWc5MJkOrIkoJ1VxDNpQugo9koYRyyDyyakpCn0eoAuzZT3lkfpH6MK/cV2pvpKVT9qlooQjTKntiKWIceOIW/8h8rVOSf7OAJyzE+mEjL8gEKSltUlmzWoegXdmQG8OEBmcPEtl+w8LkMV/THu6KnCDOO3tvPnqe66EolAqu3UhwbPTmicAgEyv64YavxChCfcloY08ZiLcvkNtjQO1r0NQjcJh5dTbB4SqLl9YXxTyyU8HZ/VNFqTu1mgDTiyZ4HejyW5JgTDTAEymefRHnAcNutevzmuCRkFdxiQmM= 2022-02-12T01:14:14.952 INFO:teuthology.kill: smithi042.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwWgRhwiSC1MPKkJLpjQFuI5jEZ9XHU4H8CRkp2XEfPtxUIBzjanlSHx3UdMDQGWGUzoBVq71K9GNdWgaupw4LwiCjW0/IJPvsKZ4dsZimx/ZakeNxt9ZdI5J54wbuTJ/TIgKNLPj5zWIayqXueM8KC+Q5XJ3Cq/pTQj0qaYU54AdFyfT16rgIBS2BjrdvvsB68YqnP54dxRwMZEjGyzf75VTeS3Pcu8QHcmaor5pQjxcwyuRCAVDqMSieB02KSWTyNVsb0LUMEy06RbeFbjom24u7ttF6KE0FjNZBZDC6haRNlGQymYgBBPCqGMH0ykWgcFEbxneXv04ST2GV3Janq+nNgSU5/WC2m/fIsKW8ebgE+2T+EpPqqBggD/IG+Cy9pui3N+Mx8wamxPsBS8pv5OGjlu4tKJ/XMIRGKG7OqrGRi26+UBffBVstzbsb8ESxq+GKxnmcswusF8gZZUQclKhJkKenGOvP9dWd4Bo13fROJAikBsciAAhb3Cnp0e8= 2022-02-12T01:14:14.977 INFO:teuthology.kill:2022-02-12 01:14:14,976.976 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-12T01:14:14.980 INFO:teuthology.kill:2022-02-12 01:14:14,980.980 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-12T01:14:15.053 INFO:teuthology.kill:2022-02-12 01:14:15,052.052 INFO:teuthology.orchestra.console:Power off smithi023 2022-02-12T01:14:15.069 INFO:teuthology.kill:2022-02-12 01:14:15,068.068 INFO:teuthology.orchestra.console:Power off smithi042 2022-02-12T01:14:27.549 INFO:teuthology.kill:2022-02-12 01:14:27,548.548 INFO:teuthology.orchestra.console:Power off for smithi023 completed 2022-02-12T01:14:27.553 INFO:teuthology.kill:2022-02-12 01:14:27,553.553 INFO:teuthology.orchestra.console:Power off for smithi042 completed 2022-02-12T01:14:27.715 INFO:teuthology.kill:2022-02-12 01:14:27,713.713 INFO:teuthology.lock.ops:unlocked: smithi042.front.sepia.ceph.com 2022-02-12T01:14:27.720 INFO:teuthology.kill:2022-02-12 01:14:27,720.720 INFO:teuthology.lock.ops:unlocked: smithi023.front.sepia.ceph.com 2022-02-12T01:16:28.055 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-02-12T01:16:28.168 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi023 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-11_19:41:29-rados-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677537 2022-02-12T01:16:28.169 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi042 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-11_19:41:29-rados-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677537