2022-01-17T20:17:52.356 INFO:root:teuthology version: 1.1.0-3ff86a5d 2022-01-17T20:17:52.506 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi005.front.sepia.ceph.com' reimaging 2022-01-17T20:17:52.507 INFO:teuthology.lock.ops:Updating [ubuntu@smithi005.front.sepia.ceph.com]: reset os type and version on server 2022-01-17T20:17:52.508 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2022-01-17T20:17:52.528 INFO:teuthology.lock.ops:Node 'ubuntu@smithi005.front.sepia.ceph.com' reimaging is complete 2022-01-17T20:17:52.528 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi029.front.sepia.ceph.com' reimaging 2022-01-17T20:17:52.529 INFO:teuthology.lock.ops:Updating [ubuntu@smithi029.front.sepia.ceph.com]: reset os type and version on server 2022-01-17T20:17:52.529 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2022-01-17T20:17:52.549 INFO:teuthology.lock.ops:Node 'ubuntu@smithi029.front.sepia.ceph.com' reimaging is complete 2022-01-17T20:17:52.803 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of rhel 8.4 2022-01-17T20:17:52.816 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of rhel 8.4 2022-01-17T20:17:53.610 INFO:teuthology.orchestra.console:Power off smithi029 2022-01-17T20:17:53.754 INFO:teuthology.orchestra.console:Power off for smithi029 completed 2022-01-17T20:17:53.810 INFO:teuthology.orchestra.console:Power off smithi005 2022-01-17T20:17:53.856 INFO:teuthology.orchestra.console:Power on smithi029 2022-01-17T20:18:02.195 INFO:teuthology.orchestra.console:Power off for smithi005 completed 2022-01-17T20:18:02.237 INFO:teuthology.orchestra.console:Power on for smithi029 completed 2022-01-17T20:18:02.297 INFO:teuthology.orchestra.console:Power on smithi005 2022-01-17T20:18:02.338 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2022-01-17T20:18:10.662 INFO:teuthology.orchestra.console:Power on for smithi005 completed 2022-01-17T20:18:10.763 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish 2022-01-17T20:21:56.531 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-17T20:22:01.451 INFO:teuthology.provision.fog.smithi005:Node is ready 2022-01-17T20:22:01.471 INFO:teuthology.orchestra.run.smithi005.stdout:smithi204 2022-01-17T20:22:01.529 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204 2022-01-17T20:22:01.903 INFO:teuthology.provision.fog.smithi005:Deploy complete! 2022-01-17T20:23:26.814 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-17T20:23:27.099 INFO:teuthology.provision.fog.smithi029:Node is ready 2022-01-17T20:23:27.115 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2022-01-17T20:23:27.171 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2022-01-17T20:23:27.528 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2022-01-17T20:23:27.679 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com 2022-01-17T20:23:27.680 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-17T20:23:27.705 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2022-01-17T20:23:27.705 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-17T20:23:27.723 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server 2022-01-17T20:23:27.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2022-01-17T20:23:27.917 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2022-01-17T20:23:27.974 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Red Hat Enterprise Linux" 2022-01-17T20:23:27.974 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8.4 (Ootpa)" 2022-01-17T20:23:27.974 INFO:teuthology.orchestra.run.smithi005.stdout:ID="rhel" 2022-01-17T20:23:27.974 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="fedora" 2022-01-17T20:23:27.975 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8.4" 2022-01-17T20:23:27.975 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2022-01-17T20:23:27.975 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-17T20:23:27.975 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2022-01-17T20:23:27.976 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-17T20:23:27.976 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.redhat.com/" 2022-01-17T20:23:27.976 INFO:teuthology.orchestra.run.smithi005.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-17T20:23:27.976 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-17T20:23:27.976 INFO:teuthology.orchestra.run.smithi005.stdout: 2022-01-17T20:23:27.976 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-17T20:23:27.977 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-17T20:23:27.977 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-17T20:23:27.977 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-17T20:23:27.978 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2022-01-17T20:23:27.996 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2022-01-17T20:23:27.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2022-01-17T20:23:28.187 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2022-01-17T20:23:28.244 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Red Hat Enterprise Linux" 2022-01-17T20:23:28.244 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8.4 (Ootpa)" 2022-01-17T20:23:28.245 INFO:teuthology.orchestra.run.smithi029.stdout:ID="rhel" 2022-01-17T20:23:28.245 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="fedora" 2022-01-17T20:23:28.245 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8.4" 2022-01-17T20:23:28.245 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2022-01-17T20:23:28.245 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-17T20:23:28.246 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2022-01-17T20:23:28.246 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-17T20:23:28.246 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.redhat.com/" 2022-01-17T20:23:28.246 INFO:teuthology.orchestra.run.smithi029.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-17T20:23:28.247 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-17T20:23:28.247 INFO:teuthology.orchestra.run.smithi029.stdout: 2022-01-17T20:23:28.247 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-17T20:23:28.247 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-17T20:23:28.247 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-17T20:23:28.248 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-17T20:23:28.248 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2022-01-17T20:23:28.334 INFO:teuthology.dispatcher.supervisor:Running job 6622614 2022-01-17T20:23:28.334 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2022-01-17_20:16:43-rados:cephadm-wip-guits-testing-2022-01-17-1612-distro-default-smithi/6622614 --name gabrioux-2022-01-17_20:16:43-rados:cephadm-wip-guits-testing-2022-01-17-1612-distro-default-smithi --description rados:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} -- /home/teuthworker/archive/gabrioux-2022-01-17_20:16:43-rados:cephadm-wip-guits-testing-2022-01-17-1612-distro-default-smithi/6622614/orig.config.yaml 2022-01-17T20:23:28.337 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2022-01-17_20:16:43-rados:cephadm-wip-guits-testing-2022-01-17-1612-distro-default-smithi/6622614 2022-01-17T20:23:28.338 INFO:teuthology.dispatcher.supervisor:Job PID: 6709 2022-01-17T20:23:28.338 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-18T02:53:39.110 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-18T02:53:39.296 INFO:teuthology.kill:Killing Pids: {6709} 2022-01-18T02:53:40.341 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-18T02:53:40.342 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-18T02:53:40.342 INFO:teuthology.misc:Compressing logs... 2022-01-18T02:53:40.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2022-01-18T02:53:40.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2022-01-18T02:53:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-18T02:53:40.819 INFO:teuthology.orchestra.run.smithi029.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-18T02:53:40.853 INFO:teuthology.orchestra.run.smithi005.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-18T02:53:40.854 INFO:teuthology.orchestra.run.smithi005.stderr:tar: Error is not recoverable: exiting now 2022-01-18T02:53:40.882 INFO:teuthology.orchestra.run.smithi029.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-18T02:53:40.882 INFO:teuthology.orchestra.run.smithi029.stderr:tar: Error is not recoverable: exiting now 2022-01-18T02:53:40.884 INFO:teuthology.misc:Compressing logs... 2022-01-18T02:53:41.095 INFO:teuthology.misc:Compressing logs... 2022-01-18T02:53:48.800 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/ed100e1e-77d4-11ec-8c34-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-18T02:53:51.309 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/ed100e1e-77d4-11ec-8c34-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-18T02:53:54.971 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/ed100e1e-77d4-11ec-8c34-001a4aab830c/ceph-mon.smithi029.log: file size changed while zipping 2022-01-18T02:53:56.530 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/ed100e1e-77d4-11ec-8c34-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-18T02:54:02.413 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/ed100e1e-77d4-11ec-8c34-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-18T02:54:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/ed100e1e-77d4-11ec-8c34-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-18T02:54:12.487 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/ed100e1e-77d4-11ec-8c34-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-18T02:54:15.349 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/ed100e1e-77d4-11ec-8c34-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-18T02:54:20.325 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/ed100e1e-77d4-11ec-8c34-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-18T02:54:25.043 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/ed100e1e-77d4-11ec-8c34-001a4aab830c/ceph-mon.smithi005.log: file size changed while zipping 2022-01-18T02:54:26.906 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/ed100e1e-77d4-11ec-8c34-001a4aab830c/ceph-mgr.smithi005.icxlhn.log: file size changed while zipping 2022-01-18T02:54:44.455 INFO:teuthology.kill:No teuthology processes running 2022-01-18T02:54:45.461 INFO:teuthology.kill:Nuking machines: ['smithi005', 'smithi029'] 2022-01-18T02:54:46.348 INFO:teuthology.kill:2022-01-18 02:54:46,347.347 INFO:teuthology.nuke:targets: 2022-01-18T02:54:46.349 INFO:teuthology.kill: smithi005.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW3s12JzRVmCuw1RD9coOcLpK+xhlBzXwLU5/ZIAXO/Qpwa50bWEFSPrDe8RjUDwiMo4ToUpYbgANtTDAmy0Xzz2RGJN3Ilz6WzZL7CG81jeWFjrlVfDasRGp/n62AKUAKvR7foXoR7It7SmBaDX46ehyDIC8SUsthGYVMmX9LFOPseJrf0rGaXLIbK2Swyjm4JgdAtfUb+LiBQk2fNOBLnRvzFZYnAjWQt69y5sadhnB691Twm5F+PfBwlwXBfFk9QjcMs6BdQ0+gH5Yd+XM1jo4W6ffaEJf8BFRlP+YtIlLe4Pbcf3HP+gM7VE+b+rSv28IlIHl7+DgB6NDhgV1Sv9coZjwMjKD1llFhHCMTmBWDY6RgsQi61F3LpUcAxp5kt3uKOPcESpQNr1kD57pYrbgxrcAAtjf19xV//0oSXa8+/HE/sOFveNrDgRnwNepgxFmVbEPcLo5tr+jKQwjuwZzdxpvjYwEUPdnKsxNQjHbnBr61Tw8yeihHgvrbQA0= 2022-01-18T02:54:46.349 INFO:teuthology.kill: smithi029.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+6IZ5uPVTwekhW+z91azpQz1gHI+tvjHiOpDy+Ixo3sA7CJQibrH4qPhw2iOuQnmwQIbuJkSL5aHU1mTV6eNDw2x+CUmraiEpi+OgPZuOo5xUhewO6G2Jwb0bm2sz/KQo83xWUFNoTAa41uc4/94vaQIVqONaFb8Aip2ciO05S3TcE4xQ+Mkk2Z7nMFMGM35VED8Gw6uqqlmPPzeZm2H/9oL5H5C1+/ZOo5uL/IPFMCErU4+aaD8DA0+PcksDDP+OXTPY6oSGnsAic9ZRwCZWj+SZVD92ICcm6UcCnqxqfbNlOGX4dYLi3X3vRDFLK6v8X1A6tQ+07BOjuT3DHiby09+B/5I1VkZRTZTNONR3FJ5TLP7/VKDgHHLNAqVfnUDbNnyVJJoq64IWW1vBqIrG+ZR+Y2/ogiJuLxKDU+ry8/htfg4o4a45OUkxh62ovgtNg50f5EP9RmnXqEIzRnQCcEST/V6QqFg0KBs5dUlAfER2q/lCM7XHVXz9RVA4q8c= 2022-01-18T02:54:46.374 INFO:teuthology.kill:2022-01-18 02:54:46,374.374 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-18T02:54:46.377 INFO:teuthology.kill:2022-01-18 02:54:46,377.377 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-18T02:54:46.449 INFO:teuthology.kill:2022-01-18 02:54:46,449.449 INFO:teuthology.orchestra.console:Power off smithi005 2022-01-18T02:54:46.463 INFO:teuthology.kill:2022-01-18 02:54:46,463.463 INFO:teuthology.orchestra.console:Power off smithi029 2022-01-18T02:54:54.824 INFO:teuthology.kill:2022-01-18 02:54:54,823.823 INFO:teuthology.orchestra.console:Power off for smithi005 completed 2022-01-18T02:54:54.829 INFO:teuthology.kill:2022-01-18 02:54:54,829.829 INFO:teuthology.orchestra.console:Power off for smithi029 completed 2022-01-18T02:54:54.978 INFO:teuthology.kill:2022-01-18 02:54:54,977.977 INFO:teuthology.lock.ops:unlocked: smithi005.front.sepia.ceph.com 2022-01-18T02:54:54.982 INFO:teuthology.kill:2022-01-18 02:54:54,982.982 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com 2022-01-18T02:56:55.180 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15