2022-01-10T12:59:02.368 INFO:root:teuthology version: 1.1.0-00e09f05 2022-01-10T12:59:02.513 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi140.front.sepia.ceph.com' reimaging 2022-01-10T12:59:02.514 INFO:teuthology.lock.ops:Updating [ubuntu@smithi140.front.sepia.ceph.com]: reset os type and version on server 2022-01-10T12:59:02.514 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2022-01-10T12:59:02.541 INFO:teuthology.lock.ops:Node 'ubuntu@smithi140.front.sepia.ceph.com' reimaging is complete 2022-01-10T12:59:02.541 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging 2022-01-10T12:59:02.542 INFO:teuthology.lock.ops:Updating [ubuntu@smithi163.front.sepia.ceph.com]: reset os type and version on server 2022-01-10T12:59:02.542 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2022-01-10T12:59:02.561 INFO:teuthology.lock.ops:Node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging is complete 2022-01-10T12:59:02.755 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.4 2022-01-10T12:59:02.773 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of rhel 8.4 2022-01-10T12:59:03.081 INFO:teuthology.orchestra.console:Power off smithi140 2022-01-10T12:59:03.121 INFO:teuthology.orchestra.console:Power off smithi163 2022-01-10T12:59:11.484 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2022-01-10T12:59:11.586 INFO:teuthology.orchestra.console:Power on smithi163 2022-01-10T12:59:15.573 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2022-01-10T12:59:15.675 INFO:teuthology.orchestra.console:Power on smithi140 2022-01-10T12:59:19.945 INFO:teuthology.orchestra.console:Power on for smithi163 completed 2022-01-10T12:59:20.046 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2022-01-10T12:59:24.042 INFO:teuthology.orchestra.console:Power on for smithi140 completed 2022-01-10T12:59:24.144 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2022-01-10T13:04:25.717 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-10T13:04:25.933 INFO:teuthology.provision.fog.smithi140:Node is ready 2022-01-10T13:04:25.948 INFO:teuthology.orchestra.run.smithi140.stdout:smithi140.front.sepia.ceph.com 2022-01-10T13:04:26.003 INFO:teuthology.orchestra.run.smithi140.stdout:172.21.15.140 smithi140.front.sepia.ceph.com smithi140 2022-01-10T13:04:26.330 INFO:teuthology.provision.fog.smithi140:Deploy complete! 2022-01-10T13:04:39.727 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-10T13:04:39.946 INFO:teuthology.provision.fog.smithi163:Node is ready 2022-01-10T13:04:39.962 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2022-01-10T13:04:40.018 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2022-01-10T13:04:40.346 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2022-01-10T13:04:40.491 INFO:teuthology.lock.ops:Checking smithi140.front.sepia.ceph.com 2022-01-10T13:04:40.492 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-10T13:04:40.511 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2022-01-10T13:04:40.511 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-10T13:04:40.528 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: set os type and version on server 2022-01-10T13:04:40.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com' 2022-01-10T13:04:40.760 INFO:teuthology.orchestra.run.smithi140.stdout:x86_64 2022-01-10T13:04:40.816 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="Red Hat Enterprise Linux" 2022-01-10T13:04:40.817 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="8.4 (Ootpa)" 2022-01-10T13:04:40.817 INFO:teuthology.orchestra.run.smithi140.stdout:ID="rhel" 2022-01-10T13:04:40.817 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE="fedora" 2022-01-10T13:04:40.817 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="8.4" 2022-01-10T13:04:40.818 INFO:teuthology.orchestra.run.smithi140.stdout:PLATFORM_ID="platform:el8" 2022-01-10T13:04:40.818 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-10T13:04:40.818 INFO:teuthology.orchestra.run.smithi140.stdout:ANSI_COLOR="0;31" 2022-01-10T13:04:40.818 INFO:teuthology.orchestra.run.smithi140.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-10T13:04:40.819 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://www.redhat.com/" 2022-01-10T13:04:40.819 INFO:teuthology.orchestra.run.smithi140.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-10T13:04:40.819 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-10T13:04:40.819 INFO:teuthology.orchestra.run.smithi140.stdout: 2022-01-10T13:04:40.820 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-10T13:04:40.820 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-10T13:04:40.820 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-10T13:04:40.820 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-10T13:04:40.822 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2022-01-10T13:04:40.839 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2022-01-10T13:04:40.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2022-01-10T13:04:41.022 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2022-01-10T13:04:41.077 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Red Hat Enterprise Linux" 2022-01-10T13:04:41.077 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8.4 (Ootpa)" 2022-01-10T13:04:41.077 INFO:teuthology.orchestra.run.smithi163.stdout:ID="rhel" 2022-01-10T13:04:41.078 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="fedora" 2022-01-10T13:04:41.078 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8.4" 2022-01-10T13:04:41.078 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2022-01-10T13:04:41.078 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-10T13:04:41.079 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2022-01-10T13:04:41.079 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-10T13:04:41.079 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.redhat.com/" 2022-01-10T13:04:41.079 INFO:teuthology.orchestra.run.smithi163.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-10T13:04:41.079 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-10T13:04:41.080 INFO:teuthology.orchestra.run.smithi163.stdout: 2022-01-10T13:04:41.080 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-10T13:04:41.080 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-10T13:04:41.080 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-10T13:04:41.081 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-10T13:04:41.081 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2022-01-10T13:04:41.163 INFO:teuthology.dispatcher.supervisor:Running job 6605893 2022-01-10T13:04:41.163 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_00e09f05e9fb2ab7c7f497f5e446613531743ae2/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2022-01-10_12:36:11-rados:cephadm-wip-guits-testing-2022-01-10-0956-distro-default-smithi/6605893 --name gabrioux-2022-01-10_12:36:11-rados:cephadm-wip-guits-testing-2022-01-10-0956-distro-default-smithi --description rados:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/gabrioux-2022-01-10_12:36:11-rados:cephadm-wip-guits-testing-2022-01-10-0956-distro-default-smithi/6605893/orig.config.yaml 2022-01-10T13:04:41.166 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2022-01-10_12:36:11-rados:cephadm-wip-guits-testing-2022-01-10-0956-distro-default-smithi/6605893 2022-01-10T13:04:41.167 INFO:teuthology.dispatcher.supervisor:Job PID: 22633 2022-01-10T13:04:41.167 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-11T01:05:01.974 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-01-11T01:05:02.167 INFO:teuthology.kill:Killing Pids: {22633} 2022-01-11T01:05:03.335 INFO:teuthology.task.internal:roles: ubuntu@smithi140.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-11T01:05:03.336 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-11T01:05:03.336 INFO:teuthology.misc:Compressing logs... 2022-01-11T01:05:03.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com' 2022-01-11T01:05:03.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2022-01-11T01:05:03.569 INFO:teuthology.orchestra.run.smithi140.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-11T01:05:03.805 INFO:teuthology.orchestra.run.smithi163.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-11T01:05:03.837 INFO:teuthology.orchestra.run.smithi140.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-11T01:05:03.837 INFO:teuthology.orchestra.run.smithi140.stderr:tar: Error is not recoverable: exiting now 2022-01-11T01:05:03.871 INFO:teuthology.orchestra.run.smithi163.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-11T01:05:03.872 INFO:teuthology.orchestra.run.smithi163.stderr:tar: Error is not recoverable: exiting now 2022-01-11T01:05:03.873 INFO:teuthology.misc:Compressing logs... 2022-01-11T01:05:04.101 INFO:teuthology.misc:Compressing logs... 2022-01-11T01:05:21.097 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/55e865b2-7217-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-11T01:05:21.185 INFO:teuthology.orchestra.run.smithi140.stderr:gzip: /var/log/ceph/55e865b2-7217-11ec-8c32-001a4aab830c/ceph-mon.smithi140.log: file size changed while zipping 2022-01-11T01:05:27.582 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/55e865b2-7217-11ec-8c32-001a4aab830c/ceph-mon.smithi163.log: file size changed while zipping 2022-01-11T01:05:27.702 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/55e865b2-7217-11ec-8c32-001a4aab830c/ceph-mgr.smithi163.swlual.log: file size changed while zipping 2022-01-11T01:05:34.597 INFO:teuthology.orchestra.run.smithi140.stderr:gzip: /var/log/ceph/55e865b2-7217-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-11T01:05:40.891 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/55e865b2-7217-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-11T01:05:48.032 INFO:teuthology.orchestra.run.smithi140.stderr:gzip: /var/log/ceph/55e865b2-7217-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-11T01:05:57.649 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/55e865b2-7217-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-11T01:06:02.938 INFO:teuthology.orchestra.run.smithi140.stderr:gzip: /var/log/ceph/55e865b2-7217-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-11T01:06:11.418 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/55e865b2-7217-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-11T01:06:20.821 INFO:teuthology.orchestra.run.smithi140.stderr:gzip: /var/log/ceph/55e865b2-7217-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-11T01:06:24.018 INFO:teuthology.orchestra.run.smithi140.stderr:gzip: /var/log/ceph/55e865b2-7217-11ec-8c32-001a4aab830c/ceph-mgr.smithi140.kebxyo.log: file size changed while zipping 2022-01-11T01:06:55.256 INFO:teuthology.kill:No teuthology processes running 2022-01-11T01:06:56.440 INFO:teuthology.kill:Nuking machines: ['smithi140', 'smithi163'] 2022-01-11T01:06:57.415 INFO:teuthology.kill:2022-01-11 01:06:57,415.415 INFO:teuthology.nuke:targets: 2022-01-11T01:06:57.416 INFO:teuthology.kill: smithi140.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtagBfqq3Zri7e/YmmxZbhZjoUk0xp5tFLxpmuERdUtAtaloydcn6bPt8DAGZhy006lztoHM3TB+s6L69y1DkQtwAVQY+TFJpEojhupmplJuLqoKzK7iecjwRhmZ5ffkeQoT9yUFecrkO98YpqNxB7dl6KAbOIrEiWK5/hrJdi+QDB5+bjngKnvNFLiervSW5z04MSn6xDMQKmzikNPLz90e0+ORC/VaRNgMhnHQmllXDDDRNyiRplDHPL9yCzQhWdzXSskbbICs+TzcigYhu3JMVs9SdKg+IyCyPTlGCLNzf85wkj2g7i9MfsGGKAQLGefXBZVkFjpAlmru9ZElR0tYioFKROvkMoXVEZkseSSiAfm9u5XENXpsyfJ3lyufounO49bi0XhjaIdvhFWIts3LVrFL2stovFdRSU0E9BKi/MSa+zz4W9VtuUW4aCA7hdKqKleADo9QaBKfcnVkA7yloXuvmyTTvXKrXG9dgWz6NQ6fjvHFu123Rr9kDIYfs= 2022-01-11T01:06:57.417 INFO:teuthology.kill: smithi163.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfnfH2Xxi3K/L6yqeqVeXvzowaa8tI0k2lHBBKzIs30eyaKJaKBlEyv5n/HJk5oZjvUoISD2QBwXMyJ3Suo0f8Yzd2KpSaOb3OvOTAWLtXGbpK4dbxAyn/2afBryyA4+2kA9AqJzUxerp5jiIed2oMi4eFhZNot1k5Lg29Ms6Gnowoq7mt6/yegVeHKb7gpYnGhtL6Vb8DGvNGhmKGeLR18jiDFJfxQsowa8odSgSQa2ulF5y0SlF7wgm/r0c0bZnxKSnL0jTQ16ah0qG4NF7XXICLqTtmQHDfBDe8EuDiHk7sjbEJHRaBhb+lXIPipnguqH39RPrj+HwwIJfWEmDGwRTBJcxL76EC4Rkz6TTmEVvtg4ZD5eaxP1+p4Xjen0yyvqjiU8ckJZwDuz6PuZ+GZSLwSBm8zZoOSK4QrnS7cC9oPDR/cyrgG3Wg+vgNg1z0tmNl+Tj2VufspKHEy/SQ2TzMyW8IOUm/e76HBCV9tniQjFdogVXXiCx5oNFt0H0= 2022-01-11T01:06:57.443 INFO:teuthology.kill:2022-01-11 01:06:57,442.442 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-11T01:06:57.446 INFO:teuthology.kill:2022-01-11 01:06:57,446.446 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-11T01:06:57.521 INFO:teuthology.kill:2022-01-11 01:06:57,521.521 INFO:teuthology.orchestra.console:Power off smithi163 2022-01-11T01:06:57.534 INFO:teuthology.kill:2022-01-11 01:06:57,534.534 INFO:teuthology.orchestra.console:Power off smithi140 2022-01-11T01:07:05.893 INFO:teuthology.kill:2022-01-11 01:07:05,893.893 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2022-01-11T01:07:06.039 INFO:teuthology.kill:2022-01-11 01:07:06,039.039 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com 2022-01-11T01:07:10.011 INFO:teuthology.kill:2022-01-11 01:07:10,011.011 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2022-01-11T01:07:10.155 INFO:teuthology.kill:2022-01-11 01:07:10,155.155 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2022-01-11T01:09:10.463 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-11T01:09:10.559 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi140 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-10_21:22:44-rados-wip-yuri4-testing-2022-01-10-1127-distro-default-smithi/6606446 2022-01-11T01:09:10.560 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi163 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-10_21:22:44-rados-wip-yuri4-testing-2022-01-10-1127-distro-default-smithi/6606446