2022-01-13T23:26:35.484 INFO:root:teuthology version: 1.1.0-6fc20113 2022-01-13T23:26:35.654 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi072.front.sepia.ceph.com' reimaging 2022-01-13T23:26:35.655 INFO:teuthology.lock.ops:Updating [ubuntu@smithi072.front.sepia.ceph.com]: reset os type and version on server 2022-01-13T23:26:35.656 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2022-01-13T23:26:35.676 INFO:teuthology.lock.ops:Node 'ubuntu@smithi072.front.sepia.ceph.com' reimaging is complete 2022-01-13T23:26:35.677 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi170.front.sepia.ceph.com' reimaging 2022-01-13T23:26:35.677 INFO:teuthology.lock.ops:Updating [ubuntu@smithi170.front.sepia.ceph.com]: reset os type and version on server 2022-01-13T23:26:35.677 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2022-01-13T23:26:35.704 INFO:teuthology.lock.ops:Node 'ubuntu@smithi170.front.sepia.ceph.com' reimaging is complete 2022-01-13T23:26:35.917 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of rhel 8.4 2022-01-13T23:26:35.931 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of rhel 8.4 2022-01-13T23:26:36.254 INFO:teuthology.orchestra.console:Power off smithi072 2022-01-13T23:26:36.272 INFO:teuthology.orchestra.console:Power off smithi170 2022-01-13T23:26:44.641 INFO:teuthology.orchestra.console:Power off for smithi072 completed 2022-01-13T23:26:44.646 INFO:teuthology.orchestra.console:Power off for smithi170 completed 2022-01-13T23:26:44.743 INFO:teuthology.orchestra.console:Power on smithi072 2022-01-13T23:26:44.753 INFO:teuthology.orchestra.console:Power on smithi170 2022-01-13T23:26:53.110 INFO:teuthology.orchestra.console:Power on for smithi072 completed 2022-01-13T23:26:53.152 INFO:teuthology.orchestra.console:Power on for smithi170 completed 2022-01-13T23:26:53.212 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2022-01-13T23:26:53.253 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish 2022-01-13T23:31:42.883 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-13T23:31:43.140 INFO:teuthology.provision.fog.smithi170:Node is ready 2022-01-13T23:31:43.156 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com 2022-01-13T23:31:43.211 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170 2022-01-13T23:31:43.531 INFO:teuthology.provision.fog.smithi170:Deploy complete! 2022-01-13T23:32:09.978 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-13T23:32:10.254 INFO:teuthology.provision.fog.smithi072:Node is ready 2022-01-13T23:32:10.269 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com 2022-01-13T23:32:10.325 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072 2022-01-13T23:32:10.670 INFO:teuthology.provision.fog.smithi072:Deploy complete! 2022-01-13T23:32:10.857 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com 2022-01-13T23:32:10.858 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-13T23:32:10.881 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com 2022-01-13T23:32:10.881 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-13T23:32:10.899 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server 2022-01-13T23:32:10.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2022-01-13T23:32:11.118 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2022-01-13T23:32:11.171 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux" 2022-01-13T23:32:11.172 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.4 (Ootpa)" 2022-01-13T23:32:11.172 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel" 2022-01-13T23:32:11.172 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora" 2022-01-13T23:32:11.173 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.4" 2022-01-13T23:32:11.173 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2022-01-13T23:32:11.173 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-13T23:32:11.173 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2022-01-13T23:32:11.174 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-13T23:32:11.174 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/" 2022-01-13T23:32:11.174 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-13T23:32:11.174 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-13T23:32:11.175 INFO:teuthology.orchestra.run.smithi072.stdout: 2022-01-13T23:32:11.175 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-13T23:32:11.175 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-13T23:32:11.175 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-13T23:32:11.175 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-13T23:32:11.177 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2022-01-13T23:32:11.195 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server 2022-01-13T23:32:11.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2022-01-13T23:32:11.433 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2022-01-13T23:32:11.488 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Red Hat Enterprise Linux" 2022-01-13T23:32:11.488 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8.4 (Ootpa)" 2022-01-13T23:32:11.489 INFO:teuthology.orchestra.run.smithi170.stdout:ID="rhel" 2022-01-13T23:32:11.489 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="fedora" 2022-01-13T23:32:11.489 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8.4" 2022-01-13T23:32:11.489 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8" 2022-01-13T23:32:11.490 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-13T23:32:11.490 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2022-01-13T23:32:11.490 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-13T23:32:11.490 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.redhat.com/" 2022-01-13T23:32:11.491 INFO:teuthology.orchestra.run.smithi170.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-13T23:32:11.491 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-13T23:32:11.491 INFO:teuthology.orchestra.run.smithi170.stdout: 2022-01-13T23:32:11.491 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-13T23:32:11.492 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-13T23:32:11.492 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-13T23:32:11.492 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-13T23:32:11.493 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2022-01-13T23:32:11.588 INFO:teuthology.dispatcher.supervisor:Running job 6614681 2022-01-13T23:32:11.589 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6fc2011361437a9dfe4e45b50de224392eed8abc/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-13_18:06:52-rados-wip-yuri3-testing-2022-01-13-0809-distro-default-smithi/6614681 --name yuriw-2022-01-13_18:06:52-rados-wip-yuri3-testing-2022-01-13-0809-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/yuriw-2022-01-13_18:06:52-rados-wip-yuri3-testing-2022-01-13-0809-distro-default-smithi/6614681/orig.config.yaml 2022-01-13T23:32:11.592 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-13_18:06:52-rados-wip-yuri3-testing-2022-01-13-0809-distro-default-smithi/6614681 2022-01-13T23:32:11.592 INFO:teuthology.dispatcher.supervisor:Job PID: 2416 2022-01-13T23:32:11.593 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-14T11:33:06.199 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-01-14T11:33:06.421 INFO:teuthology.kill:Killing Pids: {2416} 2022-01-14T11:33:07.686 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-14T11:33:07.687 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-14T11:33:07.687 INFO:teuthology.misc:Compressing logs... 2022-01-14T11:33:07.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2022-01-14T11:33:07.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2022-01-14T11:33:07.935 INFO:teuthology.orchestra.run.smithi072.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-14T11:33:08.168 INFO:teuthology.orchestra.run.smithi170.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-14T11:33:08.244 INFO:teuthology.orchestra.run.smithi072.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-14T11:33:08.245 INFO:teuthology.orchestra.run.smithi072.stderr:tar: Error is not recoverable: exiting now 2022-01-14T11:33:08.284 INFO:teuthology.orchestra.run.smithi170.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-14T11:33:08.285 INFO:teuthology.orchestra.run.smithi170.stderr:tar: Error is not recoverable: exiting now 2022-01-14T11:33:08.286 INFO:teuthology.misc:Compressing logs... 2022-01-14T11:33:08.516 INFO:teuthology.misc:Compressing logs... 2022-01-14T11:33:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/83ce1e30-74ca-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-14T11:33:25.188 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/83ce1e30-74ca-11ec-8c32-001a4aab830c/ceph-mgr.smithi072.edcmri.log: file size changed while zipping 2022-01-14T11:33:25.354 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /var/log/ceph/83ce1e30-74ca-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-14T11:33:31.777 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /var/log/ceph/83ce1e30-74ca-11ec-8c32-001a4aab830c/ceph-mon.smithi170.log: file size changed while zipping 2022-01-14T11:33:42.172 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/83ce1e30-74ca-11ec-8c32-001a4aab830c/ceph-mon.smithi072.log: file size changed while zipping 2022-01-14T11:33:44.892 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /var/log/ceph/83ce1e30-74ca-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-14T11:33:55.605 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/83ce1e30-74ca-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-14T11:34:01.434 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /var/log/ceph/83ce1e30-74ca-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-14T11:34:10.485 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/83ce1e30-74ca-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-14T11:34:15.203 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /var/log/ceph/83ce1e30-74ca-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-14T11:34:28.424 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/83ce1e30-74ca-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-14T11:34:59.715 INFO:teuthology.kill:No teuthology processes running 2022-01-14T11:35:00.959 INFO:teuthology.kill:Nuking machines: ['smithi072', 'smithi170'] 2022-01-14T11:35:01.961 INFO:teuthology.kill:2022-01-14 11:35:01,960.960 INFO:teuthology.nuke:targets: 2022-01-14T11:35:01.961 INFO:teuthology.kill: smithi072.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDi93Aqug6GYGo8gbVf8VLkVloWQzSE9DnI4fTgOXyBtA8Eyq2rFjA1zz6vrWPObxgiPWp8bBBGBFBDVAIHUgk3lS5VYHfZNhL/Lt2S0nrW7yfFxNwhY1F/OH6ckD8MWzBjBhr8vjYK6+0OHJwVf/d8L7c6bFizwwKP+qS4jt14+wrOCquocZ3oTslnPdVkUpY+qwqcj+HdNukeksxDelPW/e9fixfu6TdYg7yi4sOTZpA1QjbpBW/Sjb0pntBodJK9h7CL+FJLSIDsVO8QUxXlF0ZjM/mqtjrAvSYnIy4ALm7/ay+xB4FAplLaaWVHvRL0k8IvBbl87zkNQqc6oHZQVrf2PtTxT/pCusVeel+s2QKTjlmg9UTaEGg7l2E7tW7LqD8RiC5oPxFaD26sxWWR5ZbuRUhTlOiV++u3ICde7a2caTsGsCn+3vCIyBcUtGsAik60PWdynZ3Z14NjPo9jT7+yq7PiGvvCyQ9mCGT+QB6MW7ZmqHVAlD4klIKM+ZM= 2022-01-14T11:35:01.962 INFO:teuthology.kill: smithi170.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxaSkQDwJFJqEACMEVa3HEvWOE3urWJdzqZpIg2be186fmaxvkLLDDi9I+1NHVs327SpCNdH8edka5J/KOGQDYTGeEejG1Mgz7Z1Km7ZP2OgqWRxyfX9xcCRqnAlxFTBpylESAmbhQSf1FjuJeI27CyDqi0mOoXgAaRUxidTNRWGvrItYXYQfJGZ2pJeJz3hAnfr0B0iQVedPB28ysFJE2dYHEcr1Kj+WdbYSe+6YkaL31yuLV4BD8kZB4mHvBfYTQcIVeQJCfUtlEeYL5YNsa44Cy7PL+j2uttsOKmDgjum9+kDhRaX2liSTuL9kZa1dws8Ndf0CP8u+WaqzCuBK9LhWAP7LeovmwgbUL8QtUp9p1aXAe6oE2tbl60R1eAOSmghjP7c+SC/6KDU9t4ojo5N3bxBhsCcycnFzDmE393EPTD/8OMRHwqe5dVmNok1Wm4LVuSKXbTeRNLoIX7zo3XmZYTkOdd7Lo2751KdF7I7DHKj99GoAs1zE3JrcG88U= 2022-01-14T11:35:01.987 INFO:teuthology.kill:2022-01-14 11:35:01,987.987 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-14T11:35:01.991 INFO:teuthology.kill:2022-01-14 11:35:01,990.990 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-14T11:35:02.071 INFO:teuthology.kill:2022-01-14 11:35:02,071.071 INFO:teuthology.orchestra.console:Power off smithi072 2022-01-14T11:35:02.085 INFO:teuthology.kill:2022-01-14 11:35:02,085.085 INFO:teuthology.orchestra.console:Power off smithi170 2022-01-14T11:35:10.465 INFO:teuthology.kill:2022-01-14 11:35:10,465.465 INFO:teuthology.orchestra.console:Power off for smithi170 completed 2022-01-14T11:35:10.611 INFO:teuthology.kill:2022-01-14 11:35:10,611.611 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com 2022-01-14T11:35:14.571 INFO:teuthology.kill:2022-01-14 11:35:14,571.571 INFO:teuthology.orchestra.console:Power off for smithi072 completed 2022-01-14T11:35:14.716 INFO:teuthology.kill:2022-01-14 11:35:14,715.715 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com 2022-01-14T11:37:15.040 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-14T11:37:15.131 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi072 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-13_05:07:02-rgw-pacific-distro-default-smithi/6612088 2022-01-14T11:37:15.132 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi170 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-13_05:07:02-rgw-pacific-distro-default-smithi/6612088