2022-01-29T14:10:28.418 INFO:root:teuthology version: 1.1.0-7c0cb867 2022-01-29T14:10:28.549 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi140.front.sepia.ceph.com' reimaging 2022-01-29T14:10:28.551 INFO:teuthology.lock.ops:Updating [ubuntu@smithi140.front.sepia.ceph.com]: reset os type and version on server 2022-01-29T14:10:28.551 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2022-01-29T14:10:28.569 INFO:teuthology.lock.ops:Node 'ubuntu@smithi140.front.sepia.ceph.com' reimaging is complete 2022-01-29T14:10:28.569 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi165.front.sepia.ceph.com' reimaging 2022-01-29T14:10:28.569 INFO:teuthology.lock.ops:Updating [ubuntu@smithi165.front.sepia.ceph.com]: reset os type and version on server 2022-01-29T14:10:28.570 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2022-01-29T14:10:28.591 INFO:teuthology.lock.ops:Node 'ubuntu@smithi165.front.sepia.ceph.com' reimaging is complete 2022-01-29T14:10:28.786 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.4 2022-01-29T14:10:28.864 INFO:teuthology.provision.fog.smithi165:Scheduling deploy of rhel 8.4 2022-01-29T14:10:29.266 INFO:teuthology.orchestra.console:Power off smithi165 2022-01-29T14:10:29.282 INFO:teuthology.orchestra.console:Power off smithi140 2022-01-29T14:10:41.753 INFO:teuthology.orchestra.console:Power off for smithi165 completed 2022-01-29T14:10:41.758 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2022-01-29T14:10:41.854 INFO:teuthology.orchestra.console:Power on smithi165 2022-01-29T14:10:41.862 INFO:teuthology.orchestra.console:Power on smithi140 2022-01-29T14:10:46.107 INFO:teuthology.orchestra.console:Power on for smithi165 completed 2022-01-29T14:10:46.208 INFO:teuthology.provision.fog.smithi165:Waiting for deploy to finish 2022-01-29T14:10:50.226 INFO:teuthology.orchestra.console:Power on for smithi140 completed 2022-01-29T14:10:50.327 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2022-01-29T14:15:37.107 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-29T14:15:37.348 INFO:teuthology.provision.fog.smithi140:Node is ready 2022-01-29T14:15:37.365 INFO:teuthology.orchestra.run.smithi140.stdout:smithi140.front.sepia.ceph.com 2022-01-29T14:15:37.420 INFO:teuthology.orchestra.run.smithi140.stdout:172.21.15.140 smithi140.front.sepia.ceph.com smithi140 2022-01-29T14:15:37.749 INFO:teuthology.provision.fog.smithi140:Deploy complete! 2022-01-29T14:15:42.099 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-29T14:15:42.327 INFO:teuthology.provision.fog.smithi165:Node is ready 2022-01-29T14:15:42.386 INFO:teuthology.orchestra.run.smithi165.stdout:smithi165.front.sepia.ceph.com 2022-01-29T14:15:42.442 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.15.165 smithi165.front.sepia.ceph.com smithi165 2022-01-29T14:15:42.758 INFO:teuthology.provision.fog.smithi165:Deploy complete! 2022-01-29T14:15:42.908 INFO:teuthology.lock.ops:Checking smithi140.front.sepia.ceph.com 2022-01-29T14:15:42.909 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-29T14:15:42.928 INFO:teuthology.lock.ops:Checking smithi165.front.sepia.ceph.com 2022-01-29T14:15:42.929 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-29T14:15:42.946 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: set os type and version on server 2022-01-29T14:15:42.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com' 2022-01-29T14:15:43.185 INFO:teuthology.orchestra.run.smithi140.stdout:x86_64 2022-01-29T14:15:43.240 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="Red Hat Enterprise Linux" 2022-01-29T14:15:43.241 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="8.4 (Ootpa)" 2022-01-29T14:15:43.241 INFO:teuthology.orchestra.run.smithi140.stdout:ID="rhel" 2022-01-29T14:15:43.241 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE="fedora" 2022-01-29T14:15:43.241 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="8.4" 2022-01-29T14:15:43.242 INFO:teuthology.orchestra.run.smithi140.stdout:PLATFORM_ID="platform:el8" 2022-01-29T14:15:43.242 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-29T14:15:43.242 INFO:teuthology.orchestra.run.smithi140.stdout:ANSI_COLOR="0;31" 2022-01-29T14:15:43.242 INFO:teuthology.orchestra.run.smithi140.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-29T14:15:43.243 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://www.redhat.com/" 2022-01-29T14:15:43.243 INFO:teuthology.orchestra.run.smithi140.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-29T14:15:43.243 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-29T14:15:43.243 INFO:teuthology.orchestra.run.smithi140.stdout: 2022-01-29T14:15:43.244 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-29T14:15:43.244 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-29T14:15:43.244 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-29T14:15:43.245 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-29T14:15:43.246 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2022-01-29T14:15:43.266 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: set os type and version on server 2022-01-29T14:15:43.267 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2022-01-29T14:15:43.493 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2022-01-29T14:15:43.547 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="Red Hat Enterprise Linux" 2022-01-29T14:15:43.548 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="8.4 (Ootpa)" 2022-01-29T14:15:43.548 INFO:teuthology.orchestra.run.smithi165.stdout:ID="rhel" 2022-01-29T14:15:43.548 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="fedora" 2022-01-29T14:15:43.548 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="8.4" 2022-01-29T14:15:43.549 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el8" 2022-01-29T14:15:43.549 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-29T14:15:43.549 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2022-01-29T14:15:43.549 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-29T14:15:43.550 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://www.redhat.com/" 2022-01-29T14:15:43.550 INFO:teuthology.orchestra.run.smithi165.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-29T14:15:43.550 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-29T14:15:43.550 INFO:teuthology.orchestra.run.smithi165.stdout: 2022-01-29T14:15:43.551 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-29T14:15:43.551 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-29T14:15:43.551 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-29T14:15:43.551 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-29T14:15:43.552 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2022-01-29T14:15:43.668 INFO:teuthology.dispatcher.supervisor:Running job 6647971 2022-01-29T14:15:43.668 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-28_20:46:10-rados-wip-yuriw-quincy-1.28.22-distro-default-smithi/6647971 --name yuriw-2022-01-28_20:46:10-rados-wip-yuriw-quincy-1.28.22-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/yuriw-2022-01-28_20:46:10-rados-wip-yuriw-quincy-1.28.22-distro-default-smithi/6647971/orig.config.yaml 2022-01-29T14:15:43.673 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-28_20:46:10-rados-wip-yuriw-quincy-1.28.22-distro-default-smithi/6647971 2022-01-29T14:15:43.674 INFO:teuthology.dispatcher.supervisor:Job PID: 866 2022-01-29T14:15:43.674 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-29T20:46:12.052 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-29T20:46:13.020 INFO:teuthology.kill:Killing Pids: {866} 2022-01-29T20:46:14.157 INFO:teuthology.task.internal:roles: ubuntu@smithi140.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-29T20:46:14.158 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-29T20:46:14.158 INFO:teuthology.misc:Compressing logs... 2022-01-29T20:46:14.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com' 2022-01-29T20:46:14.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2022-01-29T20:46:14.397 INFO:teuthology.orchestra.run.smithi140.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-29T20:46:14.624 INFO:teuthology.orchestra.run.smithi165.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-29T20:46:14.667 INFO:teuthology.orchestra.run.smithi140.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-29T20:46:14.667 INFO:teuthology.orchestra.run.smithi140.stderr:tar: Error is not recoverable: exiting now 2022-01-29T20:46:14.700 INFO:teuthology.orchestra.run.smithi165.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-29T20:46:14.700 INFO:teuthology.orchestra.run.smithi165.stderr:tar: Error is not recoverable: exiting now 2022-01-29T20:46:14.702 INFO:teuthology.misc:Compressing logs... 2022-01-29T20:46:14.900 INFO:teuthology.misc:Compressing logs... 2022-01-29T20:46:24.057 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/6d87f622-810f-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-29T20:46:24.084 INFO:teuthology.orchestra.run.smithi140.stderr:gzip: /var/log/ceph/6d87f622-810f-11ec-8c35-001a4aab830c/ceph-mon.smithi140.log: file size changed while zipping 2022-01-29T20:46:30.957 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/6d87f622-810f-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-29T20:46:31.165 INFO:teuthology.orchestra.run.smithi140.stderr:gzip: /var/log/ceph/6d87f622-810f-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-29T20:46:38.394 INFO:teuthology.orchestra.run.smithi140.stderr:gzip: /var/log/ceph/6d87f622-810f-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-29T20:46:39.808 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/6d87f622-810f-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-29T20:46:43.254 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/6d87f622-810f-11ec-8c35-001a4aab830c/ceph-mon.smithi165.log: file size changed while zipping 2022-01-29T20:46:46.207 INFO:teuthology.orchestra.run.smithi140.stderr:gzip: /var/log/ceph/6d87f622-810f-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-29T20:46:50.598 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/6d87f622-810f-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-29T20:46:55.688 INFO:teuthology.orchestra.run.smithi140.stderr:gzip: /var/log/ceph/6d87f622-810f-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-29T20:46:57.370 INFO:teuthology.orchestra.run.smithi140.stderr:gzip: /var/log/ceph/6d87f622-810f-11ec-8c35-001a4aab830c/ceph-mgr.smithi140.bnuokm.log: file size changed while zipping 2022-01-29T20:47:14.132 INFO:teuthology.kill:No teuthology processes running 2022-01-29T20:47:15.301 INFO:teuthology.kill:Nuking machines: ['smithi140', 'smithi165'] 2022-01-29T20:47:16.302 INFO:teuthology.kill:2022-01-29 20:47:16,302.302 INFO:teuthology.nuke:targets: 2022-01-29T20:47:16.303 INFO:teuthology.kill: smithi140.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIM20fmOGyI+MZXXacdKJLM3woptL47rRZbWIWMNC73qbS0FaGZ9SK+kwOtNixr6Q3UtHMHaEpVn9Ktj3cLqPkaDta6MORB2CwYJh9rJ0frYlRTw7ATl9B7G/ZUqTHBAvt8VoqnB4wzCCtcBjhLWY1WkIKx1Sb6u2KXFBStL+H+CJVCx258hR8Z8jxauX6v5tS6vZv8h+BnmaRJQIF/0pYmjN7NQZXHJdF+mbP/E6PniC7uA4phIWmG8nFWpk7QVRHIZ3AQWSxYydFH3mGSfVPmIecBIT9kYNWdPQjbtjLGkeTxo+LawV555cqbmsVKh5evYgZC8x68q49h1l6hXbOebZ7qqxvhVFbAVhE6L0zfPfabPF+9LmLsv2xcZDvP3snq0JiUhxwB1FKXsiKSblxFoyVQW4ut3qYxF3rL568cDrmSA2SXoX7ux0qRLYTvCGNrG8/KoO+c2UR+Q7umvqKrDzWKgOHbKPPoBOolo4ZKiS8EnSqlMa4X5hPuWREQlU= 2022-01-29T20:47:16.303 INFO:teuthology.kill: smithi165.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQChTJ8z1P4nfN/XF1ZvLEpP9BhYyg8keyPmAvGIzeTlIAFhJIDz62PyjnXGrbBBeljs2nBFd9UorRKKCo913QPSX3vEZ8KJpwPdVS4Sz1TflzlHSwmIylHwzFA15QCIjXh1ytwBsjVOijI2Zcqlu3KxT9QdaNJTfsnk54hGZVDRytvP5FLCrYKochQFFbKtAaqMUtGDSA5XYj0NIysM4CjoTk1Xq3EtN8bzZNertcXv6k0BPrkLrSXFIU+xKKKO4ZK9pVYzmNoJKoVQIXRnr5CuXhaSByJAi38+D+eCZA340yQGoPJkgVMIIcNdS3nWAjFv57eXiehzKTvWjFJ4N3xWBoVBfAB/nD3VJff0nXR0xwBkjXeD7K2Vot8zTaoEDVF4Iar1zBU9XKCdgIaNnoOZr9HVXNl/b0sBqRDazOp4VLbPfXedzN6VlmPV7qEohpowvswzuLTD+FxRc4t0qoX28ywRx3Bja1XmJ2oemh/Lfmr+Nch5AX3Y6n3FGXuQX0s= 2022-01-29T20:47:16.330 INFO:teuthology.kill:2022-01-29 20:47:16,330.330 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-29T20:47:16.335 INFO:teuthology.kill:2022-01-29 20:47:16,335.335 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-29T20:47:16.400 INFO:teuthology.kill:2022-01-29 20:47:16,400.400 INFO:teuthology.orchestra.console:Power off smithi165 2022-01-29T20:47:16.414 INFO:teuthology.kill:2022-01-29 20:47:16,413.413 INFO:teuthology.orchestra.console:Power off smithi140 2022-01-29T20:47:24.776 INFO:teuthology.kill:2022-01-29 20:47:24,776.776 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2022-01-29T20:47:24.920 INFO:teuthology.kill:2022-01-29 20:47:24,919.919 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2022-01-29T20:47:28.884 INFO:teuthology.kill:2022-01-29 20:47:28,884.884 INFO:teuthology.orchestra.console:Power off for smithi165 completed 2022-01-29T20:47:29.032 INFO:teuthology.kill:2022-01-29 20:47:29,032.032 INFO:teuthology.lock.ops:unlocked: smithi165.front.sepia.ceph.com 2022-01-29T20:49:29.361 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-29T20:49:29.453 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi140 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-27_06:00:02-rbd-octopus-distro-default-smithi/6642919 2022-01-29T20:49:29.454 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi165 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-27_06:00:02-rbd-octopus-distro-default-smithi/6642921