2022-01-24T02:55:35.499 INFO:root:teuthology version: 1.1.0-75f1bcd2 2022-01-24T02:55:35.631 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi041.front.sepia.ceph.com' reimaging 2022-01-24T02:55:35.632 INFO:teuthology.lock.ops:Updating [ubuntu@smithi041.front.sepia.ceph.com]: reset os type and version on server 2022-01-24T02:55:35.632 INFO:teuthology.lock.ops:Updating smithi041.front.sepia.ceph.com on lock server 2022-01-24T02:55:35.651 INFO:teuthology.lock.ops:Node 'ubuntu@smithi041.front.sepia.ceph.com' reimaging is complete 2022-01-24T02:55:35.652 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi077.front.sepia.ceph.com' reimaging 2022-01-24T02:55:35.652 INFO:teuthology.lock.ops:Updating [ubuntu@smithi077.front.sepia.ceph.com]: reset os type and version on server 2022-01-24T02:55:35.653 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2022-01-24T02:55:35.673 INFO:teuthology.lock.ops:Node 'ubuntu@smithi077.front.sepia.ceph.com' reimaging is complete 2022-01-24T02:55:35.882 INFO:teuthology.provision.fog.smithi041:Scheduling deploy of ubuntu 20.04 2022-01-24T02:55:35.910 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of ubuntu 20.04 2022-01-24T02:55:36.350 INFO:teuthology.orchestra.console:Power off smithi041 2022-01-24T02:55:36.391 INFO:teuthology.orchestra.console:Power off smithi077 2022-01-24T02:55:44.723 INFO:teuthology.orchestra.console:Power off for smithi041 completed 2022-01-24T02:55:44.750 INFO:teuthology.orchestra.console:Power off for smithi077 completed 2022-01-24T02:55:44.825 INFO:teuthology.orchestra.console:Power on smithi041 2022-01-24T02:55:44.855 INFO:teuthology.orchestra.console:Power on smithi077 2022-01-24T02:55:53.201 INFO:teuthology.orchestra.console:Power on for smithi041 completed 2022-01-24T02:55:53.219 INFO:teuthology.orchestra.console:Power on for smithi077 completed 2022-01-24T02:55:53.303 INFO:teuthology.provision.fog.smithi041:Waiting for deploy to finish 2022-01-24T02:55:53.320 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish 2022-01-24T03:00:40.528 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-24T03:00:41.064 INFO:teuthology.provision.fog.smithi041:Node is ready 2022-01-24T03:00:41.070 INFO:teuthology.orchestra.run.smithi041.stdout:smithi041.front.sepia.ceph.com 2022-01-24T03:00:41.078 INFO:teuthology.orchestra.run.smithi041.stdout:172.21.15.41 smithi041.front.sepia.ceph.com smithi041 2022-01-24T03:00:41.279 INFO:teuthology.provision.fog.smithi041:Deploy complete! 2022-01-24T03:00:55.383 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-24T03:00:55.916 INFO:teuthology.provision.fog.smithi077:Node is ready 2022-01-24T03:00:55.922 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com 2022-01-24T03:00:55.930 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077 2022-01-24T03:00:56.160 INFO:teuthology.provision.fog.smithi077:Deploy complete! 2022-01-24T03:00:56.395 INFO:teuthology.lock.ops:Checking smithi041.front.sepia.ceph.com 2022-01-24T03:00:56.396 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-24T03:00:56.416 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com 2022-01-24T03:00:56.416 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-24T03:00:56.437 INFO:teuthology.lock.ops:Updating [smithi041.front.sepia.ceph.com]: set os type and version on server 2022-01-24T03:00:56.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi041.front.sepia.ceph.com' 2022-01-24T03:00:56.699 INFO:teuthology.orchestra.run.smithi041.stdout:x86_64 2022-01-24T03:00:56.705 INFO:teuthology.orchestra.run.smithi041.stdout:NAME="Ubuntu" 2022-01-24T03:00:56.706 INFO:teuthology.orchestra.run.smithi041.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-01-24T03:00:56.706 INFO:teuthology.orchestra.run.smithi041.stdout:ID=ubuntu 2022-01-24T03:00:56.706 INFO:teuthology.orchestra.run.smithi041.stdout:ID_LIKE=debian 2022-01-24T03:00:56.706 INFO:teuthology.orchestra.run.smithi041.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-01-24T03:00:56.707 INFO:teuthology.orchestra.run.smithi041.stdout:VERSION_ID="20.04" 2022-01-24T03:00:56.707 INFO:teuthology.orchestra.run.smithi041.stdout:HOME_URL="https://www.ubuntu.com/" 2022-01-24T03:00:56.707 INFO:teuthology.orchestra.run.smithi041.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-01-24T03:00:56.707 INFO:teuthology.orchestra.run.smithi041.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-01-24T03:00:56.708 INFO:teuthology.orchestra.run.smithi041.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-01-24T03:00:56.708 INFO:teuthology.orchestra.run.smithi041.stdout:VERSION_CODENAME=focal 2022-01-24T03:00:56.708 INFO:teuthology.orchestra.run.smithi041.stdout:UBUNTU_CODENAME=focal 2022-01-24T03:00:56.709 INFO:teuthology.lock.ops:Updating smithi041.front.sepia.ceph.com on lock server 2022-01-24T03:00:56.729 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server 2022-01-24T03:00:56.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2022-01-24T03:00:56.902 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2022-01-24T03:00:56.909 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Ubuntu" 2022-01-24T03:00:56.909 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-01-24T03:00:56.909 INFO:teuthology.orchestra.run.smithi077.stdout:ID=ubuntu 2022-01-24T03:00:56.910 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE=debian 2022-01-24T03:00:56.910 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-01-24T03:00:56.910 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="20.04" 2022-01-24T03:00:56.910 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.ubuntu.com/" 2022-01-24T03:00:56.911 INFO:teuthology.orchestra.run.smithi077.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-01-24T03:00:56.911 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-01-24T03:00:56.911 INFO:teuthology.orchestra.run.smithi077.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-01-24T03:00:56.911 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_CODENAME=focal 2022-01-24T03:00:56.911 INFO:teuthology.orchestra.run.smithi077.stdout:UBUNTU_CODENAME=focal 2022-01-24T03:00:56.912 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2022-01-24T03:00:57.003 INFO:teuthology.dispatcher.supervisor:Running job 6631790 2022-01-24T03:00:57.004 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/bin/teuthology -v --owner scheduled_ifed01@teuthology --archive /home/teuthworker/archive/ifed01-2022-01-21_10:00:42-rados-wip-ifed-faster-rm-p2-distro-default-smithi/6631790 --name ifed01-2022-01-21_10:00:42-rados-wip-ifed-faster-rm-p2-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/ifed01-2022-01-21_10:00:42-rados-wip-ifed-faster-rm-p2-distro-default-smithi/6631790/orig.config.yaml 2022-01-24T03:00:57.007 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ifed01-2022-01-21_10:00:42-rados-wip-ifed-faster-rm-p2-distro-default-smithi/6631790 2022-01-24T03:00:57.008 INFO:teuthology.dispatcher.supervisor:Job PID: 15516 2022-01-24T03:00:57.008 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-24T09:31:25.695 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-24T09:31:25.892 INFO:teuthology.kill:Killing Pids: {15516} 2022-01-24T09:31:27.039 INFO:teuthology.task.internal:roles: ubuntu@smithi041.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-24T09:31:27.040 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-24T09:31:27.040 INFO:teuthology.misc:Compressing logs... 2022-01-24T09:31:27.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi041.front.sepia.ceph.com' 2022-01-24T09:31:27.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2022-01-24T09:31:27.231 INFO:teuthology.orchestra.run.smithi041.stderr:find: '/var/lib/ceph/crash': No such file or directory 2022-01-24T09:31:27.393 INFO:teuthology.orchestra.run.smithi077.stderr:find: '/var/lib/ceph/crash': No such file or directory 2022-01-24T09:31:27.424 INFO:teuthology.orchestra.run.smithi041.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-24T09:31:27.424 INFO:teuthology.orchestra.run.smithi041.stderr:tar: Error is not recoverable: exiting now 2022-01-24T09:31:27.441 INFO:teuthology.orchestra.run.smithi077.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-24T09:31:27.442 INFO:teuthology.orchestra.run.smithi077.stderr:tar: Error is not recoverable: exiting now 2022-01-24T09:31:27.443 INFO:teuthology.misc:Compressing logs... 2022-01-24T09:31:27.675 INFO:teuthology.misc:Compressing logs... 2022-01-24T09:31:44.863 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/c9e6eac8-7cc2-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-24T09:31:45.407 INFO:teuthology.orchestra.run.smithi041.stderr:gzip: /var/log/ceph/c9e6eac8-7cc2-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-24T09:31:55.261 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/c9e6eac8-7cc2-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-24T09:32:01.432 INFO:teuthology.orchestra.run.smithi041.stderr:gzip: /var/log/ceph/c9e6eac8-7cc2-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-24T09:32:03.685 INFO:teuthology.orchestra.run.smithi041.stderr:gzip: /var/log/ceph/c9e6eac8-7cc2-11ec-8c35-001a4aab830c/ceph-mgr.smithi041.rnbdyf.log: file size changed while zipping 2022-01-24T09:32:14.115 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/c9e6eac8-7cc2-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-24T09:32:25.287 INFO:teuthology.orchestra.run.smithi041.stderr:gzip: /var/log/ceph/c9e6eac8-7cc2-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-24T09:32:30.760 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/c9e6eac8-7cc2-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-24T09:32:33.814 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/c9e6eac8-7cc2-11ec-8c35-001a4aab830c/ceph-mon.smithi077.log: file size changed while zipping 2022-01-24T09:32:42.237 INFO:teuthology.orchestra.run.smithi041.stderr:gzip: /var/log/ceph/c9e6eac8-7cc2-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-24T09:32:51.802 INFO:teuthology.orchestra.run.smithi041.stderr:gzip: /var/log/ceph/c9e6eac8-7cc2-11ec-8c35-001a4aab830c/ceph-mon.smithi041.log: file size changed while zipping 2022-01-24T09:33:30.287 INFO:teuthology.kill:No teuthology processes running 2022-01-24T09:33:31.364 INFO:teuthology.kill:Nuking machines: ['smithi041', 'smithi077'] 2022-01-24T09:33:32.356 INFO:teuthology.kill:2022-01-24 09:33:32,356.356 INFO:teuthology.nuke:targets: 2022-01-24T09:33:32.357 INFO:teuthology.kill: smithi041.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6WFpbmuKeMBxfk594Sk4y5xy+nYvkS6u0Teewddid4Sb/1y3BJJ+vMc4WQA+MhW11TwC/hYTfyjE6PUvU6g6gO2uBzwfB/3IwWa/a299Q1WgRSw0rW/G+/m7+qi4f0vBroae2EpZfCSYdmd+KZPvNyLhdqS+b4QCswVSebJyoDtD3z5gBUA4UvH3jrDcySYaxzJ7FqDTMwNbWYHUbKLg/DWWQ6Nj7HNBr7xryg4VByheVsvr8oBqQQZLaTt1fB1myQ0EC8Ru3gx4eXx+ld51gs521B8xLuRTcHOoYTjGz4vZOEdI3C6UEXJlL9q/xk4BVV8LlRDGeLOZXJR/9N9QRCcdDpqJh97h2aDY7d9xd/bbx+jqaua8l2AXqL+owhKZNTTmSinmauQBMsSlqm9jvx3Kqtxh6TOSeUyW7NPpXrWc4t4efJ2jIxQHv3h18kaXZA2lTuC1iDqksL1+yDlHf/r1prLLfCU7TyZX6PQnHliDM2BuZQ6IiOmh4L03DrVM= 2022-01-24T09:33:32.357 INFO:teuthology.kill: smithi077.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD1EDd+us4RxdH7vZWXdPkWjBF6PqU//fUA8P05eQu1ibtzT2TqwKu6+Wo/hrFU4dtWDxififS+1r5TFdJmD3wCg6ZGQ0G1LTXqmUOEw5Uyr8lTFtgB0U2G0uO8zgGy/lQD5Fzt7UsRyIUIe0ON1pyiy4LaxKBwR2uI5oTtt+CJ0LF+C7Oft9vtBIO57JefZohrGeWzu/FSyiwa86LTyVmuCJwoROn+u7YtTRiwQiKzJGp/hLN3tKGyugXoYw7/GfBa6pnmXyHbv+a7MYk6An5C3d4IIawh5JA/LPaIa2b7VH4jmuocOJP8fszec7wQJWXy0aDcaTjZmC2xEKm534Suai7qnk4tsvunmDSO82VGG5phANdDd8TIgnLYDkvqWOunsaMiKDRk9JwQZK6ApYoNPRQjuM4/eRF6nJ74XVl9uh3HRYKryPSNYBCBx20aZ3byD7YDrFHGkWVai19Go0Tshb8aODDRXucc3MiROmVp2NzNtmSArVgKcZQCkbFuThc= 2022-01-24T09:33:32.382 INFO:teuthology.kill:2022-01-24 09:33:32,381.381 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-24T09:33:32.385 INFO:teuthology.kill:2022-01-24 09:33:32,385.385 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-24T09:33:32.459 INFO:teuthology.kill:2022-01-24 09:33:32,458.458 INFO:teuthology.orchestra.console:Power off smithi077 2022-01-24T09:33:32.472 INFO:teuthology.kill:2022-01-24 09:33:32,471.471 INFO:teuthology.orchestra.console:Power off smithi041 2022-01-24T09:33:40.827 INFO:teuthology.kill:2022-01-24 09:33:40,827.827 INFO:teuthology.orchestra.console:Power off for smithi077 completed 2022-01-24T09:33:40.834 INFO:teuthology.kill:2022-01-24 09:33:40,833.833 INFO:teuthology.orchestra.console:Power off for smithi041 completed 2022-01-24T09:33:40.979 INFO:teuthology.kill:2022-01-24 09:33:40,978.978 INFO:teuthology.lock.ops:unlocked: smithi077.front.sepia.ceph.com 2022-01-24T09:33:40.981 INFO:teuthology.kill:2022-01-24 09:33:40,981.981 INFO:teuthology.lock.ops:unlocked: smithi041.front.sepia.ceph.com 2022-01-24T09:35:41.270 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-24T09:35:41.363 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi041 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-24_06:07:02-rbd-pacific-distro-default-smithi/6637665 2022-01-24T09:35:41.363 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi077 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-24_06:07:02-rbd-pacific-distro-default-smithi/6637665