2022-01-24T12:37:29.409 INFO:root:teuthology version: 1.1.0-75f1bcd2 2022-01-24T12:37:29.535 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi133.front.sepia.ceph.com' reimaging 2022-01-24T12:37:29.536 INFO:teuthology.lock.ops:Updating [ubuntu@smithi133.front.sepia.ceph.com]: reset os type and version on server 2022-01-24T12:37:29.537 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2022-01-24T12:37:29.555 INFO:teuthology.lock.ops:Node 'ubuntu@smithi133.front.sepia.ceph.com' reimaging is complete 2022-01-24T12:37:29.555 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi171.front.sepia.ceph.com' reimaging 2022-01-24T12:37:29.556 INFO:teuthology.lock.ops:Updating [ubuntu@smithi171.front.sepia.ceph.com]: reset os type and version on server 2022-01-24T12:37:29.556 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2022-01-24T12:37:29.575 INFO:teuthology.lock.ops:Node 'ubuntu@smithi171.front.sepia.ceph.com' reimaging is complete 2022-01-24T12:37:29.767 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of ubuntu 20.04 2022-01-24T12:37:29.786 INFO:teuthology.provision.fog.smithi171:Scheduling deploy of ubuntu 20.04 2022-01-24T12:37:30.187 INFO:teuthology.orchestra.console:Power off smithi171 2022-01-24T12:37:30.205 INFO:teuthology.orchestra.console:Power off smithi133 2022-01-24T12:37:30.333 INFO:teuthology.orchestra.console:Power off for smithi171 completed 2022-01-24T12:37:30.344 INFO:teuthology.orchestra.console:Power off for smithi133 completed 2022-01-24T12:37:30.434 INFO:teuthology.orchestra.console:Power on smithi171 2022-01-24T12:37:30.445 INFO:teuthology.orchestra.console:Power on smithi133 2022-01-24T12:37:38.800 INFO:teuthology.orchestra.console:Power on for smithi171 completed 2022-01-24T12:37:38.805 INFO:teuthology.orchestra.console:Power on for smithi133 completed 2022-01-24T12:37:38.902 INFO:teuthology.provision.fog.smithi171:Waiting for deploy to finish 2022-01-24T12:37:38.906 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2022-01-24T12:42:49.478 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-24T12:42:50.004 INFO:teuthology.provision.fog.smithi133:Node is ready 2022-01-24T12:42:50.011 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2022-01-24T12:42:50.018 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2022-01-24T12:42:50.286 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2022-01-24T12:43:04.304 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-24T12:43:04.812 INFO:teuthology.provision.fog.smithi171:Node is ready 2022-01-24T12:43:04.819 INFO:teuthology.orchestra.run.smithi171.stdout:smithi171.front.sepia.ceph.com 2022-01-24T12:43:04.826 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.15.171 smithi171.front.sepia.ceph.com smithi171 2022-01-24T12:43:05.087 INFO:teuthology.provision.fog.smithi171:Deploy complete! 2022-01-24T12:43:05.271 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2022-01-24T12:43:05.272 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-24T12:43:05.318 INFO:teuthology.lock.ops:Checking smithi171.front.sepia.ceph.com 2022-01-24T12:43:05.319 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-24T12:43:05.337 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2022-01-24T12:43:05.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2022-01-24T12:43:05.602 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2022-01-24T12:43:05.608 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2022-01-24T12:43:05.608 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-01-24T12:43:05.608 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2022-01-24T12:43:05.609 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2022-01-24T12:43:05.609 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-01-24T12:43:05.609 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="20.04" 2022-01-24T12:43:05.610 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2022-01-24T12:43:05.610 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-01-24T12:43:05.610 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-01-24T12:43:05.610 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-01-24T12:43:05.611 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=focal 2022-01-24T12:43:05.611 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=focal 2022-01-24T12:43:05.612 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2022-01-24T12:43:05.631 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: set os type and version on server 2022-01-24T12:43:05.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2022-01-24T12:43:05.806 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2022-01-24T12:43:05.854 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="Ubuntu" 2022-01-24T12:43:05.855 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-01-24T12:43:05.855 INFO:teuthology.orchestra.run.smithi171.stdout:ID=ubuntu 2022-01-24T12:43:05.855 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE=debian 2022-01-24T12:43:05.855 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-01-24T12:43:05.856 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="20.04" 2022-01-24T12:43:05.856 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://www.ubuntu.com/" 2022-01-24T12:43:05.856 INFO:teuthology.orchestra.run.smithi171.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-01-24T12:43:05.857 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-01-24T12:43:05.857 INFO:teuthology.orchestra.run.smithi171.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-01-24T12:43:05.857 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_CODENAME=focal 2022-01-24T12:43:05.857 INFO:teuthology.orchestra.run.smithi171.stdout:UBUNTU_CODENAME=focal 2022-01-24T12:43:05.858 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2022-01-24T12:43:05.956 INFO:teuthology.dispatcher.supervisor:Running job 6636721 2022-01-24T12:43:05.956 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-01-23_07:01:07-rados-master-distro-default-smithi/6636721 --name teuthology-2022-01-23_07:01:07-rados-master-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} -- /home/teuthworker/archive/teuthology-2022-01-23_07:01:07-rados-master-distro-default-smithi/6636721/orig.config.yaml 2022-01-24T12:43:05.960 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-01-23_07:01:07-rados-master-distro-default-smithi/6636721 2022-01-24T12:43:05.961 INFO:teuthology.dispatcher.supervisor:Job PID: 9565 2022-01-24T12:43:05.961 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-24T19:13:34.310 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-24T19:13:34.481 INFO:teuthology.kill:Killing Pids: {9565} 2022-01-24T19:13:35.601 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-24T19:13:35.602 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-24T19:13:35.602 INFO:teuthology.misc:Compressing logs... 2022-01-24T19:13:35.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2022-01-24T19:13:35.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2022-01-24T19:13:35.793 INFO:teuthology.orchestra.run.smithi133.stderr:find: '/var/lib/ceph/crash': No such file or directory 2022-01-24T19:13:35.964 INFO:teuthology.orchestra.run.smithi171.stderr:find: '/var/lib/ceph/crash': No such file or directory 2022-01-24T19:13:36.008 INFO:teuthology.orchestra.run.smithi133.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-24T19:13:36.008 INFO:teuthology.orchestra.run.smithi133.stderr:tar: Error is not recoverable: exiting now 2022-01-24T19:13:36.026 INFO:teuthology.orchestra.run.smithi171.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-24T19:13:36.026 INFO:teuthology.orchestra.run.smithi171.stderr:tar: Error is not recoverable: exiting now 2022-01-24T19:13:36.028 INFO:teuthology.misc:Compressing logs... 2022-01-24T19:13:36.248 INFO:teuthology.misc:Compressing logs... 2022-01-24T19:13:37.933 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/283c78a8-7d14-11ec-8c35-001a4aab830c/ceph-mgr.smithi133.hsdajb.log: file size changed while zipping 2022-01-24T19:13:44.859 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/283c78a8-7d14-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-24T19:13:45.454 INFO:teuthology.orchestra.run.smithi171.stderr:gzip: /var/log/ceph/283c78a8-7d14-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-24T19:13:52.170 INFO:teuthology.orchestra.run.smithi171.stderr:gzip: /var/log/ceph/283c78a8-7d14-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-24T19:13:53.649 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/283c78a8-7d14-11ec-8c35-001a4aab830c/ceph-mon.smithi133.log: file size changed while zipping 2022-01-24T19:14:01.275 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/283c78a8-7d14-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-24T19:14:01.367 INFO:teuthology.orchestra.run.smithi171.stderr:gzip: /var/log/ceph/283c78a8-7d14-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-24T19:14:08.462 INFO:teuthology.orchestra.run.smithi171.stderr:gzip: /var/log/ceph/283c78a8-7d14-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-24T19:14:10.492 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/283c78a8-7d14-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-24T19:14:11.721 INFO:teuthology.orchestra.run.smithi171.stderr:gzip: /var/log/ceph/283c78a8-7d14-11ec-8c35-001a4aab830c/ceph-mon.smithi171.log: file size changed while zipping 2022-01-24T19:14:17.369 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/283c78a8-7d14-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-24T19:14:36.455 INFO:teuthology.kill:No teuthology processes running 2022-01-24T19:14:37.554 INFO:teuthology.kill:Nuking machines: ['smithi133', 'smithi171'] 2022-01-24T19:14:38.498 INFO:teuthology.kill:2022-01-24 19:14:38,498.498 INFO:teuthology.nuke:targets: 2022-01-24T19:14:38.499 INFO:teuthology.kill: smithi133.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPZtXPaGTtb0MzpveDIHpCRinNp/wXpCH3PIksM7uzkmE77b543KArTei0KnEGnb5+EbskLt+ic/Wc2QMRxuKrKD8vhViN0i61MKco84VgRjGaOXZbdGzT4rWCdVHswAW3dn55eQEx3dR2fAMm7VmjbixutGSOubJhCm7QDsz5Ni3j4AM0Zvl1uJGDfTy+9vGk71BpeG/YUE1XGPSaSKxJwgnhaeEbGlVSrDCknG1ato8HwkaXGIPIyTs28Ykh+uLHEfJKs7UjstJxKpYS3pEewmwSFaxijmjrCgxdnS6W2tX2Gbe0kbaLR2mfzZF2QySkCFCKOK7RqdyS2vl+FP9bjKTFFZ3r4nVK53h69G6MC37CVXA81wj6I7TBiAF0b1EWzGJ5yYMD146sW6kkAs/MhCrGRxeTO0maVFZuoZ1gE46OzY6yCWmwDYlUOen9S6Iuhf7pIgtgLmNOL56gNEzn5x6TdMWttZ1h9JtBHrX588COjlyzH+P/wEv7INYjsbM= 2022-01-24T19:14:38.500 INFO:teuthology.kill: smithi171.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDsu4v/JbVDjs/EpwyenXnWrtH5X5t6oHumpcfctX/i9nSiQsmq9j55L6gTpCTQZNJLC0Vi8F7lGy2mmzJTeqLbhzl7Mz+wzG9AM7mDwpUSAWX6pDmasb8gkglzVrI73oHUKTRYHUipXMilXt+aiweZ2dTOEp39XVOYX2gXmqqQ9pA02d1JXTGZPyljEk8l035TP66Gy+ltm6hs2og4vRjqaC2beXhgutvOy4WjKFXjPGgBexv1QB4r/wk5sFttWN5Y3Ja6nAadnobr/Ui5axqPD2tKWbAZaYq3oebDhLDLHhJ1sVk4fjKC9tDNYiCmgnRnNkWya4Nud4PpamTJuo94Raytxq3ALBPisWVm7EzJ7bMappsm3H7cwAZO7lU4/fjCG6T8fQMxzgD3uxzueodV3cgbmQh1f8tt09KJWHEdmcdX4Jr/gSbVV3VPqKxdxHVwTVW1kvNWb5b+qOcZP2RHjfPCW6iKKuRmp2gGbo83IT5NjLAO7GOQ8UtrFCsuGl0= 2022-01-24T19:14:38.526 INFO:teuthology.kill:2022-01-24 19:14:38,525.525 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-24T19:14:38.527 INFO:teuthology.kill:2022-01-24 19:14:38,527.527 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-24T19:14:38.600 INFO:teuthology.kill:2022-01-24 19:14:38,600.600 INFO:teuthology.orchestra.console:Power off smithi171 2022-01-24T19:14:38.613 INFO:teuthology.kill:2022-01-24 19:14:38,612.612 INFO:teuthology.orchestra.console:Power off smithi133 2022-01-24T19:14:51.086 INFO:teuthology.kill:2022-01-24 19:14:51,085.085 INFO:teuthology.orchestra.console:Power off for smithi171 completed 2022-01-24T19:14:51.092 INFO:teuthology.kill:2022-01-24 19:14:51,092.092 INFO:teuthology.orchestra.console:Power off for smithi133 completed 2022-01-24T19:14:51.236 INFO:teuthology.kill:2022-01-24 19:14:51,235.235 INFO:teuthology.lock.ops:unlocked: smithi171.front.sepia.ceph.com 2022-01-24T19:14:51.239 INFO:teuthology.kill:2022-01-24 19:14:51,238.238 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com 2022-01-24T19:16:51.562 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-24T19:16:51.660 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi133 but it was locked by another job: /home/teuthworker/archive/ksirivad-2022-01-24_19:09:07-rados:mgr-wip-kisirvad-mgr-progress-improve-test-distro-basic-smithi/6638695 2022-01-24T19:16:51.660 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi171 but it was locked by another job: /home/teuthworker/archive/ksirivad-2022-01-24_19:09:07-rados:mgr-wip-kisirvad-mgr-progress-improve-test-distro-basic-smithi/6638695