2022-02-11T17:17:26.101 INFO:root:teuthology version: 1.1.0-7cebb3f2 2022-02-11T17:17:26.238 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi022.front.sepia.ceph.com' reimaging 2022-02-11T17:17:26.239 INFO:teuthology.lock.ops:Updating [ubuntu@smithi022.front.sepia.ceph.com]: reset os type and version on server 2022-02-11T17:17:26.239 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2022-02-11T17:17:26.259 INFO:teuthology.lock.ops:Node 'ubuntu@smithi022.front.sepia.ceph.com' reimaging is complete 2022-02-11T17:17:26.259 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi125.front.sepia.ceph.com' reimaging 2022-02-11T17:17:26.259 INFO:teuthology.lock.ops:Updating [ubuntu@smithi125.front.sepia.ceph.com]: reset os type and version on server 2022-02-11T17:17:26.260 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2022-02-11T17:17:26.278 INFO:teuthology.lock.ops:Node 'ubuntu@smithi125.front.sepia.ceph.com' reimaging is complete 2022-02-11T17:17:26.489 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of ubuntu 20.04 2022-02-11T17:17:26.499 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of ubuntu 20.04 2022-02-11T17:17:26.869 INFO:teuthology.orchestra.console:Power off smithi125 2022-02-11T17:17:26.892 INFO:teuthology.orchestra.console:Power off smithi022 2022-02-11T17:17:27.026 INFO:teuthology.orchestra.console:Power off for smithi125 completed 2022-02-11T17:17:27.127 INFO:teuthology.orchestra.console:Power on smithi125 2022-02-11T17:17:31.384 INFO:teuthology.orchestra.console:Power on for smithi125 completed 2022-02-11T17:17:31.485 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2022-02-11T17:17:35.266 INFO:teuthology.orchestra.console:Power off for smithi022 completed 2022-02-11T17:17:35.367 INFO:teuthology.orchestra.console:Power on smithi022 2022-02-11T17:17:43.734 INFO:teuthology.orchestra.console:Power on for smithi022 completed 2022-02-11T17:17:43.835 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2022-02-11T17:22:12.808 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-11T17:22:13.315 INFO:teuthology.provision.fog.smithi022:Node is ready 2022-02-11T17:22:13.322 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2022-02-11T17:22:13.373 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2022-02-11T17:22:13.541 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2022-02-11T17:22:29.129 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-11T17:22:29.640 INFO:teuthology.provision.fog.smithi125:Node is ready 2022-02-11T17:22:29.648 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com 2022-02-11T17:22:29.655 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2022-02-11T17:22:29.853 INFO:teuthology.provision.fog.smithi125:Deploy complete! 2022-02-11T17:22:30.088 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2022-02-11T17:22:30.089 INFO:teuthology.lock.ops:New key found. Updating... 2022-02-11T17:22:30.109 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com 2022-02-11T17:22:30.110 INFO:teuthology.lock.ops:New key found. Updating... 2022-02-11T17:22:30.133 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2022-02-11T17:22:30.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2022-02-11T17:22:30.406 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2022-02-11T17:22:30.413 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Ubuntu" 2022-02-11T17:22:30.413 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-02-11T17:22:30.413 INFO:teuthology.orchestra.run.smithi022.stdout:ID=ubuntu 2022-02-11T17:22:30.413 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE=debian 2022-02-11T17:22:30.414 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-02-11T17:22:30.414 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="20.04" 2022-02-11T17:22:30.414 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.ubuntu.com/" 2022-02-11T17:22:30.414 INFO:teuthology.orchestra.run.smithi022.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-02-11T17:22:30.415 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-02-11T17:22:30.415 INFO:teuthology.orchestra.run.smithi022.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-02-11T17:22:30.415 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_CODENAME=focal 2022-02-11T17:22:30.415 INFO:teuthology.orchestra.run.smithi022.stdout:UBUNTU_CODENAME=focal 2022-02-11T17:22:30.416 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2022-02-11T17:22:30.434 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server 2022-02-11T17:22:30.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2022-02-11T17:22:30.606 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2022-02-11T17:22:30.613 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Ubuntu" 2022-02-11T17:22:30.613 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-02-11T17:22:30.613 INFO:teuthology.orchestra.run.smithi125.stdout:ID=ubuntu 2022-02-11T17:22:30.614 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE=debian 2022-02-11T17:22:30.614 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-02-11T17:22:30.614 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="20.04" 2022-02-11T17:22:30.614 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.ubuntu.com/" 2022-02-11T17:22:30.615 INFO:teuthology.orchestra.run.smithi125.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-02-11T17:22:30.615 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-02-11T17:22:30.615 INFO:teuthology.orchestra.run.smithi125.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-02-11T17:22:30.615 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_CODENAME=focal 2022-02-11T17:22:30.615 INFO:teuthology.orchestra.run.smithi125.stdout:UBUNTU_CODENAME=focal 2022-02-11T17:22:30.616 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2022-02-11T17:22:30.711 INFO:teuthology.dispatcher.supervisor:Running job 6676869 2022-02-11T17:22:30.711 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7cebb3f2319fd6c8340c0f7cd15a137e747fd32e/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2022-02-11_16:35:44-orch:cephadm-wip-adk-testing-2022-02-10-1637-distro-basic-smithi/6676869 --name adking-2022-02-11_16:35:44-orch:cephadm-wip-adk-testing-2022-02-10-1637-distro-basic-smithi --description orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/adking-2022-02-11_16:35:44-orch:cephadm-wip-adk-testing-2022-02-10-1637-distro-basic-smithi/6676869/orig.config.yaml 2022-02-11T17:22:30.715 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2022-02-11_16:35:44-orch:cephadm-wip-adk-testing-2022-02-10-1637-distro-basic-smithi/6676869 2022-02-11T17:22:30.716 INFO:teuthology.dispatcher.supervisor:Job PID: 12800 2022-02-11T17:22:30.716 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-02-11T23:52:59.446 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-02-11T23:52:59.642 INFO:teuthology.kill:Killing Pids: {12800} 2022-02-11T23:53:00.839 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-02-11T23:53:00.840 INFO:teuthology.task.internal:roles: ubuntu@smithi125.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-02-11T23:53:00.840 INFO:teuthology.misc:Compressing logs... 2022-02-11T23:53:00.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2022-02-11T23:53:01.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2022-02-11T23:53:01.032 INFO:teuthology.orchestra.run.smithi022.stderr:find: '/var/lib/ceph/crash': No such file or directory 2022-02-11T23:53:01.203 INFO:teuthology.orchestra.run.smithi125.stderr:find: '/var/lib/ceph/crash': No such file or directory 2022-02-11T23:53:01.491 INFO:teuthology.orchestra.run.smithi022.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-02-11T23:53:01.491 INFO:teuthology.orchestra.run.smithi022.stderr:tar: Error is not recoverable: exiting now 2022-02-11T23:53:01.511 INFO:teuthology.orchestra.run.smithi125.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-02-11T23:53:01.511 INFO:teuthology.orchestra.run.smithi125.stderr:tar: Error is not recoverable: exiting now 2022-02-11T23:53:01.514 INFO:teuthology.misc:Compressing logs... 2022-02-11T23:53:01.721 INFO:teuthology.misc:Compressing logs... 2022-02-11T23:53:08.787 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/1232a1ae-8b60-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-02-11T23:53:11.954 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/1232a1ae-8b60-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-02-11T23:53:17.501 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/1232a1ae-8b60-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-02-11T23:53:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/1232a1ae-8b60-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-02-11T23:53:26.026 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/1232a1ae-8b60-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-02-11T23:53:28.032 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/1232a1ae-8b60-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-02-11T23:53:29.328 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/1232a1ae-8b60-11ec-8c35-001a4aab830c/ceph-mon.smithi125.log: file size changed while zipping 2022-02-11T23:53:35.575 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/1232a1ae-8b60-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-02-11T23:53:36.078 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/1232a1ae-8b60-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-02-11T23:53:45.178 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/1232a1ae-8b60-11ec-8c35-001a4aab830c/ceph-mon.smithi022.log: file size changed while zipping 2022-02-11T23:53:46.964 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/1232a1ae-8b60-11ec-8c35-001a4aab830c/ceph-mgr.smithi022.sdekms.log: file size changed while zipping 2022-02-11T23:54:06.601 INFO:teuthology.kill:No teuthology processes running 2022-02-11T23:54:07.777 INFO:teuthology.kill:Nuking machines: ['smithi022', 'smithi125'] 2022-02-11T23:54:08.741 INFO:teuthology.kill:2022-02-11 23:54:08,741.741 INFO:teuthology.nuke:targets: 2022-02-11T23:54:08.742 INFO:teuthology.kill: smithi022.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2Xdvpzpn7h3raiwJseapGszLmoFHr573lmC6oucpheyT6P58x9qhYHWNV6yFhdS4qXFu1k7Zi9naWfthi29TU1MvQpj8yfTA7DanKyw6Ojl13zcVKwYcwbpHNeYnM7/QsjiqOZF2rYvuyrMdAzpi0ki7kfysd/U733CtDZJLSmqyC4zEh/qhwdjqHIg2dY90jQTgfqX6E6M5CQJxgjOkBKbC4Qy5UQLyykxHmxXSrb8E5NknpjKpcDqzAjbahhZtcnm9pPrGquKcT0wXGujwrYV5C2tkt+Ij3mHdEcO2x2b/gWrik6AawjwlnX9DJ/SYoC8Ul5peLr/NFbVn3DWoYxxumU2FBM5/JW5JZMPW/qJMYUAPmpzS4kceQyeB6/rAqI68wZg/9pzvmJTdIMPqNOlJRm8U6sW6Mfde6pNqQjNYR8QOcxnTUrZ0pgNd4xPrUNVRlkp7YeHcdrDx1OiWqg+evYKNreeL4oHqKVLSCVCmn4qGbelpcVMY1+6AAT1M= 2022-02-11T23:54:08.743 INFO:teuthology.kill: smithi125.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDoA9ZGRR7SPsGwKmqSAn8AYDBO06G9msCbGYH7kF/ZNIphxamnCx77gmDD/s0SBQ3UHJMJvxqQRFUoDDFXcnOILERmQmzZgi2oCs/UZWY5NVKIAJIy7DGXpVn1RX9mJyBnE9hguH3wRUqDpRjtIeev6dmi8SFOBB23cXC+JtRZwBZAUGV5pCZh/M6tkwKhp3yXp5HqjrWDoF1ziK1r1cPxDfCZYdG/Pk1pX9YjlmsiFyFP7h8TpTMUl0m8oI0ce4/tK49SePt7/DYhCWiLokGVq9pDeysTGoacYkIPx77bzPIU7yYxUwOfhsUXVT6iaQQmyz3VF1cwRI2PcHGHXev5L1+ZEkjUfTVyaZRNA19xiU+zspElzhhjfGJM3KmfSGgRWNlQIhuLYZ/uwqyYxgEteUc1nD6IsiMGLIxF2rb/YI7yj5SYAc7rMi4EubNLCaZozmpvjHSyPnvi/M9PJ4XmUpzljV0FNgIEoHYa/EKXwC/WOFZDpZgeBqSZiLC2dI0= 2022-02-11T23:54:08.768 INFO:teuthology.kill:2022-02-11 23:54:08,768.768 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-11T23:54:08.772 INFO:teuthology.kill:2022-02-11 23:54:08,772.772 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-11T23:54:08.849 INFO:teuthology.kill:2022-02-11 23:54:08,849.849 INFO:teuthology.orchestra.console:Power off smithi125 2022-02-11T23:54:08.861 INFO:teuthology.kill:2022-02-11 23:54:08,861.861 INFO:teuthology.orchestra.console:Power off smithi022 2022-02-11T23:54:17.223 INFO:teuthology.kill:2022-02-11 23:54:17,223.223 INFO:teuthology.orchestra.console:Power off for smithi125 completed 2022-02-11T23:54:17.375 INFO:teuthology.kill:2022-02-11 23:54:17,374.374 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com 2022-02-11T23:54:21.339 INFO:teuthology.kill:2022-02-11 23:54:21,339.339 INFO:teuthology.orchestra.console:Power off for smithi022 completed 2022-02-11T23:54:21.484 INFO:teuthology.kill:2022-02-11 23:54:21,483.483 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com 2022-02-11T23:56:21.795 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-02-11T23:56:21.888 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi022 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-11_19:41:29-rados-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677398 2022-02-11T23:56:21.889 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi125 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-11_19:41:29-rados-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677398