2022-03-25T17:26:53.730 INFO:root:teuthology version: 1.1.0-70390753 2022-03-25T17:26:53.846 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi061.front.sepia.ceph.com' reimaging 2022-03-25T17:26:53.847 INFO:teuthology.lock.ops:Updating [ubuntu@smithi061.front.sepia.ceph.com]: reset os type and version on server 2022-03-25T17:26:53.847 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2022-03-25T17:26:53.864 INFO:teuthology.lock.ops:Node 'ubuntu@smithi061.front.sepia.ceph.com' reimaging is complete 2022-03-25T17:26:53.864 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi082.front.sepia.ceph.com' reimaging 2022-03-25T17:26:53.864 INFO:teuthology.lock.ops:Updating [ubuntu@smithi082.front.sepia.ceph.com]: reset os type and version on server 2022-03-25T17:26:53.865 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2022-03-25T17:26:53.883 INFO:teuthology.lock.ops:Node 'ubuntu@smithi082.front.sepia.ceph.com' reimaging is complete 2022-03-25T17:26:54.085 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of ubuntu 18.04 2022-03-25T17:26:54.086 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of ubuntu 18.04 2022-03-25T17:26:54.405 INFO:teuthology.orchestra.console:Power off smithi082 2022-03-25T17:26:54.417 INFO:teuthology.orchestra.console:Power off smithi061 2022-03-25T17:27:06.887 INFO:teuthology.orchestra.console:Power off for smithi082 completed 2022-03-25T17:27:06.893 INFO:teuthology.orchestra.console:Power off for smithi061 completed 2022-03-25T17:27:06.989 INFO:teuthology.orchestra.console:Power on smithi082 2022-03-25T17:27:06.997 INFO:teuthology.orchestra.console:Power on smithi061 2022-03-25T17:27:11.250 INFO:teuthology.orchestra.console:Power on for smithi061 completed 2022-03-25T17:27:11.351 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish 2022-03-25T17:27:15.356 INFO:teuthology.orchestra.console:Power on for smithi082 completed 2022-03-25T17:27:15.457 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish 2022-03-25T17:31:49.077 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-25T17:31:50.990 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-25T17:31:55.093 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-25T17:31:57.002 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-25T17:32:01.340 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-25T17:32:03.016 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-25T17:32:07.353 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-25T17:32:09.030 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-25T17:32:13.429 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-25T17:32:13.814 INFO:teuthology.provision.fog.smithi082:Node is ready 2022-03-25T17:32:13.861 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082.front.sepia.ceph.com 2022-03-25T17:32:13.906 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82 smithi082.front.sepia.ceph.com smithi082 2022-03-25T17:32:14.200 INFO:teuthology.provision.fog.smithi082:Deploy complete! 2022-03-25T17:32:15.043 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-25T17:32:21.132 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-25T17:32:21.405 INFO:teuthology.provision.fog.smithi061:Node is ready 2022-03-25T17:32:21.452 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061.front.sepia.ceph.com 2022-03-25T17:32:21.501 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061 2022-03-25T17:32:21.767 INFO:teuthology.provision.fog.smithi061:Deploy complete! 2022-03-25T17:32:21.918 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com 2022-03-25T17:32:21.919 INFO:teuthology.lock.ops:New key found. Updating... 2022-03-25T17:32:21.940 INFO:teuthology.lock.ops:Checking smithi082.front.sepia.ceph.com 2022-03-25T17:32:21.940 INFO:teuthology.lock.ops:New key found. Updating... 2022-03-25T17:32:21.957 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server 2022-03-25T17:32:21.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2022-03-25T17:32:22.178 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64 2022-03-25T17:32:22.226 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Ubuntu" 2022-03-25T17:32:22.227 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2022-03-25T17:32:22.227 INFO:teuthology.orchestra.run.smithi061.stdout:ID=ubuntu 2022-03-25T17:32:22.227 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE=debian 2022-03-25T17:32:22.227 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2022-03-25T17:32:22.228 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="18.04" 2022-03-25T17:32:22.228 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.ubuntu.com/" 2022-03-25T17:32:22.228 INFO:teuthology.orchestra.run.smithi061.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-03-25T17:32:22.228 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-03-25T17:32:22.229 INFO:teuthology.orchestra.run.smithi061.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-03-25T17:32:22.229 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_CODENAME=bionic 2022-03-25T17:32:22.229 INFO:teuthology.orchestra.run.smithi061.stdout:UBUNTU_CODENAME=bionic 2022-03-25T17:32:22.230 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2022-03-25T17:32:22.253 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: set os type and version on server 2022-03-25T17:32:22.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2022-03-25T17:32:22.519 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2022-03-25T17:32:22.568 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Ubuntu" 2022-03-25T17:32:22.568 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2022-03-25T17:32:22.569 INFO:teuthology.orchestra.run.smithi082.stdout:ID=ubuntu 2022-03-25T17:32:22.569 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE=debian 2022-03-25T17:32:22.569 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2022-03-25T17:32:22.569 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="18.04" 2022-03-25T17:32:22.569 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.ubuntu.com/" 2022-03-25T17:32:22.570 INFO:teuthology.orchestra.run.smithi082.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-03-25T17:32:22.570 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-03-25T17:32:22.570 INFO:teuthology.orchestra.run.smithi082.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-03-25T17:32:22.570 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_CODENAME=bionic 2022-03-25T17:32:22.571 INFO:teuthology.orchestra.run.smithi082.stdout:UBUNTU_CODENAME=bionic 2022-03-25T17:32:22.571 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2022-03-25T17:32:22.656 INFO:teuthology.dispatcher.supervisor:Running job 6760212 2022-03-25T17:32:22.657 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-03-25_14:51:16-orch-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6760212 --name yuriw-2022-03-25_14:51:16-orch-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi --description orch/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/repave-all} -- /home/teuthworker/archive/yuriw-2022-03-25_14:51:16-orch-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6760212/orig.config.yaml 2022-03-25T17:32:22.660 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-03-25_14:51:16-orch-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6760212 2022-03-25T17:32:22.661 INFO:teuthology.dispatcher.supervisor:Job PID: 13118 2022-03-25T17:32:22.662 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-03-26T00:02:52.015 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-03-26T00:02:53.880 INFO:teuthology.kill:Killing Pids: {13118} 2022-03-26T00:02:55.055 INFO:teuthology.task.internal:roles: ubuntu@smithi061.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-03-26T00:02:55.056 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-03-26T00:02:55.056 INFO:teuthology.misc:Compressing logs... 2022-03-26T00:02:55.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2022-03-26T00:02:55.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2022-03-26T00:02:55.321 INFO:teuthology.orchestra.run.smithi061.stderr:find: '/var/lib/ceph/crash': No such file or directory 2022-03-26T00:02:55.556 INFO:teuthology.orchestra.run.smithi082.stderr:find: '/var/lib/ceph/crash': No such file or directory 2022-03-26T00:02:55.576 INFO:teuthology.orchestra.run.smithi061.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-03-26T00:02:55.576 INFO:teuthology.orchestra.run.smithi061.stderr:tar: Error is not recoverable: exiting now 2022-03-26T00:02:55.615 INFO:teuthology.orchestra.run.smithi082.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-03-26T00:02:55.615 INFO:teuthology.orchestra.run.smithi082.stderr:tar: Error is not recoverable: exiting now 2022-03-26T00:02:55.617 INFO:teuthology.misc:Compressing logs... 2022-03-26T00:02:55.776 INFO:teuthology.misc:Compressing logs... 2022-03-26T00:02:57.050 INFO:teuthology.orchestra.run.smithi061.stderr:gzip: /var/log/ceph/67e6b234-ac62-11ec-8c35-001a4aab830c/ceph-mon.smithi061.log: file size changed while zipping 2022-03-26T00:02:57.473 INFO:teuthology.kill:No teuthology processes running 2022-03-26T00:02:58.631 INFO:teuthology.kill:Nuking machines: ['smithi061', 'smithi082'] 2022-03-26T00:02:59.665 INFO:teuthology.kill:2022-03-26 00:02:59,664.664 INFO:teuthology.nuke:targets: 2022-03-26T00:02:59.666 INFO:teuthology.kill: smithi061.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOSnlEVqQu9FJr/5HsnQkQAA3gMdRcffXIACdbw8cxrRgl1aL4lnRjOtOQ2ymq82VeGqM8IX3PeYwu11xNbzG+XhUn9vmx9kShBwKl3OIBLssndIGX8KVg44iC6SmuKhdG3tdHUmlAMfj0m469TEIgDWNHV48CMoOER1nmuj4jgZ8eZsbJakzvv1F3NJPqPVHP6Blvdoz6FWaAOgnEHIpTN5lFQIuYbCux49ziL4RltVODTMQLIXoOA7ZdA2PftwMvfkRzzE9rltTHc8qA9GqCxMYa5/PqUKuunALulxEAJLlh5sX+6CPc7WWH0w0sDUFe+8uI+YHA+mdz4gvM9iRV 2022-03-26T00:02:59.666 INFO:teuthology.kill: smithi082.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH0de095QEwvuhpULBj2MDPsZn3I+gaJ++MByf0ysA/FjJ/S+tdPouhfd4actsq7nch2TOlImUs3e00O6/5w1/xC3M/+o8rG3RNMbVK3etbM/Fv5QDDryagh0/GjrddtPp1dU5VGBXK0zY9S5kJsbfu8/mTtUQs31taR+N45lG4eZvz7sias3MtW45jThUDbeKT+nl1VxKKxrUnMNFeOflr3pfVo0Bl2DpTpjSkxqrHGGqLRm+5oUcPMmS8Ok4aJqw7b9sOr5ddZFSWqrQjF7o0FZzAIKQkSYADrMeilFN8DK97wHOspbaqZTXcPRAN2Yhdm8UJh8S9gi31lZUo8/z 2022-03-26T00:02:59.690 INFO:teuthology.kill:2022-03-26 00:02:59,690.690 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-26T00:02:59.693 INFO:teuthology.kill:2022-03-26 00:02:59,693.693 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-26T00:02:59.767 INFO:teuthology.kill:2022-03-26 00:02:59,767.767 INFO:teuthology.orchestra.console:Power off smithi082 2022-03-26T00:02:59.779 INFO:teuthology.kill:2022-03-26 00:02:59,779.779 INFO:teuthology.orchestra.console:Power off smithi061 2022-03-26T00:03:08.136 INFO:teuthology.kill:2022-03-26 00:03:08,136.136 INFO:teuthology.orchestra.console:Power off for smithi082 completed 2022-03-26T00:03:08.283 INFO:teuthology.kill:2022-03-26 00:03:08,282.282 INFO:teuthology.lock.ops:unlocked: smithi082.front.sepia.ceph.com 2022-03-26T00:03:12.254 INFO:teuthology.kill:2022-03-26 00:03:12,254.254 INFO:teuthology.orchestra.console:Power off for smithi061 completed 2022-03-26T00:03:12.402 INFO:teuthology.kill:2022-03-26 00:03:12,402.402 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com 2022-03-26T00:05:12.717 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-03-26T00:05:12.808 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi061 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-25_18:40:53-rados-wip-yuri-testing-2022-03-25-0929-distro-default-smithi/6761320 2022-03-26T00:05:12.809 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi082 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-25_18:40:53-rados-wip-yuri-testing-2022-03-25-0929-distro-default-smithi/6761320