2022-01-09T15:27:29.019 INFO:root:teuthology version: 1.1.0-00e09f05 2022-01-09T15:27:29.144 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi082.front.sepia.ceph.com' reimaging 2022-01-09T15:27:29.145 INFO:teuthology.lock.ops:Updating [ubuntu@smithi082.front.sepia.ceph.com]: reset os type and version on server 2022-01-09T15:27:29.146 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2022-01-09T15:27:29.163 INFO:teuthology.lock.ops:Node 'ubuntu@smithi082.front.sepia.ceph.com' reimaging is complete 2022-01-09T15:27:29.163 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi164.front.sepia.ceph.com' reimaging 2022-01-09T15:27:29.164 INFO:teuthology.lock.ops:Updating [ubuntu@smithi164.front.sepia.ceph.com]: reset os type and version on server 2022-01-09T15:27:29.164 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2022-01-09T15:27:29.183 INFO:teuthology.lock.ops:Node 'ubuntu@smithi164.front.sepia.ceph.com' reimaging is complete 2022-01-09T15:27:29.379 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of ubuntu 20.04 2022-01-09T15:27:29.398 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of ubuntu 20.04 2022-01-09T15:27:29.719 INFO:teuthology.orchestra.console:Power off smithi082 2022-01-09T15:27:29.741 INFO:teuthology.orchestra.console:Power off smithi164 2022-01-09T15:27:29.874 INFO:teuthology.orchestra.console:Power off for smithi082 completed 2022-01-09T15:27:29.885 INFO:teuthology.orchestra.console:Power off for smithi164 completed 2022-01-09T15:27:29.976 INFO:teuthology.orchestra.console:Power on smithi082 2022-01-09T15:27:29.987 INFO:teuthology.orchestra.console:Power on smithi164 2022-01-09T15:27:34.232 INFO:teuthology.orchestra.console:Power on for smithi082 completed 2022-01-09T15:27:34.333 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish 2022-01-09T15:27:38.403 INFO:teuthology.orchestra.console:Power on for smithi164 completed 2022-01-09T15:27:38.505 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish 2022-01-09T15:33:09.908 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-09T15:33:10.492 INFO:teuthology.provision.fog.smithi082:Node is ready 2022-01-09T15:33:10.499 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082.front.sepia.ceph.com 2022-01-09T15:33:10.506 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82 smithi082.front.sepia.ceph.com smithi082 2022-01-09T15:33:10.710 INFO:teuthology.provision.fog.smithi082:Deploy complete! 2022-01-09T15:33:13.668 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-09T15:33:14.250 INFO:teuthology.provision.fog.smithi164:Node is ready 2022-01-09T15:33:14.257 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com 2022-01-09T15:33:14.264 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164 2022-01-09T15:33:14.444 INFO:teuthology.provision.fog.smithi164:Deploy complete! 2022-01-09T15:33:14.656 INFO:teuthology.lock.ops:Checking smithi082.front.sepia.ceph.com 2022-01-09T15:33:14.657 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-09T15:33:14.677 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com 2022-01-09T15:33:14.677 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-09T15:33:14.697 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: set os type and version on server 2022-01-09T15:33:14.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2022-01-09T15:33:14.874 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2022-01-09T15:33:14.881 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Ubuntu" 2022-01-09T15:33:14.881 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-01-09T15:33:14.881 INFO:teuthology.orchestra.run.smithi082.stdout:ID=ubuntu 2022-01-09T15:33:14.881 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE=debian 2022-01-09T15:33:14.882 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-01-09T15:33:14.882 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="20.04" 2022-01-09T15:33:14.882 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.ubuntu.com/" 2022-01-09T15:33:14.882 INFO:teuthology.orchestra.run.smithi082.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-01-09T15:33:14.883 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-01-09T15:33:14.883 INFO:teuthology.orchestra.run.smithi082.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-01-09T15:33:14.883 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_CODENAME=focal 2022-01-09T15:33:14.883 INFO:teuthology.orchestra.run.smithi082.stdout:UBUNTU_CODENAME=focal 2022-01-09T15:33:14.884 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2022-01-09T15:33:14.902 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server 2022-01-09T15:33:14.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2022-01-09T15:33:15.074 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2022-01-09T15:33:15.080 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Ubuntu" 2022-01-09T15:33:15.080 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-01-09T15:33:15.080 INFO:teuthology.orchestra.run.smithi164.stdout:ID=ubuntu 2022-01-09T15:33:15.081 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE=debian 2022-01-09T15:33:15.081 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-01-09T15:33:15.081 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="20.04" 2022-01-09T15:33:15.081 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.ubuntu.com/" 2022-01-09T15:33:15.081 INFO:teuthology.orchestra.run.smithi164.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-01-09T15:33:15.082 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-01-09T15:33:15.082 INFO:teuthology.orchestra.run.smithi164.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-01-09T15:33:15.082 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_CODENAME=focal 2022-01-09T15:33:15.082 INFO:teuthology.orchestra.run.smithi164.stdout:UBUNTU_CODENAME=focal 2022-01-09T15:33:15.083 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2022-01-09T15:33:15.172 INFO:teuthology.dispatcher.supervisor:Running job 6604858 2022-01-09T15:33:15.172 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_00e09f05e9fb2ab7c7f497f5e446613531743ae2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-09_15:17:46-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi/6604858 --name yuriw-2022-01-09_15:17:46-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} -- /home/teuthworker/archive/yuriw-2022-01-09_15:17:46-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi/6604858/orig.config.yaml 2022-01-09T15:33:15.175 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-09_15:17:46-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi/6604858 2022-01-09T15:33:15.176 INFO:teuthology.dispatcher.supervisor:Job PID: 10766 2022-01-09T15:33:15.176 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-10T03:34:08.028 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-01-10T03:34:08.156 INFO:teuthology.kill:Killing Pids: {10766} 2022-01-10T03:34:09.285 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-10T03:34:09.286 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-10T03:34:09.287 INFO:teuthology.misc:Compressing logs... 2022-01-10T03:34:09.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2022-01-10T03:34:09.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2022-01-10T03:34:09.517 INFO:teuthology.orchestra.run.smithi082.stderr:find: '/var/lib/ceph/crash': No such file or directory 2022-01-10T03:34:09.690 INFO:teuthology.orchestra.run.smithi164.stderr:find: '/var/lib/ceph/crash': No such file or directory 2022-01-10T03:34:09.723 INFO:teuthology.orchestra.run.smithi082.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-10T03:34:09.723 INFO:teuthology.orchestra.run.smithi082.stderr:tar: Error is not recoverable: exiting now 2022-01-10T03:34:09.741 INFO:teuthology.orchestra.run.smithi164.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-10T03:34:09.741 INFO:teuthology.orchestra.run.smithi164.stderr:tar: Error is not recoverable: exiting now 2022-01-10T03:34:09.743 INFO:teuthology.misc:Compressing logs... 2022-01-10T03:34:10.097 INFO:teuthology.misc:Compressing logs... 2022-01-10T03:34:13.191 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/74370b28-7162-11ec-8c32-001a4aab830c/ceph-mgr.smithi082.vckycu.log: file size changed while zipping 2022-01-10T03:34:27.353 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/74370b28-7162-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-10T03:34:29.433 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/74370b28-7162-11ec-8c32-001a4aab830c/ceph-mon.smithi082.log: file size changed while zipping 2022-01-10T03:34:39.927 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/74370b28-7162-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-10T03:34:42.171 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/74370b28-7162-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-10T03:34:56.655 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/74370b28-7162-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-10T03:34:57.092 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/74370b28-7162-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-10T03:35:03.192 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/74370b28-7162-11ec-8c32-001a4aab830c/ceph-mon.smithi164.log: file size changed while zipping 2022-01-10T03:35:13.964 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/74370b28-7162-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-10T03:35:16.286 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/74370b28-7162-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-10T03:35:26.940 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/74370b28-7162-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-10T03:36:03.557 INFO:teuthology.kill:No teuthology processes running 2022-01-10T03:36:04.764 INFO:teuthology.kill:Nuking machines: ['smithi082', 'smithi164'] 2022-01-10T03:36:05.683 INFO:teuthology.kill:2022-01-10 03:36:05,683.683 INFO:teuthology.nuke:targets: 2022-01-10T03:36:05.684 INFO:teuthology.kill: smithi082.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjY+i5/caD+jJoFoVh8L12CgjfmQiIihhDu5k2MrGhu8YDTMweU5I6Hw+pd8ItdEzs3xBEM1WqC7xhAksCc7wLyeL83b8Uq35HCbnbQb9dXq6MJmlqYvps5yMlQ4gzcXY8j4Df+pAKa2PD1xKisgZNCNSdbyjVFIL9OFHUc8Y/GgX4FWNfl2K1IiCcYMx18H/AWFLdKXc4ALZE1QpfguYeAfdGZCte1Nx5oxJ6G6aQw69q39pXoHaD7GaoamNLwtbsl4cPMCARnmNm1WZdYrY+bmeVTP6Kc8idFaxf+3Yr6Y2fQiq9sIuk5s8GlBPnYjUu38dIYBb9LnX8rOyLcV5i5Znnm0QciLyCjR1BMd7z2W+SaOPAMs4MqXIJq4fXODaqJbeiOt/tFpohyeVCSzAmW7lW3CPNuDCh1ChLb2MBG/ElhA8j2vikZqHCZ+e7InQ1B9yFfhhQifjUCjPsEm4M5W0/KjByZleBC0525/cJ9xeTxrADYp/mEYmw4CsCD38= 2022-01-10T03:36:05.684 INFO:teuthology.kill: smithi164.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/nPxv1MxvVD2Pc41zugetQkRpxovYp04g6fn88vhSyXvo9AaMe7VanqaAMvMxouks4+yInwyhFPndlE7WcJfbyi+tF937Kr/UtMor0gAZrogBJRAZ05qYIgZtw9qwZjBHg0azY2gYPIICpsOVXRF8bNxrbzQsS1GdIEZ2nmCL/dLOvk81ejDZ5lwlw0NgCDtoDTMfpRVzHPiHy4zoE3ieDzh6hryFDrLHbu0c9ClJM3aUoulASrrP4vQxih4sVjnCe/Yz7bsr8hAehvowrKZXAh+JbASbI/1oJmZcVI7pz7qVJPTD3Yb77KMCJUZjRs9POFq51zqGpT733singmtHG115ny8XicnNGOPgK30CB8wMOqpgLIZor2vsf3e3WWCjz884TEeC9T4s0YmUmbYtRCoEyT/aF7h5HyewLqS6Bvx5zGFjbycz2oNL6q1PxmQGSewvNcmHCYPRU1oIP/H/jox1Wx3nrQR+D84jTdeYISlIhlDdk28JSpmWNSSsIGc= 2022-01-10T03:36:05.710 INFO:teuthology.kill:2022-01-10 03:36:05,709.709 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-10T03:36:05.712 INFO:teuthology.kill:2022-01-10 03:36:05,712.712 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-10T03:36:05.781 INFO:teuthology.kill:2022-01-10 03:36:05,781.781 INFO:teuthology.orchestra.console:Power off smithi082 2022-01-10T03:36:05.801 INFO:teuthology.kill:2022-01-10 03:36:05,801.801 INFO:teuthology.orchestra.console:Power off smithi164 2022-01-10T03:36:14.157 INFO:teuthology.kill:2022-01-10 03:36:14,157.157 INFO:teuthology.orchestra.console:Power off for smithi082 completed 2022-01-10T03:36:14.304 INFO:teuthology.kill:2022-01-10 03:36:14,304.304 INFO:teuthology.lock.ops:unlocked: smithi082.front.sepia.ceph.com 2022-01-10T03:36:18.277 INFO:teuthology.kill:2022-01-10 03:36:18,276.276 INFO:teuthology.orchestra.console:Power off for smithi164 completed 2022-01-10T03:36:18.421 INFO:teuthology.kill:2022-01-10 03:36:18,421.421 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com 2022-01-10T03:38:18.723 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-10T03:38:18.813 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi082 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-07_13:25:03-kcephfs-nautilus-testing-default-smithi/6601287 2022-01-10T03:38:18.813 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi164 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-07_13:25:03-kcephfs-nautilus-testing-default-smithi/6601287