2021-11-02T17:44:35.791 INFO:root:teuthology version: 1.1.0-c56135d1 2021-11-02T17:44:35.922 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi082.front.sepia.ceph.com' reimaging 2021-11-02T17:44:35.923 INFO:teuthology.lock.ops:Updating [ubuntu@smithi082.front.sepia.ceph.com]: reset os type and version on server 2021-11-02T17:44:35.923 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2021-11-02T17:44:35.944 INFO:teuthology.lock.ops:Node 'ubuntu@smithi082.front.sepia.ceph.com' reimaging is complete 2021-11-02T17:44:35.944 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi131.front.sepia.ceph.com' reimaging 2021-11-02T17:44:35.945 INFO:teuthology.lock.ops:Updating [ubuntu@smithi131.front.sepia.ceph.com]: reset os type and version on server 2021-11-02T17:44:35.945 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2021-11-02T17:44:35.968 INFO:teuthology.lock.ops:Node 'ubuntu@smithi131.front.sepia.ceph.com' reimaging is complete 2021-11-02T17:44:36.164 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of centos 8.2 2021-11-02T17:44:36.170 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of centos 8.2 2021-11-02T17:44:36.488 INFO:teuthology.orchestra.console:Power off smithi131 2021-11-02T17:44:36.505 INFO:teuthology.orchestra.console:Power off smithi082 2021-11-02T17:44:44.864 INFO:teuthology.orchestra.console:Power off for smithi131 completed 2021-11-02T17:44:44.870 INFO:teuthology.orchestra.console:Power off for smithi082 completed 2021-11-02T17:44:44.965 INFO:teuthology.orchestra.console:Power on smithi131 2021-11-02T17:44:44.975 INFO:teuthology.orchestra.console:Power on smithi082 2021-11-02T17:44:53.336 INFO:teuthology.orchestra.console:Power on for smithi131 completed 2021-11-02T17:44:53.341 INFO:teuthology.orchestra.console:Power on for smithi082 completed 2021-11-02T17:44:53.438 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish 2021-11-02T17:44:53.442 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish 2021-11-02T17:49:43.180 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-02T17:49:43.197 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-02T17:49:43.500 INFO:teuthology.provision.fog.smithi082:Node is ready 2021-11-02T17:49:43.516 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082.front.sepia.ceph.com 2021-11-02T17:49:43.549 INFO:teuthology.provision.fog.smithi131:Node is ready 2021-11-02T17:49:43.563 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com 2021-11-02T17:49:43.571 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82 smithi082.front.sepia.ceph.com smithi082 2021-11-02T17:49:43.618 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131 2021-11-02T17:49:43.894 INFO:teuthology.provision.fog.smithi082:Deploy complete! 2021-11-02T17:49:43.938 INFO:teuthology.provision.fog.smithi131:Deploy complete! 2021-11-02T17:49:44.080 INFO:teuthology.lock.ops:Checking smithi082.front.sepia.ceph.com 2021-11-02T17:49:44.081 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-02T17:49:44.102 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com 2021-11-02T17:49:44.102 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-02T17:49:44.118 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: set os type and version on server 2021-11-02T17:49:44.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2021-11-02T17:49:44.374 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2021-11-02T17:49:44.427 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Linux" 2021-11-02T17:49:44.427 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8 (Core)" 2021-11-02T17:49:44.428 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2021-11-02T17:49:44.428 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2021-11-02T17:49:44.428 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8" 2021-11-02T17:49:44.428 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2021-11-02T17:49:44.429 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-11-02T17:49:44.429 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2021-11-02T17:49:44.429 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-02T17:49:44.429 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.centos.org/" 2021-11-02T17:49:44.429 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-11-02T17:49:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: 2021-11-02T17:49:44.430 INFO:teuthology.orchestra.run.smithi082.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-11-02T17:49:44.430 INFO:teuthology.orchestra.run.smithi082.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-11-02T17:49:44.430 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-11-02T17:49:44.431 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-11-02T17:49:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: 2021-11-02T17:49:44.432 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2021-11-02T17:49:44.450 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server 2021-11-02T17:49:44.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2021-11-02T17:49:44.701 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2021-11-02T17:49:44.755 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Linux" 2021-11-02T17:49:44.755 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8 (Core)" 2021-11-02T17:49:44.755 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2021-11-02T17:49:44.756 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2021-11-02T17:49:44.756 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8" 2021-11-02T17:49:44.756 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2021-11-02T17:49:44.756 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-11-02T17:49:44.757 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2021-11-02T17:49:44.757 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-02T17:49:44.757 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.centos.org/" 2021-11-02T17:49:44.757 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-11-02T17:49:44.757 INFO:teuthology.orchestra.run.smithi131.stdout: 2021-11-02T17:49:44.758 INFO:teuthology.orchestra.run.smithi131.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-11-02T17:49:44.758 INFO:teuthology.orchestra.run.smithi131.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-11-02T17:49:44.758 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-11-02T17:49:44.758 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-11-02T17:49:44.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2021-11-02T17:49:44.759 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2021-11-02T17:49:44.846 INFO:teuthology.dispatcher.supervisor:Running job 6477841 2021-11-02T17:49:44.847 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology -v --owner scheduled_swagner@teuthology --archive /home/teuthworker/archive/swagner-2021-11-02_13:16:45-orch:cephadm-wip-swagner-testing-2021-11-02-1007-distro-basic-smithi/6477841 --name swagner-2021-11-02_13:16:45-orch:cephadm-wip-swagner-testing-2021-11-02-1007-distro-basic-smithi --description orch:cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} -- /home/teuthworker/archive/swagner-2021-11-02_13:16:45-orch:cephadm-wip-swagner-testing-2021-11-02-1007-distro-basic-smithi/6477841/orig.config.yaml 2021-11-02T17:49:44.850 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/swagner-2021-11-02_13:16:45-orch:cephadm-wip-swagner-testing-2021-11-02-1007-distro-basic-smithi/6477841 2021-11-02T17:49:44.851 INFO:teuthology.dispatcher.supervisor:Job PID: 12519 2021-11-02T17:49:44.851 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-11-03T05:50:39.391 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-11-03T05:50:39.579 INFO:teuthology.kill:Killing Pids: {12519} 2021-11-03T05:50:40.791 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['host.a', 'client.0'] 2021-11-03T05:50:40.792 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['host.b', 'client.1'] 2021-11-03T05:50:40.792 INFO:teuthology.misc:Compressing logs... 2021-11-03T05:50:40.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2021-11-03T05:50:41.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2021-11-03T05:50:41.049 INFO:teuthology.orchestra.run.smithi082.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2021-11-03T05:50:41.312 INFO:teuthology.orchestra.run.smithi131.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2021-11-03T05:50:41.346 INFO:teuthology.orchestra.run.smithi082.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2021-11-03T05:50:41.346 INFO:teuthology.orchestra.run.smithi082.stderr:tar: Error is not recoverable: exiting now 2021-11-03T05:50:41.377 INFO:teuthology.orchestra.run.smithi131.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2021-11-03T05:50:41.377 INFO:teuthology.orchestra.run.smithi131.stderr:tar: Error is not recoverable: exiting now 2021-11-03T05:50:41.378 INFO:teuthology.misc:Compressing logs... 2021-11-03T05:50:41.548 INFO:teuthology.misc:Compressing logs... 2021-11-03T05:50:42.035 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/cephadm.log: file size changed while zipping 2021-11-03T05:50:42.401 INFO:teuthology.orchestra.run.smithi082.stderr:tar: .: file changed as we read it 2021-11-03T05:50:42.545 INFO:teuthology.kill:No teuthology processes running 2021-11-03T05:50:43.756 INFO:teuthology.kill:Nuking machines: ['smithi082', 'smithi131'] 2021-11-03T05:50:44.739 INFO:teuthology.kill:2021-11-03 05:50:44,738.738 INFO:teuthology.nuke:targets: 2021-11-03T05:50:44.740 INFO:teuthology.kill: smithi082.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYhLsaJ7RGG0Cui4e4THhhlHbTm5aMRe6dRlT0pSF3XJ6shYhdqCEFIQr89mBBOZcPK4rJZb2vvm5MfOU0KwtwML2JL3WKZTeDGArr5lNGjLUPB0Ef1umDYUNwUTb3IdnDP61+4A9+HIj60GzM7I+umqdLp86oEraqqlcTjim1GksZjpPa1QorsbUj/ZWz5kQDQ4ZGGyB9A3majQLr4XDKAbZoS2wOC5e9x4SVZ97HNUQGwZ7rcCXNV2lQM9uF/Q1/wAiTAuzTexsvmdoAuArsV33LMsWYqnTjd7cQ+/1Eso9kaRAoN5P01aQCaEmL1CGzfv+Z84+kDyvII1Qm9y5Tp2l3Cz+II/JHRnpzCPmah3pQCaea11k3wEkRSQt6LaI2FDq6n1OCgTE7v40LCVVZMFEOs5ghzg+AcXvKuW0lP7V/i7kOsUt2yQqqO545fWNUeyeHg/ONdGVD/PPkVoSMXsPsNHpdXyuNW+yqR/DROeQuhrgJXP1R9rYVWUttcWE= 2021-11-03T05:50:44.741 INFO:teuthology.kill: smithi131.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvpuG9G3Kkj6bI5K49TIWour+5FdsvCKbf1dUm6yspy4Mv51xw+UV1TO0Yl39veLVz5p1ff/aMlDMwyi6udakVFx9B4N1Tk2R7uRmg3hqeOFgZUpveHJzDBsCHSDEog62RQmF0EiMJvzg0xmlIC5mddhMSUZB3GZvGJoYME6Ncfa8YrazrVOnSj9+mRTQ3spndHXf2zEkDtKZb3vD3+QVIN2oCXg02L6r7KK0qe2nSD5DS/8ErqJActM+6ZaqefJ2GBPobGZ2bCEfJyGyDXPyCwbq8TmRPkFo51Px6gm4lYXaGlWvTM9FnIKkBA5i2nYFURRKRIlTAkbCXacEcPfZHJ7WaOw+0M8uXzKC0DZghjQR9aFlatHa7AB173GWbEWwAOQbg8YxVgwAkeqbui5ioBsC648ctPN3TrMewTvQJ0fmzanWotCMSBAhJO2o/B7tDgHrHRx5QmNDyQ6E2KhZ8tPaNvvb/b4fPRoaVjW55WRALx4729IIpJsMWwh4mmoU= 2021-11-03T05:50:44.766 INFO:teuthology.kill:2021-11-03 05:50:44,766.766 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-03T05:50:44.777 INFO:teuthology.kill:2021-11-03 05:50:44,776.776 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-03T05:50:44.844 INFO:teuthology.kill:2021-11-03 05:50:44,844.844 INFO:teuthology.orchestra.console:Power off smithi082 2021-11-03T05:50:44.858 INFO:teuthology.kill:2021-11-03 05:50:44,858.858 INFO:teuthology.orchestra.console:Power off smithi131 2021-11-03T05:50:53.221 INFO:teuthology.kill:2021-11-03 05:50:53,221.221 INFO:teuthology.orchestra.console:Power off for smithi082 completed 2021-11-03T05:50:53.235 INFO:teuthology.kill:2021-11-03 05:50:53,234.234 INFO:teuthology.orchestra.console:Power off for smithi131 completed 2021-11-03T05:50:53.377 INFO:teuthology.kill:2021-11-03 05:50:53,376.376 INFO:teuthology.lock.ops:unlocked: smithi082.front.sepia.ceph.com 2021-11-03T05:50:53.390 INFO:teuthology.kill:2021-11-03 05:50:53,390.390 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com 2021-11-03T05:52:53.704 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-11-03T05:52:53.785 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi082 but it was locked by another job: /home/teuthworker/archive/pdonnell-2021-11-03_05:35:37-fs-wip-pdonnell-testing-20211103.023355-distro-basic-smithi/6480060 2021-11-03T05:52:53.786 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi131 but it was locked by another job: /home/teuthworker/archive/pdonnell-2021-11-03_05:35:37-fs-wip-pdonnell-testing-20211103.023355-distro-basic-smithi/6480060