2022-01-26T06:42:54.738 INFO:root:teuthology version: 1.1.0-7c0cb867 2022-01-26T06:42:54.879 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi119.front.sepia.ceph.com' reimaging 2022-01-26T06:42:54.881 INFO:teuthology.lock.ops:Updating [ubuntu@smithi119.front.sepia.ceph.com]: reset os type and version on server 2022-01-26T06:42:54.881 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2022-01-26T06:42:54.908 INFO:teuthology.lock.ops:Node 'ubuntu@smithi119.front.sepia.ceph.com' reimaging is complete 2022-01-26T06:42:54.908 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi123.front.sepia.ceph.com' reimaging 2022-01-26T06:42:54.909 INFO:teuthology.lock.ops:Updating [ubuntu@smithi123.front.sepia.ceph.com]: reset os type and version on server 2022-01-26T06:42:54.909 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2022-01-26T06:42:54.927 INFO:teuthology.lock.ops:Node 'ubuntu@smithi123.front.sepia.ceph.com' reimaging is complete 2022-01-26T06:42:55.118 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of centos 8.3 2022-01-26T06:42:55.121 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 8.3 2022-01-26T06:42:55.427 INFO:teuthology.orchestra.console:Power off smithi119 2022-01-26T06:42:55.442 INFO:teuthology.orchestra.console:Power off smithi123 2022-01-26T06:43:03.803 INFO:teuthology.orchestra.console:Power off for smithi119 completed 2022-01-26T06:43:03.904 INFO:teuthology.orchestra.console:Power on smithi119 2022-01-26T06:43:07.920 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2022-01-26T06:43:08.022 INFO:teuthology.orchestra.console:Power on smithi123 2022-01-26T06:43:08.159 INFO:teuthology.orchestra.console:Power on for smithi119 completed 2022-01-26T06:43:08.260 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2022-01-26T06:43:16.391 INFO:teuthology.orchestra.console:Power on for smithi123 completed 2022-01-26T06:43:16.493 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2022-01-26T06:47:14.378 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-26T06:47:29.267 INFO:teuthology.provision.fog.smithi119:Node is ready 2022-01-26T06:47:29.284 INFO:teuthology.orchestra.run.smithi119.stdout:smithi133 2022-01-26T06:47:29.338 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2022-01-26T06:47:29.693 INFO:teuthology.provision.fog.smithi119:Deploy complete! 2022-01-26T06:47:48.167 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-26T06:47:48.486 INFO:teuthology.provision.fog.smithi123:Node is ready 2022-01-26T06:47:48.504 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com 2022-01-26T06:47:48.561 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2022-01-26T06:47:48.887 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2022-01-26T06:47:49.043 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com 2022-01-26T06:47:49.044 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-26T06:47:49.064 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2022-01-26T06:47:49.065 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-26T06:47:49.085 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server 2022-01-26T06:47:49.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2022-01-26T06:47:49.356 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2022-01-26T06:47:49.411 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Linux" 2022-01-26T06:47:49.411 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8" 2022-01-26T06:47:49.411 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2022-01-26T06:47:49.412 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2022-01-26T06:47:49.412 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8" 2022-01-26T06:47:49.412 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8" 2022-01-26T06:47:49.412 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Linux 8" 2022-01-26T06:47:49.413 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2022-01-26T06:47:49.413 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-26T06:47:49.413 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2022-01-26T06:47:49.413 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-26T06:47:49.414 INFO:teuthology.orchestra.run.smithi119.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-26T06:47:49.414 INFO:teuthology.orchestra.run.smithi119.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-26T06:47:49.415 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2022-01-26T06:47:49.453 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2022-01-26T06:47:49.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2022-01-26T06:47:49.716 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2022-01-26T06:47:49.770 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Linux" 2022-01-26T06:47:49.771 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8" 2022-01-26T06:47:49.771 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2022-01-26T06:47:49.771 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2022-01-26T06:47:49.772 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8" 2022-01-26T06:47:49.772 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2022-01-26T06:47:49.772 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Linux 8" 2022-01-26T06:47:49.772 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2022-01-26T06:47:49.773 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-26T06:47:49.773 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2022-01-26T06:47:49.773 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-26T06:47:49.773 INFO:teuthology.orchestra.run.smithi123.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-26T06:47:49.774 INFO:teuthology.orchestra.run.smithi123.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-26T06:47:49.775 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2022-01-26T06:47:49.868 INFO:teuthology.dispatcher.supervisor:Running job 6641233 2022-01-26T06:47:49.869 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2022-01-26_05:20:46-orch:cephadm-wip-adk-testing-2022-01-25-2134-distro-basic-smithi/6641233 --name adking-2022-01-26_05:20:46-orch:cephadm-wip-adk-testing-2022-01-25-2134-distro-basic-smithi --description orch:cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/adking-2022-01-26_05:20:46-orch:cephadm-wip-adk-testing-2022-01-25-2134-distro-basic-smithi/6641233/orig.config.yaml 2022-01-26T06:47:49.872 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2022-01-26_05:20:46-orch:cephadm-wip-adk-testing-2022-01-25-2134-distro-basic-smithi/6641233 2022-01-26T06:47:49.873 INFO:teuthology.dispatcher.supervisor:Job PID: 9800 2022-01-26T06:47:49.873 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-26T13:18:19.882 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-26T13:18:20.065 INFO:teuthology.kill:Killing Pids: {9800} 2022-01-26T13:18:21.258 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-26T13:18:21.259 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-26T13:18:21.260 INFO:teuthology.misc:Compressing logs... 2022-01-26T13:18:21.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2022-01-26T13:18:21.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2022-01-26T13:18:21.487 INFO:teuthology.orchestra.run.smithi119.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-26T13:18:21.762 INFO:teuthology.orchestra.run.smithi123.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-26T13:18:21.793 INFO:teuthology.orchestra.run.smithi119.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-26T13:18:21.794 INFO:teuthology.orchestra.run.smithi119.stderr:tar: Error is not recoverable: exiting now 2022-01-26T13:18:21.828 INFO:teuthology.orchestra.run.smithi123.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-26T13:18:21.828 INFO:teuthology.orchestra.run.smithi123.stderr:tar: Error is not recoverable: exiting now 2022-01-26T13:18:21.829 INFO:teuthology.misc:Compressing logs... 2022-01-26T13:18:22.041 INFO:teuthology.misc:Compressing logs... 2022-01-26T13:18:25.322 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/3a71b396-7e75-11ec-8c35-001a4aab830c/ceph-mon.smithi123.log: file size changed while zipping 2022-01-26T13:18:35.970 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/3a71b396-7e75-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-26T13:18:40.496 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/3a71b396-7e75-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-26T13:18:52.208 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/3a71b396-7e75-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-26T13:18:54.264 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/3a71b396-7e75-11ec-8c35-001a4aab830c/ceph-mgr.smithi119.cvvqce.log: file size changed while zipping 2022-01-26T13:18:58.463 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/3a71b396-7e75-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-26T13:19:11.334 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/3a71b396-7e75-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-26T13:19:16.804 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/3a71b396-7e75-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-26T13:19:29.933 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/3a71b396-7e75-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-26T13:19:33.453 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/3a71b396-7e75-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-26T13:19:42.525 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/3a71b396-7e75-11ec-8c35-001a4aab830c/ceph-mon.smithi119.log: file size changed while zipping 2022-01-26T13:20:14.373 INFO:teuthology.kill:No teuthology processes running 2022-01-26T13:20:15.701 INFO:teuthology.kill:Nuking machines: ['smithi119', 'smithi123'] 2022-01-26T13:20:16.797 INFO:teuthology.kill:2022-01-26 13:20:16,797.797 INFO:teuthology.nuke:targets: 2022-01-26T13:20:16.799 INFO:teuthology.kill: smithi119.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9kyBvy4JVXrHmFmLnBVHWAxu11BvsDcw0c+dRULepxJ3xM3N1nRJfPYH/cXV7SprEBUtrkt8tDZ4F0xUeMGqsiP9iJmIVrJxwqZb5Rt/aTQaGqmPTlIE44S7t8AyMtO35ZLco35wnow5MKw7etOau+UgCVbJkQ0xJdj6tJLVHJjN1zWhsnXoWx0+7Ym7lOmTaHOjugAMQjN2htNDRH8eqR4sepVms9811TD4B1dXJ0sO2RpoS+o2bTR2xoLVE97f1mbP3frZ36QFgU+o93hk4QF4qLMcA2qpsuVDU3rFvwYHhj1SMJfm6Q4aEpJ6DfY7dsDcugciNQLl747E5F2xTjomLLYlTKtxFrRPmLV/613vMw2+MSbepxclS/4yITcGdr4VTPT8QKNOhSo6cfoMVQz7B9x+SWiMiScOZndq5NcA1UfIc7Rxa8qdSpTzpP9HZ3cTwM8WiwvvrbVa9khgtE+kS7N5bLsaANF5s+Q4yyD7suYv29uEsjxtrC+mg5XE= 2022-01-26T13:20:16.799 INFO:teuthology.kill: smithi123.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDE+MbJgowfSw6sA6BM+oSw8sfEGmyRm8bjtLQS3Gc+W5Tb4Nws1Nj0KuaaIuGVMgLP8vBzNylhUo3VtK7XLKYKLN1lbYhcJhJ2rnAtnNFISjXND++HhqsMHdtZM6u4yqG+99hZJB1Xz36jmNAMGTm9BYb2mTH2KKrfOe3CCGihNycfsL3jmIN7fLUAX1TrwW4rpM0nYTdgDVu9L/ksUA0oONn8BN77e2nNtjPD5rSKNbRMToKIBq8+C9wZQcLJOInDU/CfPzr2gC+gLB0U9+/TD8xUNXAuxZnZDJ+eWcko+lj5Vlg6T5bTasP6UIGqWYEIL3OBOkoHnRoHPutwSz/MAzVmfPxHSw8N/+JQGXtUhKAw4jy/Y/zw90th40TKZjvs2z/rJE07lglySSmztKCSA37PRPxCxLpOgcNS8zaSRd9U52Vj3QrsXZDrv7un5GpYRbBJzVqVzHccDzHZgKv5UnvXZBK9WgGBWbFTclXB0oCE90W8jeNICImXEa+ur1k= 2022-01-26T13:20:16.827 INFO:teuthology.kill:2022-01-26 13:20:16,827.827 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-26T13:20:16.831 INFO:teuthology.kill:2022-01-26 13:20:16,831.831 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-26T13:20:16.910 INFO:teuthology.kill:2022-01-26 13:20:16,910.910 INFO:teuthology.orchestra.console:Power off smithi119 2022-01-26T13:20:16.928 INFO:teuthology.kill:2022-01-26 13:20:16,927.927 INFO:teuthology.orchestra.console:Power off smithi123 2022-01-26T13:20:25.307 INFO:teuthology.kill:2022-01-26 13:20:25,306.306 INFO:teuthology.orchestra.console:Power off for smithi119 completed 2022-01-26T13:20:25.312 INFO:teuthology.kill:2022-01-26 13:20:25,312.312 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2022-01-26T13:20:25.460 INFO:teuthology.kill:2022-01-26 13:20:25,459.459 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com 2022-01-26T13:20:25.463 INFO:teuthology.kill:2022-01-26 13:20:25,463.463 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com 2022-01-26T13:22:25.798 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-26T13:22:25.939 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi119 but it was locked by another job: /home/teuthworker/archive/gabrioux-2022-01-26_13:07:05-orch:cephadm-wip-guits-testing-2022-01-26-0910-distro-default-smithi/6641422 2022-01-26T13:22:25.940 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi123 but it was locked by another job: /home/teuthworker/archive/gabrioux-2022-01-26_13:07:05-orch:cephadm-wip-guits-testing-2022-01-26-0910-distro-default-smithi/6641422