2022-01-08T20:23:35.040 INFO:root:teuthology version: 1.1.0-00e09f05 2022-01-08T20:23:35.174 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi068.front.sepia.ceph.com' reimaging 2022-01-08T20:23:35.175 INFO:teuthology.lock.ops:Updating [ubuntu@smithi068.front.sepia.ceph.com]: reset os type and version on server 2022-01-08T20:23:35.175 INFO:teuthology.lock.ops:Updating smithi068.front.sepia.ceph.com on lock server 2022-01-08T20:23:35.197 INFO:teuthology.lock.ops:Node 'ubuntu@smithi068.front.sepia.ceph.com' reimaging is complete 2022-01-08T20:23:35.197 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi119.front.sepia.ceph.com' reimaging 2022-01-08T20:23:35.197 INFO:teuthology.lock.ops:Updating [ubuntu@smithi119.front.sepia.ceph.com]: reset os type and version on server 2022-01-08T20:23:35.198 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2022-01-08T20:23:35.218 INFO:teuthology.lock.ops:Node 'ubuntu@smithi119.front.sepia.ceph.com' reimaging is complete 2022-01-08T20:23:35.408 INFO:teuthology.provision.fog.smithi068:Scheduling deploy of centos 8.2 2022-01-08T20:23:35.444 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 8.2 2022-01-08T20:23:35.826 INFO:teuthology.orchestra.console:Power off smithi068 2022-01-08T20:23:35.875 INFO:teuthology.orchestra.console:Power off smithi119 2022-01-08T20:23:44.219 INFO:teuthology.orchestra.console:Power off for smithi068 completed 2022-01-08T20:23:44.244 INFO:teuthology.orchestra.console:Power off for smithi119 completed 2022-01-08T20:23:44.321 INFO:teuthology.orchestra.console:Power on smithi068 2022-01-08T20:23:44.345 INFO:teuthology.orchestra.console:Power on smithi119 2022-01-08T20:23:52.702 INFO:teuthology.orchestra.console:Power on for smithi068 completed 2022-01-08T20:23:52.720 INFO:teuthology.orchestra.console:Power on for smithi119 completed 2022-01-08T20:23:52.804 INFO:teuthology.provision.fog.smithi068:Waiting for deploy to finish 2022-01-08T20:23:52.822 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2022-01-08T20:28:42.587 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-08T20:28:42.637 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-08T20:28:42.922 INFO:teuthology.provision.fog.smithi068:Node is ready 2022-01-08T20:28:42.931 INFO:teuthology.provision.fog.smithi119:Node is ready 2022-01-08T20:28:42.977 INFO:teuthology.orchestra.run.smithi068.stdout:smithi068.front.sepia.ceph.com 2022-01-08T20:28:42.986 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com 2022-01-08T20:28:43.034 INFO:teuthology.orchestra.run.smithi068.stdout:172.21.15.68 smithi068.front.sepia.ceph.com smithi068 2022-01-08T20:28:43.041 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119 2022-01-08T20:28:43.360 INFO:teuthology.provision.fog.smithi119:Deploy complete! 2022-01-08T20:28:43.362 INFO:teuthology.provision.fog.smithi068:Deploy complete! 2022-01-08T20:28:43.560 INFO:teuthology.lock.ops:Checking smithi068.front.sepia.ceph.com 2022-01-08T20:28:43.561 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-08T20:28:43.580 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com 2022-01-08T20:28:43.581 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-08T20:28:43.600 INFO:teuthology.lock.ops:Updating [smithi068.front.sepia.ceph.com]: set os type and version on server 2022-01-08T20:28:43.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi068.front.sepia.ceph.com' 2022-01-08T20:28:43.860 INFO:teuthology.orchestra.run.smithi068.stdout:x86_64 2022-01-08T20:28:43.915 INFO:teuthology.orchestra.run.smithi068.stdout:NAME="CentOS Linux" 2022-01-08T20:28:43.916 INFO:teuthology.orchestra.run.smithi068.stdout:VERSION="8 (Core)" 2022-01-08T20:28:43.916 INFO:teuthology.orchestra.run.smithi068.stdout:ID="centos" 2022-01-08T20:28:43.916 INFO:teuthology.orchestra.run.smithi068.stdout:ID_LIKE="rhel fedora" 2022-01-08T20:28:43.916 INFO:teuthology.orchestra.run.smithi068.stdout:VERSION_ID="8" 2022-01-08T20:28:43.917 INFO:teuthology.orchestra.run.smithi068.stdout:PLATFORM_ID="platform:el8" 2022-01-08T20:28:43.917 INFO:teuthology.orchestra.run.smithi068.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2022-01-08T20:28:43.917 INFO:teuthology.orchestra.run.smithi068.stdout:ANSI_COLOR="0;31" 2022-01-08T20:28:43.917 INFO:teuthology.orchestra.run.smithi068.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-08T20:28:43.918 INFO:teuthology.orchestra.run.smithi068.stdout:HOME_URL="https://www.centos.org/" 2022-01-08T20:28:43.918 INFO:teuthology.orchestra.run.smithi068.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-08T20:28:43.918 INFO:teuthology.orchestra.run.smithi068.stdout: 2022-01-08T20:28:43.918 INFO:teuthology.orchestra.run.smithi068.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-08T20:28:43.919 INFO:teuthology.orchestra.run.smithi068.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-08T20:28:43.919 INFO:teuthology.orchestra.run.smithi068.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2022-01-08T20:28:43.919 INFO:teuthology.orchestra.run.smithi068.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2022-01-08T20:28:43.919 INFO:teuthology.orchestra.run.smithi068.stdout: 2022-01-08T20:28:43.921 INFO:teuthology.lock.ops:Updating smithi068.front.sepia.ceph.com on lock server 2022-01-08T20:28:43.941 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server 2022-01-08T20:28:43.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2022-01-08T20:28:44.198 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2022-01-08T20:28:44.252 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Linux" 2022-01-08T20:28:44.252 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8 (Core)" 2022-01-08T20:28:44.252 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2022-01-08T20:28:44.253 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2022-01-08T20:28:44.253 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8" 2022-01-08T20:28:44.253 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8" 2022-01-08T20:28:44.253 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2022-01-08T20:28:44.254 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2022-01-08T20:28:44.254 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-08T20:28:44.254 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.centos.org/" 2022-01-08T20:28:44.254 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-08T20:28:44.254 INFO:teuthology.orchestra.run.smithi119.stdout: 2022-01-08T20:28:44.255 INFO:teuthology.orchestra.run.smithi119.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-08T20:28:44.255 INFO:teuthology.orchestra.run.smithi119.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-08T20:28:44.255 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2022-01-08T20:28:44.255 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2022-01-08T20:28:44.256 INFO:teuthology.orchestra.run.smithi119.stdout: 2022-01-08T20:28:44.256 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2022-01-08T20:28:44.360 INFO:teuthology.dispatcher.supervisor:Running job 6603301 2022-01-08T20:28:44.361 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_00e09f05e9fb2ab7c7f497f5e446613531743ae2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi/6603301 --name yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi/6603301/orig.config.yaml 2022-01-08T20:28:44.365 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-08_17:57:43-rados-wip-yuri8-testing-2022-01-07-1541-distro-default-smithi/6603301 2022-01-08T20:28:44.366 INFO:teuthology.dispatcher.supervisor:Job PID: 15678 2022-01-08T20:28:44.366 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-09T08:29:38.923 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-01-09T08:29:39.114 INFO:teuthology.kill:Killing Pids: {15678} 2022-01-09T08:29:40.341 INFO:teuthology.task.internal:roles: ubuntu@smithi068.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-09T08:29:40.342 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-09T08:29:40.342 INFO:teuthology.misc:Compressing logs... 2022-01-09T08:29:40.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi068.front.sepia.ceph.com' 2022-01-09T08:29:40.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2022-01-09T08:29:40.600 INFO:teuthology.orchestra.run.smithi068.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-09T08:29:40.870 INFO:teuthology.orchestra.run.smithi119.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-09T08:29:40.915 INFO:teuthology.orchestra.run.smithi068.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-09T08:29:40.915 INFO:teuthology.orchestra.run.smithi068.stderr:tar: Error is not recoverable: exiting now 2022-01-09T08:29:40.952 INFO:teuthology.orchestra.run.smithi119.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-09T08:29:40.952 INFO:teuthology.orchestra.run.smithi119.stderr:tar: Error is not recoverable: exiting now 2022-01-09T08:29:40.954 INFO:teuthology.misc:Compressing logs... 2022-01-09T08:29:41.170 INFO:teuthology.misc:Compressing logs... 2022-01-09T08:29:46.913 INFO:teuthology.orchestra.run.smithi068.stderr:gzip: /var/log/ceph/df0f8e98-70c2-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-09T08:29:48.194 INFO:teuthology.orchestra.run.smithi068.stderr:gzip: /var/log/ceph/df0f8e98-70c2-11ec-8c32-001a4aab830c/ceph-mgr.smithi068.sqfsym.log: file size changed while zipping 2022-01-09T08:29:48.497 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/df0f8e98-70c2-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-09T08:29:53.864 INFO:teuthology.orchestra.run.smithi068.stderr:gzip: /var/log/ceph/df0f8e98-70c2-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-09T08:29:54.018 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/df0f8e98-70c2-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-09T08:29:56.769 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/df0f8e98-70c2-11ec-8c32-001a4aab830c/ceph-mon.smithi119.log: file size changed while zipping 2022-01-09T08:30:01.035 INFO:teuthology.orchestra.run.smithi068.stderr:gzip: /var/log/ceph/df0f8e98-70c2-11ec-8c32-001a4aab830c/ceph-mon.smithi068.log: file size changed while zipping 2022-01-09T08:30:02.678 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/df0f8e98-70c2-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-09T08:30:07.302 INFO:teuthology.orchestra.run.smithi068.stderr:gzip: /var/log/ceph/df0f8e98-70c2-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-09T08:30:09.730 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/df0f8e98-70c2-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-09T08:30:14.830 INFO:teuthology.orchestra.run.smithi068.stderr:gzip: /var/log/ceph/df0f8e98-70c2-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-09T08:30:46.676 INFO:teuthology.kill:No teuthology processes running 2022-01-09T08:30:47.981 INFO:teuthology.kill:Nuking machines: ['smithi068', 'smithi119'] 2022-01-09T08:30:49.067 INFO:teuthology.kill:2022-01-09 08:30:49,067.067 INFO:teuthology.nuke:targets: 2022-01-09T08:30:49.068 INFO:teuthology.kill: smithi068.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPJTyykwas1isJpTBvjSSqbSN3B6T+2iRalCIScIHQbo8WynQWZ6as6CHrqweCeeqTmvr5mllqiq/9hPA1eD1VCjFGT5y3Q8wDsm5xF6u5jnUIBR26RILsrs4nz1lkfRlKZ6BbDqHGvV4C1nMAB8fleUopVhBFKmMQhSDZzckjbPKXOEVb64rI/6kc0fROM5XfMjoJSpnTkLUXYyFUfaQ7a9SDkh4Pj8Ttl16v/b72V15Of1ukjVvA1+sdJQlmQfQj6i7Zkuw5fEgFcL8m4hTAm4pLq0TbXst9hNpjkyU3w8uZpoP8c01o0CGumPrYg/kjbZe4SokKw1SaIS4hOm1HGDkr182kCxuWDiWkXoM+rS/gZVV3+n5jVlz3Wyqj3h+fQxnK4fdcElgkJvuRGswaiAEH2DoD6paKDWolj0qXAinb8vLhCY3TETltwkwZz6YckKVOEcy4vxnp2NzZQWpFIzGdcLx5CLCna45y+J4hqeTctFpWYTfDxcQ8AXONmsM= 2022-01-09T08:30:49.069 INFO:teuthology.kill: smithi119.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCuEznbrd6ytVQorQkaG2N6zk7g8ubQuKzDZmka79KX+ua0JFOfbxU9DGhvyH36szipf6bl77V8y3kWFlD0g5A71LTIYpMkAP+jq7dAhj5VqVMGpSCiiD6upB3sbciYSO7hA7h+f7CcpjtNJ5BA15OmZG3/IIsbHGwd3Vd6BBHw6wV/lLhg5DY7Wn5OeW2BkPZkMO6vh4Wz9A59f642QT+Si1VmGOI8XAPjFtP2rTyGWBeAIAZvRWJURihn5Y6XpO1gFE2KUUf7Shb6hHf7dhA4X4GvTsXxElgz3qPZ8rUeeDeMmB753jmM+BhoWQe3CT6R81A29mId8bxX+A1k9uMozY58mKFlf+golCynO1uYblQdpyeru3NQ3k+SjSQomBQepPnY4QYpjxqUNgs0+cjUva97NsrmDdQ4bSawRNCnenOzlT4HmBP28WVE195htsTPjTbbezNc3BYLybEKVHiGIbMWemSUiHVvBIjeozLFK2fYNtNaSJ85pxS//Sgq7GU= 2022-01-09T08:30:49.095 INFO:teuthology.kill:2022-01-09 08:30:49,095.095 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-09T08:30:49.098 INFO:teuthology.kill:2022-01-09 08:30:49,098.098 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-09T08:30:49.176 INFO:teuthology.kill:2022-01-09 08:30:49,176.176 INFO:teuthology.orchestra.console:Power off smithi119 2022-01-09T08:30:49.191 INFO:teuthology.kill:2022-01-09 08:30:49,191.191 INFO:teuthology.orchestra.console:Power off smithi068 2022-01-09T08:30:57.552 INFO:teuthology.kill:2022-01-09 08:30:57,552.552 INFO:teuthology.orchestra.console:Power off for smithi119 completed 2022-01-09T08:30:57.702 INFO:teuthology.kill:2022-01-09 08:30:57,701.701 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com 2022-01-09T08:31:01.672 INFO:teuthology.kill:2022-01-09 08:31:01,672.672 INFO:teuthology.orchestra.console:Power off for smithi068 completed 2022-01-09T08:31:01.817 INFO:teuthology.kill:2022-01-09 08:31:01,817.817 INFO:teuthology.lock.ops:unlocked: smithi068.front.sepia.ceph.com 2022-01-09T08:33:02.137 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-09T08:33:02.247 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi068 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-07_05:17:03-krbd-pacific-testing-default-smithi/6600870