2022-01-18T15:54:27.710 INFO:root:teuthology version: 1.1.0-3ff86a5d 2022-01-18T15:54:27.833 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi002.front.sepia.ceph.com' reimaging 2022-01-18T15:54:27.834 INFO:teuthology.lock.ops:Updating [ubuntu@smithi002.front.sepia.ceph.com]: reset os type and version on server 2022-01-18T15:54:27.834 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2022-01-18T15:54:27.853 INFO:teuthology.lock.ops:Node 'ubuntu@smithi002.front.sepia.ceph.com' reimaging is complete 2022-01-18T15:54:27.854 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi022.front.sepia.ceph.com' reimaging 2022-01-18T15:54:27.854 INFO:teuthology.lock.ops:Updating [ubuntu@smithi022.front.sepia.ceph.com]: reset os type and version on server 2022-01-18T15:54:27.855 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2022-01-18T15:54:27.876 INFO:teuthology.lock.ops:Node 'ubuntu@smithi022.front.sepia.ceph.com' reimaging is complete 2022-01-18T15:54:28.091 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of centos 8.2 2022-01-18T15:54:28.097 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of centos 8.2 2022-01-18T15:54:28.525 INFO:teuthology.orchestra.console:Power off smithi022 2022-01-18T15:54:28.544 INFO:teuthology.orchestra.console:Power off smithi002 2022-01-18T15:54:36.897 INFO:teuthology.orchestra.console:Power off for smithi022 completed 2022-01-18T15:54:36.905 INFO:teuthology.orchestra.console:Power off for smithi002 completed 2022-01-18T15:54:37.000 INFO:teuthology.orchestra.console:Power on smithi022 2022-01-18T15:54:37.008 INFO:teuthology.orchestra.console:Power on smithi002 2022-01-18T15:54:45.368 INFO:teuthology.orchestra.console:Power on for smithi022 completed 2022-01-18T15:54:45.374 INFO:teuthology.orchestra.console:Power on for smithi002 completed 2022-01-18T15:54:45.470 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2022-01-18T15:54:45.475 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish 2022-01-18T15:58:27.355 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-18T15:58:28.892 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-18T15:58:42.569 INFO:teuthology.provision.fog.smithi002:Node is ready 2022-01-18T15:58:42.589 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com 2022-01-18T15:58:42.646 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002 2022-01-18T15:58:43.008 INFO:teuthology.provision.fog.smithi002:Deploy complete! 2022-01-18T15:58:44.273 INFO:teuthology.provision.fog.smithi022:Node is ready 2022-01-18T15:58:44.292 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2022-01-18T15:58:44.350 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2022-01-18T15:58:44.717 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2022-01-18T15:58:44.871 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com 2022-01-18T15:58:44.872 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-18T15:58:44.893 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2022-01-18T15:58:44.894 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-18T15:58:44.912 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server 2022-01-18T15:58:44.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2022-01-18T15:58:45.185 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2022-01-18T15:58:45.240 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Linux" 2022-01-18T15:58:45.240 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8 (Core)" 2022-01-18T15:58:45.241 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2022-01-18T15:58:45.241 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2022-01-18T15:58:45.241 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8" 2022-01-18T15:58:45.241 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8" 2022-01-18T15:58:45.242 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2022-01-18T15:58:45.242 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2022-01-18T15:58:45.242 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-18T15:58:45.242 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.centos.org/" 2022-01-18T15:58:45.243 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-18T15:58:45.243 INFO:teuthology.orchestra.run.smithi002.stdout: 2022-01-18T15:58:45.243 INFO:teuthology.orchestra.run.smithi002.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-18T15:58:45.243 INFO:teuthology.orchestra.run.smithi002.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-18T15:58:45.244 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2022-01-18T15:58:45.244 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2022-01-18T15:58:45.244 INFO:teuthology.orchestra.run.smithi002.stdout: 2022-01-18T15:58:45.245 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2022-01-18T15:58:45.263 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2022-01-18T15:58:45.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2022-01-18T15:58:45.537 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2022-01-18T15:58:45.592 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Linux" 2022-01-18T15:58:45.593 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8 (Core)" 2022-01-18T15:58:45.593 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2022-01-18T15:58:45.593 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2022-01-18T15:58:45.594 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8" 2022-01-18T15:58:45.594 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2022-01-18T15:58:45.594 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2022-01-18T15:58:45.594 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2022-01-18T15:58:45.595 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-18T15:58:45.595 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.centos.org/" 2022-01-18T15:58:45.595 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-18T15:58:45.595 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-01-18T15:58:45.596 INFO:teuthology.orchestra.run.smithi022.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-18T15:58:45.596 INFO:teuthology.orchestra.run.smithi022.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-18T15:58:45.596 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2022-01-18T15:58:45.596 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2022-01-18T15:58:45.597 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-01-18T15:58:45.597 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2022-01-18T15:58:45.693 INFO:teuthology.dispatcher.supervisor:Running job 6624240 2022-01-18T15:58:45.694 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_swagner@teuthology --archive /home/teuthworker/archive/swagner-2022-01-18_15:34:53-rados:cephadm-wip-swagner2-testing-2022-01-18-1242-pacific-distro-default-smithi/6624240 --name swagner-2022-01-18_15:34:53-rados:cephadm-wip-swagner2-testing-2022-01-18-1242-pacific-distro-default-smithi --description rados:cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/swagner-2022-01-18_15:34:53-rados:cephadm-wip-swagner2-testing-2022-01-18-1242-pacific-distro-default-smithi/6624240/orig.config.yaml 2022-01-18T15:58:45.697 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/swagner-2022-01-18_15:34:53-rados:cephadm-wip-swagner2-testing-2022-01-18-1242-pacific-distro-default-smithi/6624240 2022-01-18T15:58:45.698 INFO:teuthology.dispatcher.supervisor:Job PID: 20742 2022-01-18T15:58:45.698 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-18T22:29:14.769 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-18T22:29:14.945 INFO:teuthology.kill:Killing Pids: {20742} 2022-01-18T22:29:16.141 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-18T22:29:16.142 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-18T22:29:16.143 INFO:teuthology.misc:Compressing logs... 2022-01-18T22:29:16.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2022-01-18T22:29:16.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2022-01-18T22:29:16.402 INFO:teuthology.orchestra.run.smithi002.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-18T22:29:16.673 INFO:teuthology.orchestra.run.smithi022.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-18T22:29:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-18T22:29:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:tar: Error is not recoverable: exiting now 2022-01-18T22:29:16.735 INFO:teuthology.orchestra.run.smithi022.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-18T22:29:16.736 INFO:teuthology.orchestra.run.smithi022.stderr:tar: Error is not recoverable: exiting now 2022-01-18T22:29:16.737 INFO:teuthology.misc:Compressing logs... 2022-01-18T22:29:16.991 INFO:teuthology.misc:Compressing logs... 2022-01-18T22:29:24.342 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/db80984a-7878-11ec-8c34-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-18T22:29:26.216 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/db80984a-7878-11ec-8c34-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-18T22:29:28.371 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/db80984a-7878-11ec-8c34-001a4aab830c/ceph-mgr.smithi002.spbttc.log: file size changed while zipping 2022-01-18T22:29:33.307 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/db80984a-7878-11ec-8c34-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-18T22:29:38.004 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/db80984a-7878-11ec-8c34-001a4aab830c/ceph-mon.smithi002.log: file size changed while zipping 2022-01-18T22:29:40.834 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/db80984a-7878-11ec-8c34-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-18T22:29:44.525 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/db80984a-7878-11ec-8c34-001a4aab830c/ceph-mon.smithi022.log: file size changed while zipping 2022-01-18T22:29:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/db80984a-7878-11ec-8c34-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-18T22:29:53.648 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/db80984a-7878-11ec-8c34-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-18T22:29:53.667 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/db80984a-7878-11ec-8c34-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-18T22:30:03.368 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/db80984a-7878-11ec-8c34-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-18T22:30:20.371 INFO:teuthology.kill:No teuthology processes running 2022-01-18T22:30:21.493 INFO:teuthology.kill:Nuking machines: ['smithi002', 'smithi022'] 2022-01-18T22:30:22.495 INFO:teuthology.kill:2022-01-18 22:30:22,495.495 INFO:teuthology.nuke:targets: 2022-01-18T22:30:22.496 INFO:teuthology.kill: smithi002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAyWzensjHxDWUjWpdlYmniNFqMtBOMnr8DWCX9zxjZc2W/b4kzocYbjyI8ZW343b5kW2qF4X1HUHsVWOXU2k6Q0Di8UKryojYhPsr432LXjrCyISSVI2OZQu1m05DaZWd2G70EEuMHLtmNiZDjZ2qMj9RjjsDEWibBpTuYuKnt23A81lH8R5TsCMHKdK9fIJmOaOMpx6+IG2bi4s5jtZPOs0KCKIW1jstIAeUJ2B566A8KWFU0Yhh39uBd4quP8AyCj4RqGYmwWi3XFhnohntL/vnhQNk6Zp2fBvS++iyE2mgmuDyUGvR8NfRPR2O0mXzP36TOTZ7KJSampelGNVbN609RyeHjqo0cByJ9JoLJOp3LhKBI/x6WSskvUGN0ajECRMPi1WPqQCNcNvXE8AQdnRwNJmxq2kzNa3M4YvM0AeNW3b/X8HYMDGikqHo8Gh96pntNtiMyUaaNa627rbbejBB9MjEtdmiKyfaKb27pFkhRXN8v5VhgMePbzPEOb0= 2022-01-18T22:30:22.497 INFO:teuthology.kill: smithi022.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4zJKNKl4KyAS8kD8Tq4Ln3x9ItMAW8o+wKSciX/B4Zjv7D/Zz+gPpoEtEVthdgoFWTijimtsFXCA3d4FWIJhdYBwieYYsmkjV3CHFXWVC0pAuNFB7MEKbKHICs4Bnt5E+rPXhSAaIlyCgiHpNzdPsjObKR0/p1LLyuT5eoqUBXjw8PINKqhKZjXVN3naNfQZxtTxbTo6cVoQXsUCjcYJOYsJTGIrMNODrhM5ufOWxzBTbMD8fvRiAFtZHkwkHG08T86biP8wCOQBMoUhpPBJN8vLmBf2GQ1a6+vppzaqAGJ1ESRAWdfTQIJch+vJsVEEH/ToODLIz5+7Pj5603Wenb31EVbnpPzrOPmJIbAyXQfnapKnsmvoyvF7KRasQ7YoxaedRSd9Aon9T3v+qE56PzkbhRfVnOrLkWmH5c/GxKBQykSmngfrORAwpLcCYA2DfaZtTn91PjaTN3yN4HEdx0J8JfJPfwqBAGy6HeIvKDheElCV5Ne+2cTneYeYPAwM= 2022-01-18T22:30:22.523 INFO:teuthology.kill:2022-01-18 22:30:22,523.523 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-18T22:30:22.526 INFO:teuthology.kill:2022-01-18 22:30:22,526.526 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-18T22:30:22.599 INFO:teuthology.kill:2022-01-18 22:30:22,599.599 INFO:teuthology.orchestra.console:Power off smithi022 2022-01-18T22:30:22.612 INFO:teuthology.kill:2022-01-18 22:30:22,612.612 INFO:teuthology.orchestra.console:Power off smithi002 2022-01-18T22:30:30.974 INFO:teuthology.kill:2022-01-18 22:30:30,974.974 INFO:teuthology.orchestra.console:Power off for smithi022 completed 2022-01-18T22:30:30.978 INFO:teuthology.kill:2022-01-18 22:30:30,978.978 INFO:teuthology.orchestra.console:Power off for smithi002 completed 2022-01-18T22:30:31.124 INFO:teuthology.kill:2022-01-18 22:30:31,123.123 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com 2022-01-18T22:30:31.127 INFO:teuthology.kill:2022-01-18 22:30:31,127.127 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com 2022-01-18T22:32:31.446 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-18T22:32:31.559 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi002 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-18_17:49:50-rbd-wip-yuri3-testing-2022-01-18-0829-octopus-distro-default-smithi/6624680