2022-01-06T22:02:41.083 INFO:root:teuthology version: 1.1.0-95a7d479 2022-01-06T22:02:41.273 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi137.front.sepia.ceph.com' reimaging 2022-01-06T22:02:41.274 INFO:teuthology.lock.ops:Updating [ubuntu@smithi137.front.sepia.ceph.com]: reset os type and version on server 2022-01-06T22:02:41.275 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2022-01-06T22:02:41.298 INFO:teuthology.lock.ops:Node 'ubuntu@smithi137.front.sepia.ceph.com' reimaging is complete 2022-01-06T22:02:41.299 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi154.front.sepia.ceph.com' reimaging 2022-01-06T22:02:41.299 INFO:teuthology.lock.ops:Updating [ubuntu@smithi154.front.sepia.ceph.com]: reset os type and version on server 2022-01-06T22:02:41.299 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2022-01-06T22:02:41.319 INFO:teuthology.lock.ops:Node 'ubuntu@smithi154.front.sepia.ceph.com' reimaging is complete 2022-01-06T22:02:41.530 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of centos 8.2 2022-01-06T22:02:41.533 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 8.2 2022-01-06T22:02:41.952 INFO:teuthology.orchestra.console:Power off smithi137 2022-01-06T22:02:41.994 INFO:teuthology.orchestra.console:Power off smithi154 2022-01-06T22:02:54.441 INFO:teuthology.orchestra.console:Power off for smithi137 completed 2022-01-06T22:02:54.466 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2022-01-06T22:02:54.543 INFO:teuthology.orchestra.console:Power on smithi137 2022-01-06T22:02:54.573 INFO:teuthology.orchestra.console:Power on smithi154 2022-01-06T22:02:58.825 INFO:teuthology.orchestra.console:Power on for smithi154 completed 2022-01-06T22:02:58.926 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2022-01-06T22:03:02.907 INFO:teuthology.orchestra.console:Power on for smithi137 completed 2022-01-06T22:03:03.009 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish 2022-01-06T22:07:53.250 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-06T22:07:53.522 INFO:teuthology.provision.fog.smithi137:Node is ready 2022-01-06T22:07:53.577 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137.front.sepia.ceph.com 2022-01-06T22:07:53.632 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137 2022-01-06T22:07:53.951 INFO:teuthology.provision.fog.smithi137:Deploy complete! 2022-01-06T22:08:04.562 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-06T22:08:04.876 INFO:teuthology.provision.fog.smithi154:Node is ready 2022-01-06T22:08:04.891 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com 2022-01-06T22:08:04.949 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2022-01-06T22:08:05.273 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2022-01-06T22:08:05.418 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com 2022-01-06T22:08:05.421 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-06T22:08:05.448 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com 2022-01-06T22:08:05.448 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-06T22:08:05.468 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server 2022-01-06T22:08:05.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2022-01-06T22:08:05.735 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2022-01-06T22:08:05.789 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Linux" 2022-01-06T22:08:05.789 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8 (Core)" 2022-01-06T22:08:05.790 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2022-01-06T22:08:05.790 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2022-01-06T22:08:05.790 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8" 2022-01-06T22:08:05.791 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8" 2022-01-06T22:08:05.791 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2022-01-06T22:08:05.791 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2022-01-06T22:08:05.791 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-06T22:08:05.792 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.centos.org/" 2022-01-06T22:08:05.792 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-06T22:08:05.792 INFO:teuthology.orchestra.run.smithi137.stdout: 2022-01-06T22:08:05.792 INFO:teuthology.orchestra.run.smithi137.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-06T22:08:05.792 INFO:teuthology.orchestra.run.smithi137.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-06T22:08:05.793 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2022-01-06T22:08:05.793 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2022-01-06T22:08:05.793 INFO:teuthology.orchestra.run.smithi137.stdout: 2022-01-06T22:08:05.794 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2022-01-06T22:08:05.812 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server 2022-01-06T22:08:05.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2022-01-06T22:08:06.012 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2022-01-06T22:08:06.066 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Linux" 2022-01-06T22:08:06.067 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8 (Core)" 2022-01-06T22:08:06.067 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2022-01-06T22:08:06.067 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2022-01-06T22:08:06.067 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8" 2022-01-06T22:08:06.067 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2022-01-06T22:08:06.068 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2022-01-06T22:08:06.068 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2022-01-06T22:08:06.068 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-06T22:08:06.068 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.centos.org/" 2022-01-06T22:08:06.069 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-06T22:08:06.069 INFO:teuthology.orchestra.run.smithi154.stdout: 2022-01-06T22:08:06.069 INFO:teuthology.orchestra.run.smithi154.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-06T22:08:06.069 INFO:teuthology.orchestra.run.smithi154.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-06T22:08:06.070 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2022-01-06T22:08:06.070 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2022-01-06T22:08:06.070 INFO:teuthology.orchestra.run.smithi154.stdout: 2022-01-06T22:08:06.071 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2022-01-06T22:08:06.165 INFO:teuthology.dispatcher.supervisor:Running job 6599082 2022-01-06T22:08:06.165 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-06_15:50:38-rados-wip-yuri8-testing-2022-01-05-1411-distro-default-smithi/6599082 --name yuriw-2022-01-06_15:50:38-rados-wip-yuri8-testing-2022-01-05-1411-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/yuriw-2022-01-06_15:50:38-rados-wip-yuri8-testing-2022-01-05-1411-distro-default-smithi/6599082/orig.config.yaml 2022-01-06T22:08:06.168 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-06_15:50:38-rados-wip-yuri8-testing-2022-01-05-1411-distro-default-smithi/6599082 2022-01-06T22:08:06.169 INFO:teuthology.dispatcher.supervisor:Job PID: 31132 2022-01-06T22:08:06.169 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-07T10:09:00.823 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-01-07T10:09:01.038 INFO:teuthology.kill:Killing Pids: {31132} 2022-01-07T10:09:02.234 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-07T10:09:02.235 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-07T10:09:02.235 INFO:teuthology.misc:Compressing logs... 2022-01-07T10:09:02.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2022-01-07T10:09:02.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2022-01-07T10:09:02.493 INFO:teuthology.orchestra.run.smithi137.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-07T10:09:02.756 INFO:teuthology.orchestra.run.smithi154.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-07T10:09:02.802 INFO:teuthology.orchestra.run.smithi137.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-07T10:09:02.803 INFO:teuthology.orchestra.run.smithi137.stderr:tar: Error is not recoverable: exiting now 2022-01-07T10:09:02.837 INFO:teuthology.orchestra.run.smithi154.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-07T10:09:02.837 INFO:teuthology.orchestra.run.smithi154.stderr:tar: Error is not recoverable: exiting now 2022-01-07T10:09:02.839 INFO:teuthology.misc:Compressing logs... 2022-01-07T10:09:03.072 INFO:teuthology.misc:Compressing logs... 2022-01-07T10:09:10.415 INFO:teuthology.orchestra.run.smithi137.stderr:gzip: /var/log/ceph/6ffb065c-6f3e-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-07T10:09:12.999 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/6ffb065c-6f3e-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-07T10:09:17.672 INFO:teuthology.orchestra.run.smithi137.stderr:gzip: /var/log/ceph/6ffb065c-6f3e-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-07T10:09:20.525 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/6ffb065c-6f3e-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-07T10:09:24.269 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/6ffb065c-6f3e-11ec-8c32-001a4aab830c/ceph-mon.smithi154.log: file size changed while zipping 2022-01-07T10:09:26.767 INFO:teuthology.orchestra.run.smithi137.stderr:gzip: /var/log/ceph/6ffb065c-6f3e-11ec-8c32-001a4aab830c/ceph-mon.smithi137.log: file size changed while zipping 2022-01-07T10:09:28.444 INFO:teuthology.orchestra.run.smithi137.stderr:gzip: /var/log/ceph/6ffb065c-6f3e-11ec-8c32-001a4aab830c/ceph-mgr.smithi137.xmrfxh.log: file size changed while zipping 2022-01-07T10:09:32.253 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/6ffb065c-6f3e-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-07T10:09:36.508 INFO:teuthology.orchestra.run.smithi137.stderr:gzip: /var/log/ceph/6ffb065c-6f3e-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-07T10:09:41.834 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/6ffb065c-6f3e-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-07T10:09:46.223 INFO:teuthology.orchestra.run.smithi137.stderr:gzip: /var/log/ceph/6ffb065c-6f3e-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-07T10:10:17.372 INFO:teuthology.kill:No teuthology processes running 2022-01-07T10:10:18.519 INFO:teuthology.kill:Nuking machines: ['smithi137', 'smithi154'] 2022-01-07T10:10:19.514 INFO:teuthology.kill:2022-01-07 10:10:19,514.514 INFO:teuthology.nuke:targets: 2022-01-07T10:10:19.515 INFO:teuthology.kill: smithi137.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxC8fHrQ3mlkGFC+xULpL9DBNhII4baeJv9aNVu6zCf+tIFbnTCqQ/+Wg80qn7okbtFWJrXciHPm2FnmIrYSKCBauvkZ1oSh2s1nfJSWWE1tzJzxJtqCPGrUes24qx8TIw/pFY+G/m0b91zDCR0U2RgQEqvq/mKCHl1rbN19Hw4W0e91Y4YyPR+l+mwc7Uc1yP3VpnGhn6B7B6ixZs5M75C1pnW4knmK6VI0SUI2IBCNTjv2MtL+T0x0MuxsywiQlBi+/IgtC5sp5kZbGZD2QXDw8fQBhCm4PxjLgnM6gfNfKPoJz45vn5eD73EKg6GT0yBElmc5985NaMqXE2n616AH5hQfLZ1Pm2K2wG/O/ON0TMD6D8eac2D3liBa3hMlToWyls4rC1mFILmihl5fLZFC9hEJTeXNnYKPUBSlM6Up9Gv0T6TxmkxxT5vP7yY3zLuOPFFeniAnCAZvk45F1MxV3hTIqmD5KeOhTO602Spn34vPGzK61SKC7VB94xnKc= 2022-01-07T10:10:19.516 INFO:teuthology.kill: smithi154.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKjNPZ1e1wcltkuRjYhfz5iZeUPwlRWmZIpErJKYVIgGgiqF47Gm4vwgHxNdXCC+TzokK94mT6MFgSBU6s3oFTY5A2BXgasG4LLBXOHwm1hXDW7W/zx9Kgj6/zP9oq3hvUNgu5vsy47ifezcqn/a8g0sIMoLtsWuPDGFBvcQk/SUdBibVjSjIenTASyrL++xnojtW8nrx4VmMBoUH5N1u7XQqFbfcbZqDr7WGSZ8WbnrXSJq0Fc7Eopf52XZVFhqdEqxZL2K9ZPXqybe2MCbclevs3dbf/zQdeJ5sHwD6yFqehMOOYICZeCx2U6OJCGzUU2ZetjUD9Z+lDsiaBt/V27fYU9clrdaJRn5E5q77tC1YpD/XM5ZxpraqPbXixX0qSJ7jKNCvREyG029/yzRCoooRa61ABvV1fsgGiCwRmfEDFPjL80i/J7Ckvp4emSUxILAn+RD6vgG2quoIkivNzn1VIwvbb1zz+ZSvFXj/xCWBlsIx0Tqxmfxocr/kNc9k= 2022-01-07T10:10:19.544 INFO:teuthology.kill:2022-01-07 10:10:19,543.543 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-07T10:10:19.547 INFO:teuthology.kill:2022-01-07 10:10:19,547.547 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-07T10:10:19.630 INFO:teuthology.kill:2022-01-07 10:10:19,630.630 INFO:teuthology.orchestra.console:Power off smithi137 2022-01-07T10:10:19.644 INFO:teuthology.kill:2022-01-07 10:10:19,644.644 INFO:teuthology.orchestra.console:Power off smithi154 2022-01-07T10:10:28.001 INFO:teuthology.kill:2022-01-07 10:10:28,000.000 INFO:teuthology.orchestra.console:Power off for smithi137 completed 2022-01-07T10:10:28.013 INFO:teuthology.kill:2022-01-07 10:10:28,013.013 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2022-01-07T10:10:28.154 INFO:teuthology.kill:2022-01-07 10:10:28,153.153 INFO:teuthology.lock.ops:unlocked: smithi137.front.sepia.ceph.com 2022-01-07T10:10:28.158 INFO:teuthology.kill:2022-01-07 10:10:28,158.158 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com 2022-01-07T10:12:28.453 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-07T10:12:28.547 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi137 but it was locked by another job: /home/teuthworker/archive/ofriedma-2022-01-06_16:08:20-rgw-wip-ofriedma-ratelimit-i02-distro-basic-smithi/6599901 2022-01-07T10:12:28.548 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi154 but it was locked by another job: /home/teuthworker/archive/ofriedma-2022-01-06_16:08:20-rgw-wip-ofriedma-ratelimit-i02-distro-basic-smithi/6599901