2022-01-29T11:43:31.155 INFO:root:teuthology version: 1.1.0-7c0cb867 2022-01-29T11:43:31.282 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi079.front.sepia.ceph.com' reimaging 2022-01-29T11:43:31.284 INFO:teuthology.lock.ops:Updating [ubuntu@smithi079.front.sepia.ceph.com]: reset os type and version on server 2022-01-29T11:43:31.284 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2022-01-29T11:43:31.308 INFO:teuthology.lock.ops:Node 'ubuntu@smithi079.front.sepia.ceph.com' reimaging is complete 2022-01-29T11:43:31.308 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi192.front.sepia.ceph.com' reimaging 2022-01-29T11:43:31.309 INFO:teuthology.lock.ops:Updating [ubuntu@smithi192.front.sepia.ceph.com]: reset os type and version on server 2022-01-29T11:43:31.309 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2022-01-29T11:43:31.327 INFO:teuthology.lock.ops:Node 'ubuntu@smithi192.front.sepia.ceph.com' reimaging is complete 2022-01-29T11:43:31.541 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 8.2 2022-01-29T11:43:31.590 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 8.2 2022-01-29T11:43:31.997 INFO:teuthology.orchestra.console:Power off smithi079 2022-01-29T11:43:32.065 INFO:teuthology.orchestra.console:Power off smithi192 2022-01-29T11:43:32.146 INFO:teuthology.orchestra.console:Power off for smithi079 completed 2022-01-29T11:43:32.208 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2022-01-29T11:43:32.247 INFO:teuthology.orchestra.console:Power on smithi079 2022-01-29T11:43:32.309 INFO:teuthology.orchestra.console:Power on smithi192 2022-01-29T11:43:36.560 INFO:teuthology.orchestra.console:Power on for smithi192 completed 2022-01-29T11:43:36.662 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2022-01-29T11:43:40.665 INFO:teuthology.orchestra.console:Power on for smithi079 completed 2022-01-29T11:43:40.766 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2022-01-29T11:47:51.385 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-29T11:48:11.724 INFO:teuthology.provision.fog.smithi192:Node is ready 2022-01-29T11:48:11.743 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2022-01-29T11:48:11.799 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2022-01-29T11:48:12.154 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2022-01-29T11:48:21.727 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-29T11:48:22.036 INFO:teuthology.provision.fog.smithi079:Node is ready 2022-01-29T11:48:22.051 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2022-01-29T11:48:22.107 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2022-01-29T11:48:22.421 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2022-01-29T11:48:22.569 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2022-01-29T11:48:22.570 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-29T11:48:22.591 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2022-01-29T11:48:22.591 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-29T11:48:22.612 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2022-01-29T11:48:22.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2022-01-29T11:48:22.867 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2022-01-29T11:48:22.922 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Linux" 2022-01-29T11:48:22.922 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8 (Core)" 2022-01-29T11:48:22.922 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2022-01-29T11:48:22.923 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2022-01-29T11:48:22.923 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8" 2022-01-29T11:48:22.923 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2022-01-29T11:48:22.923 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2022-01-29T11:48:22.924 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2022-01-29T11:48:22.924 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-29T11:48:22.924 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.centos.org/" 2022-01-29T11:48:22.924 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-29T11:48:22.925 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-01-29T11:48:22.925 INFO:teuthology.orchestra.run.smithi079.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-29T11:48:22.925 INFO:teuthology.orchestra.run.smithi079.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-29T11:48:22.925 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2022-01-29T11:48:22.926 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2022-01-29T11:48:22.926 INFO:teuthology.orchestra.run.smithi079.stdout: 2022-01-29T11:48:22.927 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2022-01-29T11:48:22.945 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2022-01-29T11:48:22.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2022-01-29T11:48:23.211 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2022-01-29T11:48:23.265 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Linux" 2022-01-29T11:48:23.265 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8 (Core)" 2022-01-29T11:48:23.266 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2022-01-29T11:48:23.266 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2022-01-29T11:48:23.266 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8" 2022-01-29T11:48:23.266 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2022-01-29T11:48:23.267 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2022-01-29T11:48:23.267 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2022-01-29T11:48:23.267 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-29T11:48:23.267 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.centos.org/" 2022-01-29T11:48:23.268 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-29T11:48:23.268 INFO:teuthology.orchestra.run.smithi192.stdout: 2022-01-29T11:48:23.268 INFO:teuthology.orchestra.run.smithi192.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-29T11:48:23.268 INFO:teuthology.orchestra.run.smithi192.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-29T11:48:23.269 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2022-01-29T11:48:23.269 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2022-01-29T11:48:23.269 INFO:teuthology.orchestra.run.smithi192.stdout: 2022-01-29T11:48:23.270 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2022-01-29T11:48:23.369 INFO:teuthology.dispatcher.supervisor:Running job 6647680 2022-01-29T11:48:23.370 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-28_20:46:10-rados-wip-yuriw-quincy-1.28.22-distro-default-smithi/6647680 --name yuriw-2022-01-28_20:46:10-rados-wip-yuriw-quincy-1.28.22-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/yuriw-2022-01-28_20:46:10-rados-wip-yuriw-quincy-1.28.22-distro-default-smithi/6647680/orig.config.yaml 2022-01-29T11:48:23.373 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-28_20:46:10-rados-wip-yuriw-quincy-1.28.22-distro-default-smithi/6647680 2022-01-29T11:48:23.373 INFO:teuthology.dispatcher.supervisor:Job PID: 32155 2022-01-29T11:48:23.374 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-29T18:18:52.379 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-29T18:18:52.596 INFO:teuthology.kill:Killing Pids: {32155} 2022-01-29T18:18:53.806 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-29T18:18:53.808 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-29T18:18:53.808 INFO:teuthology.misc:Compressing logs... 2022-01-29T18:18:53.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2022-01-29T18:18:54.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2022-01-29T18:18:54.043 INFO:teuthology.orchestra.run.smithi079.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-29T18:18:54.260 INFO:teuthology.orchestra.run.smithi192.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-29T18:18:54.298 INFO:teuthology.orchestra.run.smithi079.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-29T18:18:54.298 INFO:teuthology.orchestra.run.smithi079.stderr:tar: Error is not recoverable: exiting now 2022-01-29T18:18:54.336 INFO:teuthology.orchestra.run.smithi192.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-29T18:18:54.337 INFO:teuthology.orchestra.run.smithi192.stderr:tar: Error is not recoverable: exiting now 2022-01-29T18:18:54.338 INFO:teuthology.misc:Compressing logs... 2022-01-29T18:18:54.530 INFO:teuthology.misc:Compressing logs... 2022-01-29T18:19:01.685 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/9fda8d84-80fa-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-29T18:19:03.401 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/9fda8d84-80fa-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-29T18:19:08.872 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/9fda8d84-80fa-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-29T18:19:10.213 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/9fda8d84-80fa-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-29T18:19:13.709 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/9fda8d84-80fa-11ec-8c35-001a4aab830c/ceph-mon.smithi192.log: file size changed while zipping 2022-01-29T18:19:18.085 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/9fda8d84-80fa-11ec-8c35-001a4aab830c/ceph-mon.smithi079.log: file size changed while zipping 2022-01-29T18:19:20.857 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/9fda8d84-80fa-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-29T18:19:25.966 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/9fda8d84-80fa-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-29T18:19:29.575 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/9fda8d84-80fa-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-29T18:19:35.506 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/9fda8d84-80fa-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-29T18:19:37.174 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/9fda8d84-80fa-11ec-8c35-001a4aab830c/ceph-mgr.smithi079.xdhavb.log: file size changed while zipping 2022-01-29T18:19:53.891 INFO:teuthology.kill:No teuthology processes running 2022-01-29T18:19:54.957 INFO:teuthology.kill:Nuking machines: ['smithi079', 'smithi192'] 2022-01-29T18:19:55.884 INFO:teuthology.kill:2022-01-29 18:19:55,884.884 INFO:teuthology.nuke:targets: 2022-01-29T18:19:55.885 INFO:teuthology.kill: smithi079.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9Ok7goiZp44D8eM/NKARVMNK19RE7vlGSrVtr8evDq8nkiVRjrLdjH7f+gj83cQSOgmGJo2VfnNaGLj6jM1pBKOHCZOTud2ad5UKLdsJClEDOhpc5jC8WyCQatuPGDtILX3ZKs7CmLwmrziebiJGPJ/7veVk0Q31DV2pJyPuu4V/Jc/r2gE619kZbd7HHtHknPTvwyC411LChU6cHQOFZBJe+bFAqcmRQTBlgzKm5XoozXBGuJhgaY7a3Rs6g5m2jU1DT+X745VSvBv/YIM9czAywqIHoUzI/WlEIxbrTE1rfvQahbiRz2ILGoSJH22JQztLtvt7InY3rYGq4f5Pdfpk/1hRy5/nWOXxYpBZ2pGOODXkQGT1H43/HxMLQGm5EdMLIDRYFIDDSUyPBgOhnBCwOTuDhXg0uxFPT9iixqjAdNdSn1/ImsIW0JE2u9jdkwLgaYkWa1Y0gyDr0ssBKs9aWiCHK2zXsZ5vr3scORd7Odk6bYY1oySkQ+YnDmcE= 2022-01-29T18:19:55.886 INFO:teuthology.kill: smithi192.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGm/8RqhrqM2ejhHTARLwpplsov0Y6TzOcLralLb3J9hHyMcoE/O1sMQYxN92oSWhAJiyXaUBCKM/R6YNfOPmPAPr7YRHA3VI9AZpSJbm+Qy8V1jB714X7n1VI+yXY3URqFDQCnsVltCGvOZ7LrXrDVKDqMgHcTB4tzZkRQCQPY3i7klPwuG6tB5g/b85D9jQn2lcVw3nmue1hZXF1nro58n62tL3pPd85d3ktvPZkEcFR7yWd7dv1u6y8rTStQVUiBRCmIfkYtole1hM5HRzA+i/uVvzHfIhHQeURVKcZN6HllmH+78VzAgj/0TicSYCBlWz0yS5BUcI0f8q6AAO8bxwVk1hoWvOc32n2/dE4Y2a0EuHWdG3jmjemOJv7bKos9m5UqWj6mywWVzTz8hc7lciElo26z/DyRgFn1ViC3aB2/I9VzCoK/Lqqi+caJo4X5jb9WI+fi+haoNwHk3476z7SsLs5R/Rcb0lmY9v4lTpYP+h2IRch3ebmUTpIn+8= 2022-01-29T18:19:55.911 INFO:teuthology.kill:2022-01-29 18:19:55,910.910 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-29T18:19:55.914 INFO:teuthology.kill:2022-01-29 18:19:55,913.913 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-29T18:19:55.989 INFO:teuthology.kill:2022-01-29 18:19:55,988.988 INFO:teuthology.orchestra.console:Power off smithi192 2022-01-29T18:19:56.001 INFO:teuthology.kill:2022-01-29 18:19:56,001.001 INFO:teuthology.orchestra.console:Power off smithi079 2022-01-29T18:20:08.465 INFO:teuthology.kill:2022-01-29 18:20:08,464.464 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2022-01-29T18:20:08.468 INFO:teuthology.kill:2022-01-29 18:20:08,468.468 INFO:teuthology.orchestra.console:Power off for smithi079 completed 2022-01-29T18:20:08.616 INFO:teuthology.kill:2022-01-29 18:20:08,615.615 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com 2022-01-29T18:20:08.619 INFO:teuthology.kill:2022-01-29 18:20:08,619.619 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com 2022-01-29T18:22:08.906 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-29T18:22:08.995 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi079 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-29_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6648287 2022-01-29T18:22:08.996 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi192 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-29_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6648287