2022-01-29T14:38:06.085 INFO:root:teuthology version: 1.1.0-7c0cb867 2022-01-29T14:38:06.206 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi016.front.sepia.ceph.com' reimaging 2022-01-29T14:38:06.207 INFO:teuthology.lock.ops:Updating [ubuntu@smithi016.front.sepia.ceph.com]: reset os type and version on server 2022-01-29T14:38:06.207 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2022-01-29T14:38:06.225 INFO:teuthology.lock.ops:Node 'ubuntu@smithi016.front.sepia.ceph.com' reimaging is complete 2022-01-29T14:38:06.226 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging 2022-01-29T14:38:06.226 INFO:teuthology.lock.ops:Updating [ubuntu@smithi163.front.sepia.ceph.com]: reset os type and version on server 2022-01-29T14:38:06.226 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2022-01-29T14:38:06.245 INFO:teuthology.lock.ops:Node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging is complete 2022-01-29T14:38:06.440 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 8.3 2022-01-29T14:38:06.450 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of centos 8.3 2022-01-29T14:38:06.778 INFO:teuthology.orchestra.console:Power off smithi163 2022-01-29T14:38:06.794 INFO:teuthology.orchestra.console:Power off smithi016 2022-01-29T14:38:15.156 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2022-01-29T14:38:15.258 INFO:teuthology.orchestra.console:Power on smithi163 2022-01-29T14:38:19.272 INFO:teuthology.orchestra.console:Power off for smithi016 completed 2022-01-29T14:38:19.374 INFO:teuthology.orchestra.console:Power on smithi016 2022-01-29T14:38:23.620 INFO:teuthology.orchestra.console:Power on for smithi163 completed 2022-01-29T14:38:23.722 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2022-01-29T14:38:27.734 INFO:teuthology.orchestra.console:Power on for smithi016 completed 2022-01-29T14:38:27.835 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish 2022-01-29T14:42:09.981 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-29T14:42:24.479 INFO:teuthology.provision.fog.smithi016:Node is ready 2022-01-29T14:42:24.497 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com 2022-01-29T14:42:24.551 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016 2022-01-29T14:42:24.899 INFO:teuthology.provision.fog.smithi016:Deploy complete! 2022-01-29T14:43:53.191 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-29T14:43:53.498 INFO:teuthology.provision.fog.smithi163:Node is ready 2022-01-29T14:43:53.514 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2022-01-29T14:43:53.570 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2022-01-29T14:43:53.894 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2022-01-29T14:43:54.080 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com 2022-01-29T14:43:54.081 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-29T14:43:54.101 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2022-01-29T14:43:54.101 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-29T14:43:54.119 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server 2022-01-29T14:43:54.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2022-01-29T14:43:54.390 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2022-01-29T14:43:54.446 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Linux" 2022-01-29T14:43:54.447 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8" 2022-01-29T14:43:54.447 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2022-01-29T14:43:54.447 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2022-01-29T14:43:54.448 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8" 2022-01-29T14:43:54.448 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2022-01-29T14:43:54.448 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Linux 8" 2022-01-29T14:43:54.448 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2022-01-29T14:43:54.448 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-29T14:43:54.449 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2022-01-29T14:43:54.449 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-29T14:43:54.449 INFO:teuthology.orchestra.run.smithi016.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-29T14:43:54.449 INFO:teuthology.orchestra.run.smithi016.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-29T14:43:54.451 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2022-01-29T14:43:54.468 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2022-01-29T14:43:54.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2022-01-29T14:43:54.727 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2022-01-29T14:43:54.781 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Linux" 2022-01-29T14:43:54.782 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8" 2022-01-29T14:43:54.782 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2022-01-29T14:43:54.782 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2022-01-29T14:43:54.783 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8" 2022-01-29T14:43:54.783 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2022-01-29T14:43:54.783 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Linux 8" 2022-01-29T14:43:54.783 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2022-01-29T14:43:54.784 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-29T14:43:54.784 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2022-01-29T14:43:54.784 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-29T14:43:54.785 INFO:teuthology.orchestra.run.smithi163.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-29T14:43:54.785 INFO:teuthology.orchestra.run.smithi163.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-29T14:43:54.785 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2022-01-29T14:43:54.892 INFO:teuthology.dispatcher.supervisor:Running job 6648020 2022-01-29T14:43:54.893 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-28_20:46:10-rados-wip-yuriw-quincy-1.28.22-distro-default-smithi/6648020 --name yuriw-2022-01-28_20:46:10-rados-wip-yuriw-quincy-1.28.22-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/yuriw-2022-01-28_20:46:10-rados-wip-yuriw-quincy-1.28.22-distro-default-smithi/6648020/orig.config.yaml 2022-01-29T14:43:54.896 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-28_20:46:10-rados-wip-yuriw-quincy-1.28.22-distro-default-smithi/6648020 2022-01-29T14:43:54.897 INFO:teuthology.dispatcher.supervisor:Job PID: 24808 2022-01-29T14:43:54.898 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-29T21:14:23.454 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-29T21:14:23.636 INFO:teuthology.kill:Killing Pids: {24808} 2022-01-29T21:14:24.749 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-29T21:14:24.902 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-29T21:14:24.903 INFO:teuthology.misc:Compressing logs... 2022-01-29T21:14:24.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2022-01-29T21:14:25.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2022-01-29T21:14:25.129 INFO:teuthology.orchestra.run.smithi016.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-29T21:14:25.405 INFO:teuthology.orchestra.run.smithi163.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-29T21:14:25.450 INFO:teuthology.orchestra.run.smithi016.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-29T21:14:25.451 INFO:teuthology.orchestra.run.smithi016.stderr:tar: Error is not recoverable: exiting now 2022-01-29T21:14:25.487 INFO:teuthology.orchestra.run.smithi163.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-29T21:14:25.487 INFO:teuthology.orchestra.run.smithi163.stderr:tar: Error is not recoverable: exiting now 2022-01-29T21:14:25.488 INFO:teuthology.misc:Compressing logs... 2022-01-29T21:14:25.701 INFO:teuthology.misc:Compressing logs... 2022-01-29T21:14:29.042 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/3cac78c6-8113-11ec-8c35-001a4aab830c/ceph-mon.smithi163.log: file size changed while zipping 2022-01-29T21:14:42.202 INFO:teuthology.orchestra.run.smithi016.stderr:gzip: /var/log/ceph/3cac78c6-8113-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-29T21:14:44.404 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/3cac78c6-8113-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-29T21:15:00.096 INFO:teuthology.orchestra.run.smithi016.stderr:gzip: /var/log/ceph/3cac78c6-8113-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-29T21:15:01.439 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/3cac78c6-8113-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-29T21:15:13.101 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/3cac78c6-8113-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-29T21:15:24.307 INFO:teuthology.orchestra.run.smithi016.stderr:gzip: /var/log/ceph/3cac78c6-8113-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-29T21:15:33.105 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/3cac78c6-8113-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-29T21:15:34.267 INFO:teuthology.orchestra.run.smithi016.stderr:gzip: /var/log/ceph/3cac78c6-8113-11ec-8c35-001a4aab830c/ceph-mon.smithi016.log: file size changed while zipping 2022-01-29T21:15:36.593 INFO:teuthology.orchestra.run.smithi016.stderr:gzip: /var/log/ceph/3cac78c6-8113-11ec-8c35-001a4aab830c/ceph-mgr.smithi016.vieeck.log: file size changed while zipping 2022-01-29T21:15:54.410 INFO:teuthology.orchestra.run.smithi016.stderr:gzip: /var/log/ceph/3cac78c6-8113-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-29T21:16:27.282 INFO:teuthology.kill:No teuthology processes running 2022-01-29T21:16:28.478 INFO:teuthology.kill:Nuking machines: ['smithi016', 'smithi163'] 2022-01-29T21:16:29.431 INFO:teuthology.kill:2022-01-29 21:16:29,431.431 INFO:teuthology.nuke:targets: 2022-01-29T21:16:29.432 INFO:teuthology.kill: smithi016.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCin/DqCeKCyq3j4EQYnbYXVZHjGyNa1d8w3Eb6X0cHxeWHnAqdn2PZgyZIOnmknk4SVVJbxbt7XbJIvF5ewb0j39Nm6h19hsVxJ7zRLYIRCFOcCucDmfDlVl4eF/RrCprqeb3lyC//yGsbc7b3CqBVRqBad8srD6PARtTt1TrV+uxWmKqZbe9iOgHGAUQ0MNq8Vo1qWKMfRkdPzsOQXaNSrIl6AONVTKoxzgW0ZSTTnSahiDTBe0EA8ARe2JUCpUNdnMA3Q2AlzPTiSVumIKlLN2qJYI75wjpE1/M2S+71/gYhSi/pJODAMrZw7GA9T/HjtDL8IIdwsrKjJcfZIApBG1wt7rxwFvEV5r1/fu9IsB/akc2l8scuuFRzbq351eF7njMqIZQWKF4Kz2qv1TrDmS2K0I93QT8NpgMvvRLGhdGW9dcwD36QecT9eco7OY7505p16zQ5PyMoJsZ0nSyFJz/eTF2mpkeVd8lRXglFbZZzbrKRaQdKtKq+oR2buZk= 2022-01-29T21:16:29.432 INFO:teuthology.kill: smithi163.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD0IUU6r1rxv0q7teGw6szUnsD6sboGy/AdGamWWJ+5Tw6V5nkma1hjnE+VRXSiD+Jntas8938PyFCzNuGcqpfXFhrzZRoe4LfLWD6ww0cPSutQasdh0sK0eXeqkyRy81fO4N6l7YJwb8RKU2UDhGYbwlfH5sR9KtoUueE3yaJUovlpWbzacJpo6uPen3IAsjD5FooU8SSQPE3084BhrIXuCSDm38P1NMA3ZGBaElZuML4GW+lp1d/jhJigL9318YslzAHfT71GXq/LJIR4nYBHJghFc60/oee0SrUjtkWF46zHhW9n7Y7uB850BwougqJt03QSj5/6tXHH1r9Zp7DVzbqhFdbcbytbMg8r9fbzsEDVdq1zUwQmhT7w8QkHraKTqA1sQPIg6zQ6kwPZG5vDZTgRpAir6HxnL74OknEKAtwD0Lg7nyAbjBUmAKkUmqrLuurc9nTjEzqGLDTTHPk7/Mwr8aoSHHtarxflWD14uHnb/zzDRRq7g2lKs+gplqM= 2022-01-29T21:16:29.459 INFO:teuthology.kill:2022-01-29 21:16:29,459.459 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-29T21:16:29.462 INFO:teuthology.kill:2022-01-29 21:16:29,462.462 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-29T21:16:29.545 INFO:teuthology.kill:2022-01-29 21:16:29,545.545 INFO:teuthology.orchestra.console:Power off smithi016 2022-01-29T21:16:29.561 INFO:teuthology.kill:2022-01-29 21:16:29,561.561 INFO:teuthology.orchestra.console:Power off smithi163 2022-01-29T21:16:37.923 INFO:teuthology.kill:2022-01-29 21:16:37,922.922 INFO:teuthology.orchestra.console:Power off for smithi016 completed 2022-01-29T21:16:38.323 INFO:teuthology.kill:2022-01-29 21:16:38,081.081 INFO:teuthology.lock.ops:unlocked: smithi016.front.sepia.ceph.com 2022-01-29T21:16:42.042 INFO:teuthology.kill:2022-01-29 21:16:42,042.042 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2022-01-29T21:16:42.191 INFO:teuthology.kill:2022-01-29 21:16:42,191.191 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com 2022-01-29T21:18:42.534 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-29T21:18:42.632 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi016 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-27_06:00:02-rbd-octopus-distro-default-smithi/6642967 2022-01-29T21:18:42.632 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi163 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-27_06:00:02-rbd-octopus-distro-default-smithi/6642967