2022-01-10T14:16:44.833 INFO:root:teuthology version: 1.1.0-00e09f05 2022-01-10T14:16:44.961 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi122.front.sepia.ceph.com' reimaging 2022-01-10T14:16:44.962 INFO:teuthology.lock.ops:Updating [ubuntu@smithi122.front.sepia.ceph.com]: reset os type and version on server 2022-01-10T14:16:44.963 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2022-01-10T14:16:44.986 INFO:teuthology.lock.ops:Node 'ubuntu@smithi122.front.sepia.ceph.com' reimaging is complete 2022-01-10T14:16:44.986 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi146.front.sepia.ceph.com' reimaging 2022-01-10T14:16:44.986 INFO:teuthology.lock.ops:Updating [ubuntu@smithi146.front.sepia.ceph.com]: reset os type and version on server 2022-01-10T14:16:44.987 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2022-01-10T14:16:45.005 INFO:teuthology.lock.ops:Node 'ubuntu@smithi146.front.sepia.ceph.com' reimaging is complete 2022-01-10T14:16:45.201 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of centos 8.3 2022-01-10T14:16:45.209 INFO:teuthology.provision.fog.smithi122:Scheduling deploy of centos 8.3 2022-01-10T14:16:45.610 INFO:teuthology.orchestra.console:Power off smithi146 2022-01-10T14:16:45.685 INFO:teuthology.orchestra.console:Power off smithi122 2022-01-10T14:16:45.751 INFO:teuthology.orchestra.console:Power off for smithi146 completed 2022-01-10T14:16:45.825 INFO:teuthology.orchestra.console:Power off for smithi122 completed 2022-01-10T14:16:45.853 INFO:teuthology.orchestra.console:Power on smithi146 2022-01-10T14:16:45.927 INFO:teuthology.orchestra.console:Power on smithi122 2022-01-10T14:16:50.118 INFO:teuthology.orchestra.console:Power on for smithi146 completed 2022-01-10T14:16:50.176 INFO:teuthology.orchestra.console:Power on for smithi122 completed 2022-01-10T14:16:50.220 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish 2022-01-10T14:16:50.278 INFO:teuthology.provision.fog.smithi122:Waiting for deploy to finish 2022-01-10T14:21:18.170 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-10T14:21:38.856 INFO:teuthology.provision.fog.smithi146:Node is ready 2022-01-10T14:21:38.876 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com 2022-01-10T14:21:38.935 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146 2022-01-10T14:21:39.287 INFO:teuthology.provision.fog.smithi146:Deploy complete! 2022-01-10T14:21:55.584 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-10T14:21:55.894 INFO:teuthology.provision.fog.smithi122:Node is ready 2022-01-10T14:21:55.909 INFO:teuthology.orchestra.run.smithi122.stdout:smithi122.front.sepia.ceph.com 2022-01-10T14:21:55.965 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.15.122 smithi122.front.sepia.ceph.com smithi122 2022-01-10T14:21:56.295 INFO:teuthology.provision.fog.smithi122:Deploy complete! 2022-01-10T14:21:56.447 INFO:teuthology.lock.ops:Checking smithi122.front.sepia.ceph.com 2022-01-10T14:21:56.448 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-10T14:21:56.469 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com 2022-01-10T14:21:56.470 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-10T14:21:56.493 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: set os type and version on server 2022-01-10T14:21:56.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2022-01-10T14:21:56.725 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2022-01-10T14:21:56.801 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Linux" 2022-01-10T14:21:56.803 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="8" 2022-01-10T14:21:56.803 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2022-01-10T14:21:56.804 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2022-01-10T14:21:56.805 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="8" 2022-01-10T14:21:56.805 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el8" 2022-01-10T14:21:56.807 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Linux 8" 2022-01-10T14:21:56.808 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2022-01-10T14:21:56.808 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-10T14:21:56.808 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2022-01-10T14:21:56.809 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-10T14:21:56.809 INFO:teuthology.orchestra.run.smithi122.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-10T14:21:56.809 INFO:teuthology.orchestra.run.smithi122.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-10T14:21:56.811 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2022-01-10T14:21:56.836 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server 2022-01-10T14:21:56.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2022-01-10T14:21:57.211 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2022-01-10T14:21:57.279 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Linux" 2022-01-10T14:21:57.279 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8" 2022-01-10T14:21:57.279 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2022-01-10T14:21:57.280 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2022-01-10T14:21:57.280 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8" 2022-01-10T14:21:57.280 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2022-01-10T14:21:57.280 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Linux 8" 2022-01-10T14:21:57.281 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2022-01-10T14:21:57.281 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-10T14:21:57.281 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2022-01-10T14:21:57.281 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-10T14:21:57.281 INFO:teuthology.orchestra.run.smithi146.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-10T14:21:57.282 INFO:teuthology.orchestra.run.smithi146.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-10T14:21:57.282 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2022-01-10T14:21:57.393 INFO:teuthology.dispatcher.supervisor:Running job 6604201 2022-01-10T14:21:57.394 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_00e09f05e9fb2ab7c7f497f5e446613531743ae2/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-01-09_07:01:02-rados-master-distro-default-smithi/6604201 --name teuthology-2022-01-09_07:01:02-rados-master-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} -- /home/teuthworker/archive/teuthology-2022-01-09_07:01:02-rados-master-distro-default-smithi/6604201/orig.config.yaml 2022-01-10T14:21:57.397 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-01-09_07:01:02-rados-master-distro-default-smithi/6604201 2022-01-10T14:21:57.398 INFO:teuthology.dispatcher.supervisor:Job PID: 32281 2022-01-10T14:21:57.398 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-11T02:22:52.188 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-01-11T02:22:52.381 INFO:teuthology.kill:Killing Pids: {32281} 2022-01-11T02:22:53.512 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-11T02:22:53.513 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-11T02:22:53.514 INFO:teuthology.misc:Compressing logs... 2022-01-11T02:22:53.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2022-01-11T02:22:53.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2022-01-11T02:22:53.769 INFO:teuthology.orchestra.run.smithi122.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-11T02:22:53.974 INFO:teuthology.orchestra.run.smithi146.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-11T02:22:54.014 INFO:teuthology.orchestra.run.smithi122.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-11T02:22:54.015 INFO:teuthology.orchestra.run.smithi122.stderr:tar: Error is not recoverable: exiting now 2022-01-11T02:22:54.068 INFO:teuthology.orchestra.run.smithi146.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-11T02:22:54.068 INFO:teuthology.orchestra.run.smithi146.stderr:tar: Error is not recoverable: exiting now 2022-01-11T02:22:54.070 INFO:teuthology.misc:Compressing logs... 2022-01-11T02:22:54.265 INFO:teuthology.misc:Compressing logs... 2022-01-11T02:23:00.706 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/123cad04-7222-11ec-8c32-001a4aab830c/ceph-mon.smithi146.log: file size changed while zipping 2022-01-11T02:23:09.156 INFO:teuthology.orchestra.run.smithi122.stderr:gzip: /var/log/ceph/123cad04-7222-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-11T02:23:14.397 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/123cad04-7222-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-11T02:23:22.466 INFO:teuthology.orchestra.run.smithi122.stderr:gzip: /var/log/ceph/123cad04-7222-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-11T02:23:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/123cad04-7222-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-11T02:23:39.551 INFO:teuthology.orchestra.run.smithi122.stderr:gzip: /var/log/ceph/123cad04-7222-11ec-8c32-001a4aab830c/ceph-mon.smithi122.log: file size changed while zipping 2022-01-11T02:23:42.738 INFO:teuthology.orchestra.run.smithi122.stderr:gzip: /var/log/ceph/123cad04-7222-11ec-8c32-001a4aab830c/ceph-mgr.smithi122.sapcgo.log: file size changed while zipping 2022-01-11T02:23:45.449 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/123cad04-7222-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-11T02:24:00.711 INFO:teuthology.orchestra.run.smithi122.stderr:gzip: /var/log/ceph/123cad04-7222-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-11T02:24:03.207 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/123cad04-7222-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-11T02:24:14.287 INFO:teuthology.orchestra.run.smithi122.stderr:gzip: /var/log/ceph/123cad04-7222-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-11T02:24:45.922 INFO:teuthology.kill:No teuthology processes running 2022-01-11T02:24:47.016 INFO:teuthology.kill:Nuking machines: ['smithi122', 'smithi146'] 2022-01-11T02:24:47.926 INFO:teuthology.kill:2022-01-11 02:24:47,925.925 INFO:teuthology.nuke:targets: 2022-01-11T02:24:47.926 INFO:teuthology.kill: smithi122.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC97lr/2IzH7V4AsdKCchbtjO8WmbdQUbCVyfPVv3Gel1C1iV6ni9bAInWwHUI3x++Ho8+YuOUslYLZJnTiugW/ve2nEdRv3IjiDmOyuxxPEWcjyshNAHyisRxBdTG0BIVVXL2yyjpndcjyT+gPUjq+Y8lV+z5Q63qCOt+XZLxXQA0fmSCRxQeXSlVUZCO8+3K70di7DZzo9FwAnTs33Mr4T7pPYsPijNz2OUjbWeu+LeNIEVxZNu0gJuPbWF01Y/w/8/s00jWVsIhx+4NutS/PGYpX8ZF/u7D9TqvhI5ZPGPLmjAiugB4JneJKBQcXg4KE+3sxj4iAy7Y4oLH54oqNNb91kvzAPH08Ol6nkAiObWRNwcWJc/dVE2CnP4aiqRoQuOYI6/SGO0BxFVaTg3IAzF1kvm8mzLelEeIdLj5LAp9/efEdcj5uUsmJBvU/G7hIbFFBXvCo6L2B47JGxR2DR5tL2LVbJQnuM54hQ47HuBng++go2sfxGgXa5sfNs+M= 2022-01-11T02:24:47.927 INFO:teuthology.kill: smithi146.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAGITieJMcbf2RGEsV/53Y/3zjZAJ94UqkGjEmh356xvQTXY76pzEXFbm9sUoWhPJXgkbNI5msKdyGwwCl0SyvswKZcE0gatrVSqcIUt7YqVwZfNyMmkKu9OshEZIqtj55De6is97JjggeG0QVAPIIGg4k28uXzZfgsbWLYJhT6vi+cDzHhhx6uuoPinLw1wgoE63WUPH+E0GmB8I7uMJmp0U5boRoZI1DewDlg89yyLqmR5tfKq16Dqwsviq8Q3BVADWrwS23FCt4kaTbC1Bz4wxnH8gQLUaFk66TKrswk7FPtHSuruSIy+lQc+k7csalitlM7g8PzLVcntLGaXexl2zur50bTVqtuMb5JEBqF0ytrhpN7ZTt/Sl6YWcxyz2lO/zLxWPXJ3B5pfW1WddUstew5aOvX2zvtdA+zy5zDEhV6zXCgpT2rHxO+X7ylrlgfvFX0swXWU/QJcpxGGXm6tda5diVbFSV3HSq+qyCNFEFfY69eZFtTVrvnGHTOqs= 2022-01-11T02:24:47.952 INFO:teuthology.kill:2022-01-11 02:24:47,951.951 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-11T02:24:47.955 INFO:teuthology.kill:2022-01-11 02:24:47,954.954 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-11T02:24:48.027 INFO:teuthology.kill:2022-01-11 02:24:48,027.027 INFO:teuthology.orchestra.console:Power off smithi146 2022-01-11T02:24:48.041 INFO:teuthology.kill:2022-01-11 02:24:48,041.041 INFO:teuthology.orchestra.console:Power off smithi122 2022-01-11T02:24:56.400 INFO:teuthology.kill:2022-01-11 02:24:56,400.400 INFO:teuthology.orchestra.console:Power off for smithi122 completed 2022-01-11T02:24:56.546 INFO:teuthology.kill:2022-01-11 02:24:56,545.545 INFO:teuthology.lock.ops:unlocked: smithi122.front.sepia.ceph.com 2022-01-11T02:25:00.507 INFO:teuthology.kill:2022-01-11 02:25:00,506.506 INFO:teuthology.orchestra.console:Power off for smithi146 completed 2022-01-11T02:25:00.654 INFO:teuthology.kill:2022-01-11 02:25:00,654.654 INFO:teuthology.lock.ops:unlocked: smithi146.front.sepia.ceph.com 2022-01-11T02:27:00.994 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-11T02:27:01.098 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi122 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-10_21:22:44-rados-wip-yuri4-testing-2022-01-10-1127-distro-default-smithi/6606596 2022-01-11T02:27:01.099 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi146 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-10_21:22:44-rados-wip-yuri4-testing-2022-01-10-1127-distro-default-smithi/6606594