2022-01-17T12:43:10.620 INFO:root:teuthology version: 1.1.0-3ff86a5d 2022-01-17T12:43:10.770 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi031.front.sepia.ceph.com' reimaging 2022-01-17T12:43:10.771 INFO:teuthology.lock.ops:Updating [ubuntu@smithi031.front.sepia.ceph.com]: reset os type and version on server 2022-01-17T12:43:10.771 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2022-01-17T12:43:10.789 INFO:teuthology.lock.ops:Node 'ubuntu@smithi031.front.sepia.ceph.com' reimaging is complete 2022-01-17T12:43:10.789 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi103.front.sepia.ceph.com' reimaging 2022-01-17T12:43:10.789 INFO:teuthology.lock.ops:Updating [ubuntu@smithi103.front.sepia.ceph.com]: reset os type and version on server 2022-01-17T12:43:10.790 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2022-01-17T12:43:10.810 INFO:teuthology.lock.ops:Node 'ubuntu@smithi103.front.sepia.ceph.com' reimaging is complete 2022-01-17T12:43:11.005 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of centos 8.2 2022-01-17T12:43:11.029 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of centos 8.2 2022-01-17T12:43:11.838 INFO:teuthology.orchestra.console:Power off smithi031 2022-01-17T12:43:11.878 INFO:teuthology.orchestra.console:Power off smithi103 2022-01-17T12:43:11.989 INFO:teuthology.orchestra.console:Power off for smithi031 completed 2022-01-17T12:43:12.020 INFO:teuthology.orchestra.console:Power off for smithi103 completed 2022-01-17T12:43:12.090 INFO:teuthology.orchestra.console:Power on smithi031 2022-01-17T12:43:12.122 INFO:teuthology.orchestra.console:Power on smithi103 2022-01-17T12:43:16.375 INFO:teuthology.orchestra.console:Power on for smithi103 completed 2022-01-17T12:43:16.476 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2022-01-17T12:43:20.459 INFO:teuthology.orchestra.console:Power on for smithi031 completed 2022-01-17T12:43:20.560 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2022-01-17T12:47:11.237 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-17T12:47:11.598 INFO:teuthology.provision.fog.smithi031:Node is ready 2022-01-17T12:47:11.652 INFO:teuthology.orchestra.run.smithi031.stdout:smithi003 2022-01-17T12:47:11.708 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2022-01-17T12:47:12.022 INFO:teuthology.provision.fog.smithi031:Deploy complete! 2022-01-17T12:50:03.584 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-17T12:50:03.885 INFO:teuthology.provision.fog.smithi103:Node is ready 2022-01-17T12:50:03.900 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com 2022-01-17T12:50:03.955 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103 2022-01-17T12:50:04.277 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2022-01-17T12:50:04.423 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com 2022-01-17T12:50:04.424 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-17T12:50:04.442 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com 2022-01-17T12:50:04.443 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-17T12:50:04.460 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server 2022-01-17T12:50:04.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2022-01-17T12:50:04.673 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2022-01-17T12:50:04.729 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Linux" 2022-01-17T12:50:04.729 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8 (Core)" 2022-01-17T12:50:04.729 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2022-01-17T12:50:04.730 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2022-01-17T12:50:04.730 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8" 2022-01-17T12:50:04.730 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2022-01-17T12:50:04.730 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2022-01-17T12:50:04.731 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2022-01-17T12:50:04.731 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-17T12:50:04.731 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.centos.org/" 2022-01-17T12:50:04.731 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-17T12:50:04.732 INFO:teuthology.orchestra.run.smithi031.stdout: 2022-01-17T12:50:04.732 INFO:teuthology.orchestra.run.smithi031.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-17T12:50:04.732 INFO:teuthology.orchestra.run.smithi031.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-17T12:50:04.732 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2022-01-17T12:50:04.733 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2022-01-17T12:50:04.733 INFO:teuthology.orchestra.run.smithi031.stdout: 2022-01-17T12:50:04.734 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2022-01-17T12:50:04.756 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server 2022-01-17T12:50:04.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2022-01-17T12:50:05.010 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2022-01-17T12:50:05.064 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Linux" 2022-01-17T12:50:05.064 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8 (Core)" 2022-01-17T12:50:05.065 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2022-01-17T12:50:05.065 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2022-01-17T12:50:05.065 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8" 2022-01-17T12:50:05.065 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2022-01-17T12:50:05.066 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2022-01-17T12:50:05.066 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2022-01-17T12:50:05.066 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-17T12:50:05.067 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.centos.org/" 2022-01-17T12:50:05.067 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-17T12:50:05.067 INFO:teuthology.orchestra.run.smithi103.stdout: 2022-01-17T12:50:05.067 INFO:teuthology.orchestra.run.smithi103.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-17T12:50:05.067 INFO:teuthology.orchestra.run.smithi103.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-17T12:50:05.068 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2022-01-17T12:50:05.068 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2022-01-17T12:50:05.068 INFO:teuthology.orchestra.run.smithi103.stdout: 2022-01-17T12:50:05.069 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2022-01-17T12:50:05.159 INFO:teuthology.dispatcher.supervisor:Running job 6622015 2022-01-17T12:50:05.159 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_swagner@teuthology --archive /home/teuthworker/archive/swagner-2022-01-17_12:42:04-orch:cephadm-wip-swagner-testing-2022-01-17-1014-distro-default-smithi/6622015 --name swagner-2022-01-17_12:42:04-orch:cephadm-wip-swagner-testing-2022-01-17-1014-distro-default-smithi --description orch:cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/swagner-2022-01-17_12:42:04-orch:cephadm-wip-swagner-testing-2022-01-17-1014-distro-default-smithi/6622015/orig.config.yaml 2022-01-17T12:50:05.163 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/swagner-2022-01-17_12:42:04-orch:cephadm-wip-swagner-testing-2022-01-17-1014-distro-default-smithi/6622015 2022-01-17T12:50:05.163 INFO:teuthology.dispatcher.supervisor:Job PID: 8739 2022-01-17T12:50:05.164 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-17T19:20:34.183 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-17T19:20:34.357 INFO:teuthology.kill:Killing Pids: {8739} 2022-01-17T19:20:35.519 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-17T19:20:35.520 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-17T19:20:35.521 INFO:teuthology.misc:Compressing logs... 2022-01-17T19:20:35.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2022-01-17T19:20:35.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2022-01-17T19:20:35.776 INFO:teuthology.orchestra.run.smithi031.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-17T19:20:35.972 INFO:teuthology.orchestra.run.smithi103.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-17T19:20:36.004 INFO:teuthology.orchestra.run.smithi031.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-17T19:20:36.005 INFO:teuthology.orchestra.run.smithi031.stderr:tar: Error is not recoverable: exiting now 2022-01-17T19:20:36.032 INFO:teuthology.orchestra.run.smithi103.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-17T19:20:36.032 INFO:teuthology.orchestra.run.smithi103.stderr:tar: Error is not recoverable: exiting now 2022-01-17T19:20:36.034 INFO:teuthology.misc:Compressing logs... 2022-01-17T19:20:36.227 INFO:teuthology.misc:Compressing logs... 2022-01-17T19:20:44.038 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/762c2c9a-7795-11ec-8c34-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-17T19:20:45.371 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/762c2c9a-7795-11ec-8c34-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-17T19:20:51.936 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/762c2c9a-7795-11ec-8c34-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-17T19:20:52.346 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/762c2c9a-7795-11ec-8c34-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-17T19:20:53.813 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/762c2c9a-7795-11ec-8c34-001a4aab830c/ceph-mgr.smithi031.htkcul.log: file size changed while zipping 2022-01-17T19:20:55.404 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/762c2c9a-7795-11ec-8c34-001a4aab830c/ceph-mon.smithi103.log: file size changed while zipping 2022-01-17T19:21:02.404 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/762c2c9a-7795-11ec-8c34-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-17T19:21:02.879 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/762c2c9a-7795-11ec-8c34-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-17T19:21:11.763 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/762c2c9a-7795-11ec-8c34-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-17T19:21:12.079 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/762c2c9a-7795-11ec-8c34-001a4aab830c/ceph-mon.smithi031.log: file size changed while zipping 2022-01-17T19:21:22.471 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/762c2c9a-7795-11ec-8c34-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-17T19:21:39.529 INFO:teuthology.kill:No teuthology processes running 2022-01-17T19:21:40.620 INFO:teuthology.kill:Nuking machines: ['smithi031', 'smithi103'] 2022-01-17T19:21:41.542 INFO:teuthology.kill:2022-01-17 19:21:41,542.542 INFO:teuthology.nuke:targets: 2022-01-17T19:21:41.543 INFO:teuthology.kill: smithi031.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDB8ckIbYe+G1pLVpIXaaBzYZPmAmge0FBCqkoZ+tC+fkCQ40teLOXBvDezSicd+M8+KaaBhTUlbRH5H+2Rb9ShYxpPElAtB8kRcwzjEJRiWmnoRYpfsw3v+PEggB9ISKK+YHa/ySGwbRR9qlfIG63AvqvnWorZzuVYTrUXVkyUbm1YBon2zveDtBivC+XVKEflGOuF2bE2t4lS82k1+LvURs3Z4ejrzTrUrwQz/zuBl7ti7EHTXtrEnGd1/VX7e2ScKC3Ip+nFyX0eStB810ypKFiRO3TokAIq3TVEpJ93WZVeTrvBEPHrHAuvjVhKTn/EU7je/HsCi0+ckPgKl1d+abDW17fmKd5/prDpKj1EpY55OmCK280QKbLdFr5YOeJjAA/zlQ0YfiCCVglZosB+XX1LacUPBe2TiewRZmy4l40YPTzENQXQ/XdbhlDuxHo+3pbLHKTchSZYvk6L9fMKsY+IPfHMWGea0JJgo8D8c9MgBRFrab9qbVa+brY7L8U= 2022-01-17T19:21:41.543 INFO:teuthology.kill: smithi103.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+0UPLw/y6dwxDd5DucWACUYO8MrGkXkVBOzuHWCQ/Mep4CRCf7Xt2HBlsytgNumQ7AHzlHdkAFWkY6pJONMzNEuVQvdiJtWcBS5cnwQB+vRt3EvsIXRe4ncG8gdk9dMYOZQ/E89OLHyWHhutj3AhYkNM0CTRp0VJnh0RlYOTPwEqZgM6nh6GED8mYrUP/vXXKgrdWt2znidh10j6fobXZLY9vCMj1srpcG7I9dWGVX3RVJHTAJHhILTEJV4fvC4wZMrYSs2PTEkL6hHho/vC9WF76yy7QunzPSJoBafOqPLIwBt4/fFSi7+zTa4SINFEv8QqDOu8JvoZnEhtxaZYUeH9U2Jj/0WkG9/xxpfiMBuRN5DnYxzGC+uNZ4EnZsn7afV6ZbuOpGqBFuuxYxqXCnAqAn9V8vTOQB5iR3O8iG98dGelivpqhGJSmAxwiI67PxtODxjSSkqP379kMJamgv2s+cIMjwN20jyuKBQdzZ/R2Sr+xBwgWPhh58r4oGYs= 2022-01-17T19:21:41.569 INFO:teuthology.kill:2022-01-17 19:21:41,569.569 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-17T19:21:41.580 INFO:teuthology.kill:2022-01-17 19:21:41,579.579 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-17T19:21:41.642 INFO:teuthology.kill:2022-01-17 19:21:41,642.642 INFO:teuthology.orchestra.console:Power off smithi031 2022-01-17T19:21:41.658 INFO:teuthology.kill:2022-01-17 19:21:41,657.657 INFO:teuthology.orchestra.console:Power off smithi103 2022-01-17T19:21:54.128 INFO:teuthology.kill:2022-01-17 19:21:54,127.127 INFO:teuthology.orchestra.console:Power off for smithi031 completed 2022-01-17T19:21:54.133 INFO:teuthology.kill:2022-01-17 19:21:54,133.133 INFO:teuthology.orchestra.console:Power off for smithi103 completed 2022-01-17T19:21:54.280 INFO:teuthology.kill:2022-01-17 19:21:54,279.279 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com 2022-01-17T19:21:54.283 INFO:teuthology.kill:2022-01-17 19:21:54,283.283 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com 2022-01-17T19:23:54.603 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15