2022-01-06T10:30:43.533 INFO:root:teuthology version: 1.1.0-95a7d479 2022-01-06T10:30:43.651 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi060.front.sepia.ceph.com' reimaging 2022-01-06T10:30:43.652 INFO:teuthology.lock.ops:Updating [ubuntu@smithi060.front.sepia.ceph.com]: reset os type and version on server 2022-01-06T10:30:43.653 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2022-01-06T10:30:43.672 INFO:teuthology.lock.ops:Node 'ubuntu@smithi060.front.sepia.ceph.com' reimaging is complete 2022-01-06T10:30:43.672 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi105.front.sepia.ceph.com' reimaging 2022-01-06T10:30:43.673 INFO:teuthology.lock.ops:Updating [ubuntu@smithi105.front.sepia.ceph.com]: reset os type and version on server 2022-01-06T10:30:43.673 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2022-01-06T10:30:43.694 INFO:teuthology.lock.ops:Node 'ubuntu@smithi105.front.sepia.ceph.com' reimaging is complete 2022-01-06T10:30:43.917 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of centos 8.2 2022-01-06T10:30:43.921 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.2 2022-01-06T10:30:44.257 INFO:teuthology.orchestra.console:Power off smithi060 2022-01-06T10:30:44.274 INFO:teuthology.orchestra.console:Power off smithi105 2022-01-06T10:30:52.630 INFO:teuthology.orchestra.console:Power off for smithi060 completed 2022-01-06T10:30:52.732 INFO:teuthology.orchestra.console:Power on smithi060 2022-01-06T10:30:56.745 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2022-01-06T10:30:56.847 INFO:teuthology.orchestra.console:Power on smithi105 2022-01-06T10:30:56.986 INFO:teuthology.orchestra.console:Power on for smithi060 completed 2022-01-06T10:30:57.088 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish 2022-01-06T10:31:01.100 INFO:teuthology.orchestra.console:Power on for smithi105 completed 2022-01-06T10:31:01.201 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2022-01-06T10:34:38.194 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-06T10:34:48.159 INFO:teuthology.provision.fog.smithi060:Node is ready 2022-01-06T10:34:48.177 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com 2022-01-06T10:34:48.233 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060 2022-01-06T10:34:48.598 INFO:teuthology.provision.fog.smithi060:Deploy complete! 2022-01-06T10:36:06.234 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-06T10:36:06.518 INFO:teuthology.provision.fog.smithi105:Node is ready 2022-01-06T10:36:06.573 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2022-01-06T10:36:06.629 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2022-01-06T10:36:06.947 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2022-01-06T10:36:07.110 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com 2022-01-06T10:36:07.111 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-06T10:36:07.130 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2022-01-06T10:36:07.130 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-06T10:36:07.150 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server 2022-01-06T10:36:07.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2022-01-06T10:36:07.431 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2022-01-06T10:36:07.486 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Linux" 2022-01-06T10:36:07.487 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8 (Core)" 2022-01-06T10:36:07.487 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2022-01-06T10:36:07.487 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2022-01-06T10:36:07.487 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8" 2022-01-06T10:36:07.488 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8" 2022-01-06T10:36:07.488 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2022-01-06T10:36:07.488 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2022-01-06T10:36:07.489 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-06T10:36:07.489 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.centos.org/" 2022-01-06T10:36:07.489 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-06T10:36:07.489 INFO:teuthology.orchestra.run.smithi060.stdout: 2022-01-06T10:36:07.490 INFO:teuthology.orchestra.run.smithi060.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-06T10:36:07.490 INFO:teuthology.orchestra.run.smithi060.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-06T10:36:07.490 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2022-01-06T10:36:07.490 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2022-01-06T10:36:07.490 INFO:teuthology.orchestra.run.smithi060.stdout: 2022-01-06T10:36:07.492 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2022-01-06T10:36:07.510 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2022-01-06T10:36:07.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2022-01-06T10:36:07.767 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2022-01-06T10:36:07.822 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Linux" 2022-01-06T10:36:07.823 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8 (Core)" 2022-01-06T10:36:07.823 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2022-01-06T10:36:07.823 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2022-01-06T10:36:07.823 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2022-01-06T10:36:07.824 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2022-01-06T10:36:07.824 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2022-01-06T10:36:07.824 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2022-01-06T10:36:07.824 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-06T10:36:07.824 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.centos.org/" 2022-01-06T10:36:07.825 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-06T10:36:07.825 INFO:teuthology.orchestra.run.smithi105.stdout: 2022-01-06T10:36:07.825 INFO:teuthology.orchestra.run.smithi105.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-06T10:36:07.825 INFO:teuthology.orchestra.run.smithi105.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-06T10:36:07.826 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2022-01-06T10:36:07.826 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2022-01-06T10:36:07.826 INFO:teuthology.orchestra.run.smithi105.stdout: 2022-01-06T10:36:07.827 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2022-01-06T10:36:07.922 INFO:teuthology.dispatcher.supervisor:Running job 6597661 2022-01-06T10:36:07.923 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_swagner@teuthology --archive /home/teuthworker/archive/swagner-2022-01-06_10:04:35-orch:cephadm-wip-swagner-testing-2022-01-05-1435-distro-default-smithi/6597661 --name swagner-2022-01-06_10:04:35-orch:cephadm-wip-swagner-testing-2022-01-05-1435-distro-default-smithi --description orch:cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} -- /home/teuthworker/archive/swagner-2022-01-06_10:04:35-orch:cephadm-wip-swagner-testing-2022-01-05-1435-distro-default-smithi/6597661/orig.config.yaml 2022-01-06T10:36:07.926 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/swagner-2022-01-06_10:04:35-orch:cephadm-wip-swagner-testing-2022-01-05-1435-distro-default-smithi/6597661 2022-01-06T10:36:07.927 INFO:teuthology.dispatcher.supervisor:Job PID: 4217 2022-01-06T10:36:07.927 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-06T22:37:01.673 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-01-06T22:37:01.859 INFO:teuthology.kill:Killing Pids: {4217} 2022-01-06T22:37:03.048 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-06T22:37:03.049 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-06T22:37:03.049 INFO:teuthology.misc:Compressing logs... 2022-01-06T22:37:03.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2022-01-06T22:37:03.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2022-01-06T22:37:03.314 INFO:teuthology.orchestra.run.smithi060.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-06T22:37:03.513 INFO:teuthology.orchestra.run.smithi105.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-01-06T22:37:03.548 INFO:teuthology.orchestra.run.smithi060.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-06T22:37:03.549 INFO:teuthology.orchestra.run.smithi060.stderr:tar: Error is not recoverable: exiting now 2022-01-06T22:37:03.576 INFO:teuthology.orchestra.run.smithi105.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-06T22:37:03.576 INFO:teuthology.orchestra.run.smithi105.stderr:tar: Error is not recoverable: exiting now 2022-01-06T22:37:03.577 INFO:teuthology.misc:Compressing logs... 2022-01-06T22:37:03.796 INFO:teuthology.misc:Compressing logs... 2022-01-06T22:37:18.337 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/c30ddd6c-6edd-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-06T22:37:20.685 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/c30ddd6c-6edd-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-06T22:37:27.073 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/c30ddd6c-6edd-11ec-8c32-001a4aab830c/ceph-mon.smithi105.log: file size changed while zipping 2022-01-06T22:37:36.643 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/c30ddd6c-6edd-11ec-8c32-001a4aab830c/ceph-mon.smithi060.log: file size changed while zipping 2022-01-06T22:37:40.114 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/c30ddd6c-6edd-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-06T22:37:51.199 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/c30ddd6c-6edd-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-06T22:37:53.949 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/c30ddd6c-6edd-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-06T22:37:54.630 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/c30ddd6c-6edd-11ec-8c32-001a4aab830c/ceph-mgr.smithi060.chgxeg.log: file size changed while zipping 2022-01-06T22:38:10.407 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/c30ddd6c-6edd-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-06T22:38:10.757 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/c30ddd6c-6edd-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-06T22:38:30.193 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/c30ddd6c-6edd-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-06T22:39:02.237 INFO:teuthology.kill:No teuthology processes running 2022-01-06T22:39:03.387 INFO:teuthology.kill:Nuking machines: ['smithi060', 'smithi105'] 2022-01-06T22:39:04.372 INFO:teuthology.kill:2022-01-06 22:39:04,371.371 INFO:teuthology.nuke:targets: 2022-01-06T22:39:04.373 INFO:teuthology.kill: smithi060.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoKqDLAdgGDIrg8yN2xBJ/5gzCzGeK3nmEfOrelbzTuMxG1OlHK77j9XXkwiOyi+L7J4jWnDPRdbaR4pmDNwtnEMlTP0c0WgTYVf2wgIE4zTA4oEu4AQsECKApCdGAoYKMuzWXzb6SygigNEcxpKWNtYwLR4RH0Yru3jB8czP6PMkPvhjHlr+sIapjcXFC+bbhm8Rq40i+jJoXYm7vHvp63UX4ZGRKwQh6VKklRwABKEA4LrVs2pHmcVMb8lEZvApzPBpYIuZaHVOZ6qLf8TF6miMaNIyJqXtCyy0mNmKBMKgimE1xHKNpuMnJgOvna/hrDOXXgFJM4x0+iLnuAIHOoJvJYslVjdE47MiajissU0e4MNCiTHvIzdwCF45rty1/fFUFZ2kaRULR3iiQy5gMd5mzdBOtxfNcYub8QwisZ7ai1YB1ooBSpwBRZteyaQwmJND1aeobwz35jw+IpUcF/0nuFPWucsb1fYxbKODYqRcPIO7h4eXDh6ZQr9iUra0= 2022-01-06T22:39:04.373 INFO:teuthology.kill: smithi105.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeqDvEHhPhDTojd2NYRNfV3RvSDlwR8exGJFZNxFIIJ/7XCd9vg7GcTBi/hf04ypMXfmCsGe+36YlF2qcEQ1Q7Z2eb9j4NY0y49VWp8F4Dl3luwC1HirUkMlr/0SMs30ri3YE6g6TDgMPnEytVRujwEA23zBwNSnUP0JxEls0CQcznW1/GCd3OWceHQyT/Ft1GblkB/4DoU1wAKChih+VV+kKW5HGKFE+nkKSxihsu50FSGaP8YXuGM1qnMgrJeZzYeEhBf/wgSQw33MeD5K7MtjMNDeZX9XgFlWn5XCqPbfVIOYhWaDep2m3xtCwMSgVPeHKpPG76KQUkxidsZvwBCetRe+avZJQbNrP6aGeIS+uLG3b9TKyvqCBchXTWslvs0Ade6l9SujUIh40yN639+Fxp/zZIac9ojwWJqpvOeAwaXVeGpzjSf/FYHQzRtKWxpKIQAmaH5LI02Y2RvJGG8YmQyITDQ5mBrLgKGpWsnRrXoopm3+TRUTXAjlHsGLU= 2022-01-06T22:39:04.400 INFO:teuthology.kill:2022-01-06 22:39:04,400.400 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-06T22:39:04.406 INFO:teuthology.kill:2022-01-06 22:39:04,406.406 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-06T22:39:04.485 INFO:teuthology.kill:2022-01-06 22:39:04,485.485 INFO:teuthology.orchestra.console:Power off smithi060 2022-01-06T22:39:04.498 INFO:teuthology.kill:2022-01-06 22:39:04,498.498 INFO:teuthology.orchestra.console:Power off smithi105 2022-01-06T22:39:16.968 INFO:teuthology.kill:2022-01-06 22:39:16,967.967 INFO:teuthology.orchestra.console:Power off for smithi060 completed 2022-01-06T22:39:16.974 INFO:teuthology.kill:2022-01-06 22:39:16,974.974 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2022-01-06T22:39:17.113 INFO:teuthology.kill:2022-01-06 22:39:17,112.112 INFO:teuthology.lock.ops:unlocked: smithi060.front.sepia.ceph.com 2022-01-06T22:39:17.117 INFO:teuthology.kill:2022-01-06 22:39:17,117.117 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com 2022-01-06T22:41:17.426 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-06T22:41:17.527 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi060 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-06_15:50:38-rados-wip-yuri8-testing-2022-01-05-1411-distro-default-smithi/6599122 2022-01-06T22:41:17.527 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi105 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-06_15:50:38-rados-wip-yuri8-testing-2022-01-05-1411-distro-default-smithi/6599122