2021-12-19T14:28:08.663 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-19T14:28:08.791 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi070.front.sepia.ceph.com' reimaging
2021-12-19T14:28:08.792 INFO:teuthology.lock.ops:Updating [ubuntu@smithi070.front.sepia.ceph.com]: reset os type and version on server
2021-12-19T14:28:08.792 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server
2021-12-19T14:28:08.816 INFO:teuthology.lock.ops:Node 'ubuntu@smithi070.front.sepia.ceph.com' reimaging is complete
2021-12-19T14:28:08.816 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi111.front.sepia.ceph.com' reimaging
2021-12-19T14:28:08.817 INFO:teuthology.lock.ops:Updating [ubuntu@smithi111.front.sepia.ceph.com]: reset os type and version on server
2021-12-19T14:28:08.817 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2021-12-19T14:28:08.837 INFO:teuthology.lock.ops:Node 'ubuntu@smithi111.front.sepia.ceph.com' reimaging is complete
2021-12-19T14:28:09.045 INFO:teuthology.provision.fog.smithi070:Scheduling deploy of centos 8.3
2021-12-19T14:28:09.080 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of centos 8.3
2021-12-19T14:28:09.621 INFO:teuthology.orchestra.console:Power off smithi070
2021-12-19T14:28:09.754 INFO:teuthology.orchestra.console:Power off smithi111
2021-12-19T14:28:17.988 INFO:teuthology.orchestra.console:Power off for smithi070 completed
2021-12-19T14:28:18.090 INFO:teuthology.orchestra.console:Power on smithi070
2021-12-19T14:28:18.118 INFO:teuthology.orchestra.console:Power off for smithi111 completed
2021-12-19T14:28:18.220 INFO:teuthology.orchestra.console:Power on smithi111
2021-12-19T14:28:26.458 INFO:teuthology.orchestra.console:Power on for smithi070 completed
2021-12-19T14:28:26.559 INFO:teuthology.provision.fog.smithi070:Waiting for deploy to finish
2021-12-19T14:28:26.636 INFO:teuthology.orchestra.console:Power on for smithi111 completed
2021-12-19T14:28:26.737 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2021-12-19T14:33:17.353 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-19T14:33:17.678 INFO:teuthology.provision.fog.smithi070:Node is ready
2021-12-19T14:33:17.695 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070.front.sepia.ceph.com
2021-12-19T14:33:17.751 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70 smithi070.front.sepia.ceph.com smithi070
2021-12-19T14:33:18.080 INFO:teuthology.provision.fog.smithi070:Deploy complete!
2021-12-19T14:33:32.353 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-19T14:33:32.642 INFO:teuthology.provision.fog.smithi111:Node is ready
2021-12-19T14:33:32.657 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2021-12-19T14:33:32.712 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2021-12-19T14:33:33.033 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2021-12-19T14:33:33.189 INFO:teuthology.lock.ops:Checking smithi070.front.sepia.ceph.com
2021-12-19T14:33:33.190 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-19T14:33:33.215 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2021-12-19T14:33:33.216 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-19T14:33:33.233 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: set os type and version on server
2021-12-19T14:33:33.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com'
2021-12-19T14:33:33.499 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64
2021-12-19T14:33:33.555 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Linux"
2021-12-19T14:33:33.555 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8"
2021-12-19T14:33:33.555 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos"
2021-12-19T14:33:33.556 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora"
2021-12-19T14:33:33.556 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8"
2021-12-19T14:33:33.556 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8"
2021-12-19T14:33:33.557 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Linux 8"
2021-12-19T14:33:33.557 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31"
2021-12-19T14:33:33.557 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-19T14:33:33.557 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/"
2021-12-19T14:33:33.558 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-12-19T14:33:33.558 INFO:teuthology.orchestra.run.smithi070.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-12-19T14:33:33.558 INFO:teuthology.orchestra.run.smithi070.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-12-19T14:33:33.559 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server
2021-12-19T14:33:33.578 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2021-12-19T14:33:33.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2021-12-19T14:33:33.839 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2021-12-19T14:33:33.893 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Linux"
2021-12-19T14:33:33.893 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8"
2021-12-19T14:33:33.894 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2021-12-19T14:33:33.894 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2021-12-19T14:33:33.894 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8"
2021-12-19T14:33:33.895 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2021-12-19T14:33:33.895 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Linux 8"
2021-12-19T14:33:33.895 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2021-12-19T14:33:33.895 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-19T14:33:33.895 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2021-12-19T14:33:33.896 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-12-19T14:33:33.896 INFO:teuthology.orchestra.run.smithi111.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-12-19T14:33:33.896 INFO:teuthology.orchestra.run.smithi111.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-12-19T14:33:33.897 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2021-12-19T14:33:34.000 INFO:teuthology.dispatcher.supervisor:Running job 6570938
2021-12-19T14:33:34.000 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-12-19_03:31:03-rados-pacific-distro-default-smithi/6570938 --name teuthology-2021-12-19_03:31:03-rados-pacific-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.3_container_tools_3.0 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/teuthology-2021-12-19_03:31:03-rados-pacific-distro-default-smithi/6570938/orig.config.yaml
2021-12-19T14:33:34.003 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-12-19_03:31:03-rados-pacific-distro-default-smithi/6570938
2021-12-19T14:33:34.004 INFO:teuthology.dispatcher.supervisor:Job PID: 20304
2021-12-19T14:33:34.004 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-20T02:34:28.107 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-20T02:34:28.307 INFO:teuthology.kill:Killing Pids: {20304}
2021-12-20T02:34:29.530 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-12-20T02:34:29.531 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-12-20T02:34:29.532 INFO:teuthology.misc:Compressing logs...
2021-12-20T02:34:29.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com'
2021-12-20T02:34:29.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2021-12-20T02:34:29.796 INFO:teuthology.orchestra.run.smithi070.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-20T02:34:30.004 INFO:teuthology.orchestra.run.smithi111.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-20T02:34:30.042 INFO:teuthology.orchestra.run.smithi070.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-20T02:34:30.043 INFO:teuthology.orchestra.run.smithi070.stderr:tar: Error is not recoverable: exiting now
2021-12-20T02:34:30.077 INFO:teuthology.orchestra.run.smithi111.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-20T02:34:30.077 INFO:teuthology.orchestra.run.smithi111.stderr:tar: Error is not recoverable: exiting now
2021-12-20T02:34:30.078 INFO:teuthology.misc:Compressing logs...
2021-12-20T02:34:30.357 INFO:teuthology.orchestra.run.smithi111.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-20T02:34:30.520 INFO:teuthology.misc:Compressing logs...
2021-12-20T02:35:00.859 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/fd6f2a54-60d9-11ec-8c31-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-12-20T02:35:02.604 INFO:teuthology.orchestra.run.smithi111.stderr:gzip: /var/log/ceph/fd6f2a54-60d9-11ec-8c31-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-12-20T02:35:22.146 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/fd6f2a54-60d9-11ec-8c31-001a4aab830c/ceph-mon.smithi070.log: file size changed while zipping
2021-12-20T02:35:29.479 INFO:teuthology.orchestra.run.smithi111.stderr:gzip: /var/log/ceph/fd6f2a54-60d9-11ec-8c31-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-12-20T02:35:35.585 INFO:teuthology.orchestra.run.smithi111.stderr:gzip: /var/log/ceph/fd6f2a54-60d9-11ec-8c31-001a4aab830c/ceph-mon.smithi111.log: file size changed while zipping
2021-12-20T02:35:46.630 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/fd6f2a54-60d9-11ec-8c31-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-12-20T02:35:55.394 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/fd6f2a54-60d9-11ec-8c31-001a4aab830c/ceph-mgr.smithi070.zhcvtm.log: file size changed while zipping
2021-12-20T02:36:02.274 INFO:teuthology.orchestra.run.smithi111.stderr:gzip: /var/log/ceph/fd6f2a54-60d9-11ec-8c31-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-12-20T02:36:12.948 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/fd6f2a54-60d9-11ec-8c31-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-12-20T02:36:25.658 INFO:teuthology.orchestra.run.smithi111.stderr:gzip: /var/log/ceph/fd6f2a54-60d9-11ec-8c31-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-12-20T02:36:42.968 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/fd6f2a54-60d9-11ec-8c31-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-12-20T02:37:36.464 INFO:teuthology.kill:No teuthology processes running
2021-12-20T02:37:37.639 INFO:teuthology.kill:Nuking machines: ['smithi070', 'smithi111']
2021-12-20T02:37:38.646 INFO:teuthology.kill:2021-12-20 02:37:38,645.645 INFO:teuthology.nuke:targets:
2021-12-20T02:37:38.647 INFO:teuthology.kill:  smithi070.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC26e/qQ84/6PvbdzPxaEH1xXvi/gAynWczSWsfLA5bzgwNz/dZ09ONxv6BdDmsnEgChhwZFrsXJs9P0Kc7EULCxnitFAd4OMy4fxPiO+cyoHjfDdP6S0p7HMXoRcDN516rbbJLMVyNiEX3vfZZEWn+yAKRTTNP3yZOjfINwIgMsj6XQxTotulLdaXoEF90cctJlslV7N5hCGk4Jx3K0agywLFzvDMQ4gQnw8RbdniGMBu5tJEHNY/547iO3eVO0qnRCk7FdOccxRzPS7jzXGAX5ndFFkR2+HL61oAZF+iybYOPu1a9pjzEmSiJZxw+0l83CaZxZQCF06VLUcW2EhPBz/btoOa8jGuBBWrA+BQMETEFl9xKl0vN3l6vwNScua/e0Z4g/2nZz/YNqVsor6OOVciWjgYmnvOmL0yxLXNNAYL8eiB/UHjBvjb7JZwGmT164X6iV/OI0mFDrmXgaxsa2LHmV1Di8GOI27PoMMt/qxeKO7XWfzAdXpau9H40jJ8=
2021-12-20T02:37:38.647 INFO:teuthology.kill:  smithi111.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHnGfGrT8CA5IGWVb1meBHKQc5RJ2u/BE6loHBEDPjg/IT5yDmw6UUtoU+4dNSmY6J2DyKHvniv7jzQ91VWcJmT9PIGVVBEQ6hMGxGV6y+S96JnfXDhmmGS/9gYfRXITBHEK6oM0zZx5TIHfBthzitIYbj1QJXy6L2GrDm2bAJb5xv7mRGJ0MYKXSOXNaxbDlfho4eCfpEknnanY5Ue3LCZR+Wt8bwv75bCfrWX09tHI09n6QbUm9Z9p5ImZwfdtZMVBU6gnQHX36WH/GiwaLRT7gZqcQthyam/Gr0l7cA1G6qDnx4fyHq7cp14QYP2T/koaVvIP1zg/PniasBSBWpzs7QCPYuvI1CcXgPYDBKeTramHIWgpJrnUBDhGJZjJj2i1HvYYY4W/fAxnQNHpOtsKzrRHYrYuimxsU4x2Zib0vrGGxo3SkAtYZ6RHhHbOgp4LElZ/fEu3jVy961Atk6Ljtz2gx97rYi48R4pxIu/duIaM5DiDVej5Nm1tk+1xE=
2021-12-20T02:37:38.673 INFO:teuthology.kill:2021-12-20 02:37:38,672.672 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-20T02:37:38.676 INFO:teuthology.kill:2021-12-20 02:37:38,676.676 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-20T02:37:38.749 INFO:teuthology.kill:2021-12-20 02:37:38,749.749 INFO:teuthology.orchestra.console:Power off smithi111
2021-12-20T02:37:38.765 INFO:teuthology.kill:2021-12-20 02:37:38,765.765 INFO:teuthology.orchestra.console:Power off smithi070
2021-12-20T02:37:47.124 INFO:teuthology.kill:2021-12-20 02:37:47,123.123 INFO:teuthology.orchestra.console:Power off for smithi111 completed
2021-12-20T02:37:47.128 INFO:teuthology.kill:2021-12-20 02:37:47,128.128 INFO:teuthology.orchestra.console:Power off for smithi070 completed
2021-12-20T02:37:47.282 INFO:teuthology.kill:2021-12-20 02:37:47,281.281 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com
2021-12-20T02:37:47.285 INFO:teuthology.kill:2021-12-20 02:37:47,285.285 INFO:teuthology.lock.ops:unlocked: smithi070.front.sepia.ceph.com
2021-12-20T02:39:47.606 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-20T02:39:47.734 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi070 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-20_02:01:03-rbd-master-distro-default-smithi/6572725
2021-12-20T02:39:47.734 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi111 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-20_02:01:03-rbd-master-distro-default-smithi/6572725