2021-12-15T21:01:40.494 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-15T21:01:40.614 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi068.front.sepia.ceph.com' reimaging
2021-12-15T21:01:40.615 INFO:teuthology.lock.ops:Updating [ubuntu@smithi068.front.sepia.ceph.com]: reset os type and version on server
2021-12-15T21:01:40.615 INFO:teuthology.lock.ops:Updating smithi068.front.sepia.ceph.com on lock server
2021-12-15T21:01:40.634 INFO:teuthology.lock.ops:Node 'ubuntu@smithi068.front.sepia.ceph.com' reimaging is complete
2021-12-15T21:01:40.634 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi191.front.sepia.ceph.com' reimaging
2021-12-15T21:01:40.635 INFO:teuthology.lock.ops:Updating [ubuntu@smithi191.front.sepia.ceph.com]: reset os type and version on server
2021-12-15T21:01:40.635 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2021-12-15T21:01:40.654 INFO:teuthology.lock.ops:Node 'ubuntu@smithi191.front.sepia.ceph.com' reimaging is complete
2021-12-15T21:01:40.855 INFO:teuthology.provision.fog.smithi068:Scheduling deploy of centos 8.2
2021-12-15T21:01:40.860 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 8.2
2021-12-15T21:01:41.196 INFO:teuthology.orchestra.console:Power off smithi068
2021-12-15T21:01:41.250 INFO:teuthology.orchestra.console:Power off smithi191
2021-12-15T21:01:49.588 INFO:teuthology.orchestra.console:Power off for smithi068 completed
2021-12-15T21:01:49.689 INFO:teuthology.orchestra.console:Power on smithi068
2021-12-15T21:01:53.724 INFO:teuthology.orchestra.console:Power off for smithi191 completed
2021-12-15T21:01:53.825 INFO:teuthology.orchestra.console:Power on smithi191
2021-12-15T21:01:58.072 INFO:teuthology.orchestra.console:Power on for smithi068 completed
2021-12-15T21:01:58.075 INFO:teuthology.orchestra.console:Power on for smithi191 completed
2021-12-15T21:01:58.173 INFO:teuthology.provision.fog.smithi068:Waiting for deploy to finish
2021-12-15T21:01:58.177 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish
2021-12-15T21:06:48.166 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-15T21:06:48.492 INFO:teuthology.provision.fog.smithi068:Node is ready
2021-12-15T21:06:48.507 INFO:teuthology.orchestra.run.smithi068.stdout:smithi068.front.sepia.ceph.com
2021-12-15T21:06:48.563 INFO:teuthology.orchestra.run.smithi068.stdout:172.21.15.68 smithi068.front.sepia.ceph.com smithi068
2021-12-15T21:06:48.981 INFO:teuthology.provision.fog.smithi068:Deploy complete!
2021-12-15T21:07:03.130 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-15T21:07:03.409 INFO:teuthology.provision.fog.smithi191:Node is ready
2021-12-15T21:07:03.464 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com
2021-12-15T21:07:03.519 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191
2021-12-15T21:07:03.834 INFO:teuthology.provision.fog.smithi191:Deploy complete!
2021-12-15T21:07:03.986 INFO:teuthology.lock.ops:Checking smithi068.front.sepia.ceph.com
2021-12-15T21:07:03.987 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-15T21:07:04.027 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com
2021-12-15T21:07:04.028 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-15T21:07:04.076 INFO:teuthology.lock.ops:Updating [smithi068.front.sepia.ceph.com]: set os type and version on server
2021-12-15T21:07:04.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi068.front.sepia.ceph.com'
2021-12-15T21:07:04.353 INFO:teuthology.orchestra.run.smithi068.stdout:x86_64
2021-12-15T21:07:04.408 INFO:teuthology.orchestra.run.smithi068.stdout:NAME="CentOS Linux"
2021-12-15T21:07:04.409 INFO:teuthology.orchestra.run.smithi068.stdout:VERSION="8 (Core)"
2021-12-15T21:07:04.409 INFO:teuthology.orchestra.run.smithi068.stdout:ID="centos"
2021-12-15T21:07:04.410 INFO:teuthology.orchestra.run.smithi068.stdout:ID_LIKE="rhel fedora"
2021-12-15T21:07:04.410 INFO:teuthology.orchestra.run.smithi068.stdout:VERSION_ID="8"
2021-12-15T21:07:04.410 INFO:teuthology.orchestra.run.smithi068.stdout:PLATFORM_ID="platform:el8"
2021-12-15T21:07:04.411 INFO:teuthology.orchestra.run.smithi068.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-12-15T21:07:04.412 INFO:teuthology.orchestra.run.smithi068.stdout:ANSI_COLOR="0;31"
2021-12-15T21:07:04.412 INFO:teuthology.orchestra.run.smithi068.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-15T21:07:04.412 INFO:teuthology.orchestra.run.smithi068.stdout:HOME_URL="https://www.centos.org/"
2021-12-15T21:07:04.413 INFO:teuthology.orchestra.run.smithi068.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-12-15T21:07:04.414 INFO:teuthology.orchestra.run.smithi068.stdout:
2021-12-15T21:07:04.414 INFO:teuthology.orchestra.run.smithi068.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-12-15T21:07:04.414 INFO:teuthology.orchestra.run.smithi068.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-12-15T21:07:04.414 INFO:teuthology.orchestra.run.smithi068.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-12-15T21:07:04.415 INFO:teuthology.orchestra.run.smithi068.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-12-15T21:07:04.415 INFO:teuthology.orchestra.run.smithi068.stdout:
2021-12-15T21:07:04.416 INFO:teuthology.lock.ops:Updating smithi068.front.sepia.ceph.com on lock server
2021-12-15T21:07:04.435 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server
2021-12-15T21:07:04.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com'
2021-12-15T21:07:04.636 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64
2021-12-15T21:07:04.691 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Linux"
2021-12-15T21:07:04.692 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8 (Core)"
2021-12-15T21:07:04.692 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos"
2021-12-15T21:07:04.692 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora"
2021-12-15T21:07:04.693 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8"
2021-12-15T21:07:04.693 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8"
2021-12-15T21:07:04.693 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-12-15T21:07:04.694 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31"
2021-12-15T21:07:04.694 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-15T21:07:04.694 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.centos.org/"
2021-12-15T21:07:04.695 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-12-15T21:07:04.695 INFO:teuthology.orchestra.run.smithi191.stdout:
2021-12-15T21:07:04.695 INFO:teuthology.orchestra.run.smithi191.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-12-15T21:07:04.695 INFO:teuthology.orchestra.run.smithi191.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-12-15T21:07:04.696 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-12-15T21:07:04.696 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-12-15T21:07:04.696 INFO:teuthology.orchestra.run.smithi191.stdout:
2021-12-15T21:07:04.697 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2021-12-15T21:07:04.822 INFO:teuthology.dispatcher.supervisor:Running job 6564728
2021-12-15T21:07:04.823 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-12-15_15:59:44-rados-wip-sage2-testing-2021-12-14-1714-distro-basic-smithi/6564728 --name sage-2021-12-15_15:59:44-rados-wip-sage2-testing-2021-12-14-1714-distro-basic-smithi --description rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} -- /home/teuthworker/archive/sage-2021-12-15_15:59:44-rados-wip-sage2-testing-2021-12-14-1714-distro-basic-smithi/6564728/orig.config.yaml
2021-12-15T21:07:04.826 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-12-15_15:59:44-rados-wip-sage2-testing-2021-12-14-1714-distro-basic-smithi/6564728
2021-12-15T21:07:04.827 INFO:teuthology.dispatcher.supervisor:Job PID: 18541
2021-12-15T21:07:04.827 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-15T21:07:58.164 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-12-16T09:07:59.251 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-16T09:07:59.408 INFO:teuthology.kill:Killing Pids: {18541}
2021-12-16T09:08:00.589 INFO:teuthology.task.internal:roles: ubuntu@smithi068.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a']
2021-12-16T09:08:00.590 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a']
2021-12-16T09:08:00.591 INFO:teuthology.misc:Compressing logs...
2021-12-16T09:08:00.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi068.front.sepia.ceph.com'
2021-12-16T09:08:00.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com'
2021-12-16T09:08:01.118 INFO:teuthology.misc:Compressing logs...
2021-12-16T09:08:04.296 INFO:teuthology.orchestra.run.smithi191.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-16T09:08:05.370 INFO:teuthology.misc:Compressing logs...
2021-12-16T09:08:27.581 INFO:teuthology.orchestra.run.smithi191.stderr:gzip: /var/log/ceph/9f069a00-5dec-11ec-8c31-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-12-16T09:08:31.922 INFO:teuthology.orchestra.run.smithi068.stderr:gzip: /var/log/ceph/9f069a00-5dec-11ec-8c31-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-12-16T09:08:48.547 INFO:teuthology.orchestra.run.smithi068.stderr:gzip: /var/log/ceph/9f069a00-5dec-11ec-8c31-001a4aab830c/ceph-mon.c.log: file size changed while zipping
2021-12-16T09:09:02.794 INFO:teuthology.orchestra.run.smithi191.stderr:gzip: /var/log/ceph/9f069a00-5dec-11ec-8c31-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-12-16T09:09:05.349 INFO:teuthology.orchestra.run.smithi068.stderr:gzip: /var/log/ceph/9f069a00-5dec-11ec-8c31-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-12-16T09:09:23.867 INFO:teuthology.orchestra.run.smithi191.stderr:gzip: /var/log/ceph/9f069a00-5dec-11ec-8c31-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-12-16T09:09:31.798 INFO:teuthology.orchestra.run.smithi068.stderr:gzip: /var/log/ceph/9f069a00-5dec-11ec-8c31-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-12-16T09:09:31.963 INFO:teuthology.orchestra.run.smithi191.stderr:gzip: /var/log/ceph/9f069a00-5dec-11ec-8c31-001a4aab830c/ceph-mgr.x.log: file size changed while zipping
2021-12-16T09:09:43.289 INFO:teuthology.orchestra.run.smithi191.stderr:gzip: /var/log/ceph/9f069a00-5dec-11ec-8c31-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2021-12-16T09:10:03.628 INFO:teuthology.orchestra.run.smithi191.stderr:gzip: /var/log/ceph/9f069a00-5dec-11ec-8c31-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-12-16T09:10:08.242 INFO:teuthology.orchestra.run.smithi068.stderr:gzip: /var/log/ceph/9f069a00-5dec-11ec-8c31-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-12-16T09:11:55.758 INFO:teuthology.orchestra.run.smithi191.stderr:tar: ./9f069a00-5dec-11ec-8c31-001a4aab830c: file changed as we read it
2021-12-16T09:11:55.942 INFO:teuthology.kill:No teuthology processes running
2021-12-16T09:11:57.124 INFO:teuthology.kill:Nuking machines: ['smithi068', 'smithi191']
2021-12-16T09:11:58.101 INFO:teuthology.kill:2021-12-16 09:11:58,101.101 INFO:teuthology.nuke:targets:
2021-12-16T09:11:58.103 INFO:teuthology.kill:  smithi068.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxRJq8fV6eV7Ov9cwVNhnJLgfoSt1Um0hn19cOsEFZ2oZZWXom5+wt4RUHh8a6tayzhC2JxU38fWjAJZBGNBr9zwb4B8LmDwkwgofcpmcPPXhe4BjJ2bXzJuUNoowdy0RYZQUtxP+MkAkjAGF/prol9q9bNrDfogt2I1QVzlR7RrsoGMw5XQkY/2YygDB+anq4u2cwf+fBq/LAwRpdRw4BVSFoTvx37cRayN20NcPlSeVvJ1YgI5NNKWI/hQy3Qkasjl8HtMX9QBNzKAXzZxha/IBPr15liDWyh8QRRHLBTdZ9MW+yw2Tz31PueR0TARlfgNcgN0GxG5pZ0m/difRpfbMcHyBHNGoYQIk0f9HZ6q6m/uLQPcBowm+OYe0iJjVO9zoY7GLMaRzUtLVHcatJpV96gdLeV/aXNcH6wfRy0cZ/rpBGvGebSgJLacBDPtblCS3O1lZzdoSEI7EX2/phwzwgqQFMN+8wMj6tITS+8jH5wD/I+1Iv52n+HqvXwTM=
2021-12-16T09:11:58.103 INFO:teuthology.kill:  smithi191.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCuQeWlZ26qrWSE3jg74eUjdFQ3bN+TKbXoM/VX5dhJdqs5U0hPnAyq+ghJCSLoPtBESJ+s2ftlOUWT3Tkh9A8mUSDyeWE+Xj/zuPo3NLeLdA4BtDPgtnrY5o6+i3OIQuP/scsE0Iyf+cGNZqhzu61GSOk0Tgvb7P/m0XicPYuwrdySC6W+8k0oR1EgKdeENBXm4EhrYOKLQ2DrtVZ1rYv8oUoxzRJtjCpfTVhLeJUu9esor/BPe6VLWUEL0kcgbW9k06RpiA/7PYrrz6h0zTGVF2PjHQNGE6WTWj0Iai8d37LjyBrLHWCI9A0gEpKE87SkTygLiFKC9gNyrUBdOUZXoIHRNRxks7bu7yL6c4B3pECRtItQkGNOWmQgTGeY8w6aj1Eozftm7p+46aLJdpKc4kVzL4qEwQXD+aCbBaw6bJx2NrDuLLPYCdst7hs5aBb7ENpnBB1T4QZBi+SyqzU9DWAqGFDB/aLxUKchS/9um1xjiC+Q0NO6m4JdUdaSyK8=
2021-12-16T09:11:58.136 INFO:teuthology.kill:2021-12-16 09:11:58,136.136 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-16T09:11:58.139 INFO:teuthology.kill:2021-12-16 09:11:58,139.139 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-16T09:11:58.214 INFO:teuthology.kill:2021-12-16 09:11:58,214.214 INFO:teuthology.orchestra.console:Power off smithi068
2021-12-16T09:11:58.231 INFO:teuthology.kill:2021-12-16 09:11:58,230.230 INFO:teuthology.orchestra.console:Power off smithi191
2021-12-16T09:12:06.587 INFO:teuthology.kill:2021-12-16 09:12:06,586.586 INFO:teuthology.orchestra.console:Power off for smithi068 completed
2021-12-16T09:12:06.750 INFO:teuthology.kill:2021-12-16 09:12:06,749.749 INFO:teuthology.lock.ops:unlocked: smithi068.front.sepia.ceph.com
2021-12-16T09:12:10.706 INFO:teuthology.kill:2021-12-16 09:12:10,706.706 INFO:teuthology.orchestra.console:Power off for smithi191 completed
2021-12-16T09:12:10.851 INFO:teuthology.kill:2021-12-16 09:12:10,850.850 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com
2021-12-16T09:14:11.159 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-16T09:14:11.243 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi068 but it was locked by another job: /home/teuthworker/archive/vshankar-2021-12-16_08:47:24-fs-wip-vshankar-testing-20211216-114012-testing-default-smithi/6566294
2021-12-16T09:14:11.244 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi191 but it was locked by another job: /home/teuthworker/archive/vshankar-2021-12-16_08:47:24-fs-wip-vshankar-testing-20211216-114012-testing-default-smithi/6566294