2021-12-23T19:58:58.776 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-23T19:58:58.900 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi141.front.sepia.ceph.com' reimaging
2021-12-23T19:58:58.901 INFO:teuthology.lock.ops:Updating [ubuntu@smithi141.front.sepia.ceph.com]: reset os type and version on server
2021-12-23T19:58:58.902 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2021-12-23T19:58:58.921 INFO:teuthology.lock.ops:Node 'ubuntu@smithi141.front.sepia.ceph.com' reimaging is complete
2021-12-23T19:58:58.922 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi162.front.sepia.ceph.com' reimaging
2021-12-23T19:58:58.922 INFO:teuthology.lock.ops:Updating [ubuntu@smithi162.front.sepia.ceph.com]: reset os type and version on server
2021-12-23T19:58:58.923 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server
2021-12-23T19:58:58.942 INFO:teuthology.lock.ops:Node 'ubuntu@smithi162.front.sepia.ceph.com' reimaging is complete
2021-12-23T19:58:59.137 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of centos 8.stream
2021-12-23T19:58:59.150 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of centos 8.stream
2021-12-23T19:58:59.537 INFO:teuthology.orchestra.console:Power off smithi141
2021-12-23T19:58:59.577 INFO:teuthology.orchestra.console:Power off smithi162
2021-12-23T19:59:07.935 INFO:teuthology.orchestra.console:Power off for smithi162 completed
2021-12-23T19:59:08.037 INFO:teuthology.orchestra.console:Power on smithi162
2021-12-23T19:59:12.022 INFO:teuthology.orchestra.console:Power off for smithi141 completed
2021-12-23T19:59:12.124 INFO:teuthology.orchestra.console:Power on smithi141
2021-12-23T19:59:16.384 INFO:teuthology.orchestra.console:Power on for smithi141 completed
2021-12-23T19:59:16.401 INFO:teuthology.orchestra.console:Power on for smithi162 completed
2021-12-23T19:59:16.485 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish
2021-12-23T19:59:16.503 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish
2021-12-23T20:01:47.717 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: Authentication failed.
2021-12-23T20:03:19.733 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-23T20:03:49.675 INFO:teuthology.provision.fog.smithi141:Node is ready
2021-12-23T20:03:49.697 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com
2021-12-23T20:03:49.755 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141
2021-12-23T20:03:50.106 INFO:teuthology.provision.fog.smithi141:Deploy complete!
2021-12-23T20:04:14.426 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-23T20:04:14.738 INFO:teuthology.provision.fog.smithi162:Node is ready
2021-12-23T20:04:14.755 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com
2021-12-23T20:04:14.817 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162
2021-12-23T20:04:15.154 INFO:teuthology.provision.fog.smithi162:Deploy complete!
2021-12-23T20:04:15.314 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com
2021-12-23T20:04:15.315 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-23T20:04:15.336 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com
2021-12-23T20:04:15.336 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-23T20:04:15.364 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server
2021-12-23T20:04:15.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com'
2021-12-23T20:04:15.612 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64
2021-12-23T20:04:15.668 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream"
2021-12-23T20:04:15.668 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="8"
2021-12-23T20:04:15.669 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos"
2021-12-23T20:04:15.669 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora"
2021-12-23T20:04:15.669 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="8"
2021-12-23T20:04:15.669 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el8"
2021-12-23T20:04:15.669 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-23T20:04:15.670 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31"
2021-12-23T20:04:15.670 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-23T20:04:15.670 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/"
2021-12-23T20:04:15.671 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-23T20:04:15.671 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-23T20:04:15.671 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-23T20:04:15.672 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2021-12-23T20:04:15.692 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server
2021-12-23T20:04:15.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com'
2021-12-23T20:04:15.883 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64
2021-12-23T20:04:15.938 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream"
2021-12-23T20:04:15.939 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8"
2021-12-23T20:04:15.939 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos"
2021-12-23T20:04:15.939 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora"
2021-12-23T20:04:15.939 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8"
2021-12-23T20:04:15.939 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8"
2021-12-23T20:04:15.940 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-23T20:04:15.940 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31"
2021-12-23T20:04:15.940 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-23T20:04:15.940 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/"
2021-12-23T20:04:15.941 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-23T20:04:15.941 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-23T20:04:15.941 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-23T20:04:15.942 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server
2021-12-23T20:04:16.043 INFO:teuthology.dispatcher.supervisor:Running job 6582558
2021-12-23T20:04:16.043 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-12-23_16:50:03-rados-wip-yuri6-testing-2021-12-22-1410-distro-default-smithi/6582558 --name yuriw-2021-12-23_16:50:03-rados-wip-yuri6-testing-2021-12-22-1410-distro-default-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2021-12-23_16:50:03-rados-wip-yuri6-testing-2021-12-22-1410-distro-default-smithi/6582558/orig.config.yaml
2021-12-23T20:04:16.048 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-12-23_16:50:03-rados-wip-yuri6-testing-2021-12-22-1410-distro-default-smithi/6582558
2021-12-23T20:04:16.049 INFO:teuthology.dispatcher.supervisor:Job PID: 29135
2021-12-23T20:04:16.049 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-24T08:04:36.608 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-24T08:04:36.806 INFO:teuthology.kill:Killing Pids: {29135}
2021-12-24T08:04:37.898 INFO:teuthology.task.internal:roles: ubuntu@smithi141.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2021-12-24T08:04:37.898 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2021-12-24T08:04:37.899 INFO:teuthology.misc:Compressing logs...
2021-12-24T08:04:37.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com'
2021-12-24T08:04:38.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com'
2021-12-24T08:04:38.452 INFO:teuthology.misc:Compressing logs...
2021-12-24T08:04:39.747 INFO:teuthology.orchestra.run.smithi141.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-24T08:04:40.169 INFO:teuthology.misc:Compressing logs...
2021-12-24T08:04:45.085 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/906fbdc8-642c-11ec-8c31-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-12-24T08:04:50.062 INFO:teuthology.orchestra.run.smithi141.stderr:gzip: /var/log/ceph/906fbdc8-642c-11ec-8c31-001a4aab830c/ceph-mon.smithi141.log: file size changed while zipping
2021-12-24T08:04:50.580 INFO:teuthology.orchestra.run.smithi141.stderr:gzip: /var/log/ceph/906fbdc8-642c-11ec-8c31-001a4aab830c/ceph-mds.cephfs.smithi141.zteizh.log: file size changed while zipping
2021-12-24T08:04:51.185 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/906fbdc8-642c-11ec-8c31-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-12-24T08:04:55.804 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/906fbdc8-642c-11ec-8c31-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-12-24T08:04:56.028 INFO:teuthology.orchestra.run.smithi141.stderr:gzip: /var/log/ceph/906fbdc8-642c-11ec-8c31-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-12-24T08:04:58.933 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/906fbdc8-642c-11ec-8c31-001a4aab830c/ceph-mon.smithi162.log: file size changed while zipping
2021-12-24T08:04:59.013 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/906fbdc8-642c-11ec-8c31-001a4aab830c/ceph-mgr.smithi162.ncnjje.log: file size changed while zipping
2021-12-24T08:05:00.886 INFO:teuthology.orchestra.run.smithi141.stderr:gzip: /var/log/ceph/906fbdc8-642c-11ec-8c31-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-12-24T08:05:03.603 INFO:teuthology.orchestra.run.smithi141.stderr:gzip: /var/log/ceph/906fbdc8-642c-11ec-8c31-001a4aab830c/ceph-mgr.smithi141.kiufgf.log: file size changed while zipping
2021-12-24T08:05:09.343 INFO:teuthology.orchestra.run.smithi141.stderr:gzip: /var/log/ceph/906fbdc8-642c-11ec-8c31-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-12-24T08:06:34.873 INFO:teuthology.orchestra.run.smithi141.stderr:gzip: /var/log/ceph/906fbdc8-642c-11ec-8c31-001a4aab830c/ceph-mds.cephfs.smithi141.terfxg.log: file size changed while zipping
2021-12-24T08:08:26.389 INFO:teuthology.kill:No teuthology processes running
2021-12-24T08:08:27.520 INFO:teuthology.kill:Nuking machines: ['smithi141', 'smithi162']
2021-12-24T08:08:28.423 INFO:teuthology.kill:2021-12-24 08:08:28,423.423 INFO:teuthology.nuke:targets:
2021-12-24T08:08:28.424 INFO:teuthology.kill:  smithi141.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyopW7WnMC5hUttXFyCMcRr8pIulpr1OY3EJDOqiTWQrpzs7kDykxGepOeXFE10KAE37z7loekk3n39M/kvK9XkP9SgInfHEkEWUCgdMYdv2V7ra0MfTqlLLhS8zM1jGT2OJ1ZdxTzg9Ij09ar7fTHLN65917IrbrjwC0EoR8mmJ/LQxpEJpAvnJFzZXu75bXNCRwyNpAtDIvAxLd+RqgMkYiPU54cVymXjZK2W3V7eNi09N0SHF/VOxX1j89LC0oMMrO5ZPTsRpBgVHIyLryZ60OgwPPdGjcMuPpUOvbJe9sXc7kPI8wVXVvRH3ODp6oc4k/RzgDNXQyA7RYiyPJ7beEpZMl3JYZX0ZipqZipKb+srLVxarBPbogR27+/InIR3QY+t0X1orQQIx4OKdyiBP0sANUCC57ytvOooVujSeJTvpxz3H9zcc/Yxq/9MINRwmCuKUkfxdzI5XoJxn14ROEpSCd3tlTSo/UNvtCdz9LAhSH7oIQ1/X2Y/D3cFB0=
2021-12-24T08:08:28.425 INFO:teuthology.kill:  smithi162.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBCxC9mUGJ2TrJqX1OccHT4hmNIKD7kowL5s04bhOp6nW/eqaUJZvbYbuRNKI6ZokOhxgHZZwWAyDL4HIqX1U0fkX7b+siQxMfn/9Cr6yAJ/ei2He3zFvgaxwW2Es42U/BKsYMjGcNbRxemNmN069rXwnHzJtlNh3KYQVlhjOAmpsZORrGLjlijUmuXH3k7TRcxJzezVbUI/7FouXPuWrPbeTxSSnnrCa6S6O+lMo/81LqXcWQf0gi2G2PWkPjSi0+dbLXq5nIDqD4PmLk8MnUdugm0xd66+RzoGhqtiCgtkFaZIcxQvdLvbxbSsTdbqC8CigVLKBKGD/9YIOuWc+JyCOiQp0n9YcWHSoJyk0SVHTlkoRNWNQqc8izX/+29Zc4aqDJ0T3wSy7whqFulH8Ii+6O0lUUVfvQd9DsF2PCIWPP/Y24M9sNs/Lu+QJGIQr0mRgH0DjJRNgeQlv9UoHMIVH7j/DGMSpNoia4uXhGvmqPvORHhSVit2TMQ9t/1U8=
2021-12-24T08:08:28.448 INFO:teuthology.kill:2021-12-24 08:08:28,448.448 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-24T08:08:28.451 INFO:teuthology.kill:2021-12-24 08:08:28,451.451 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-24T08:08:28.524 INFO:teuthology.kill:2021-12-24 08:08:28,524.524 INFO:teuthology.orchestra.console:Power off smithi162
2021-12-24T08:08:28.538 INFO:teuthology.kill:2021-12-24 08:08:28,538.538 INFO:teuthology.orchestra.console:Power off smithi141
2021-12-24T08:08:41.010 INFO:teuthology.kill:2021-12-24 08:08:41,009.009 INFO:teuthology.orchestra.console:Power off for smithi162 completed
2021-12-24T08:08:41.015 INFO:teuthology.kill:2021-12-24 08:08:41,015.015 INFO:teuthology.orchestra.console:Power off for smithi141 completed
2021-12-24T08:08:41.161 INFO:teuthology.kill:2021-12-24 08:08:41,160.160 INFO:teuthology.lock.ops:unlocked: smithi162.front.sepia.ceph.com
2021-12-24T08:08:41.163 INFO:teuthology.kill:2021-12-24 08:08:41,163.163 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com
2021-12-24T08:10:41.353 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-24T08:10:41.463 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi141 but it was locked by another job: /home/teuthworker/archive/amathuri-2021-12-24_06:20:07-rados-master-distro-basic-smithi/6583386
2021-12-24T08:10:41.464 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi162 but it was locked by another job: /home/teuthworker/archive/amathuri-2021-12-24_06:20:07-rados-master-distro-basic-smithi/6583386