2021-11-12T08:08:19.528 INFO:root:teuthology version: 1.1.0-c56135d1
2021-11-12T08:08:19.682 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi077.front.sepia.ceph.com' reimaging
2021-11-12T08:08:19.683 INFO:teuthology.lock.ops:Updating [ubuntu@smithi077.front.sepia.ceph.com]: reset os type and version on server
2021-11-12T08:08:19.683 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2021-11-12T08:08:19.701 INFO:teuthology.lock.ops:Node 'ubuntu@smithi077.front.sepia.ceph.com' reimaging is complete
2021-11-12T08:08:19.702 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi102.front.sepia.ceph.com' reimaging
2021-11-12T08:08:19.702 INFO:teuthology.lock.ops:Updating [ubuntu@smithi102.front.sepia.ceph.com]: reset os type and version on server
2021-11-12T08:08:19.702 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2021-11-12T08:08:19.720 INFO:teuthology.lock.ops:Node 'ubuntu@smithi102.front.sepia.ceph.com' reimaging is complete
2021-11-12T08:08:19.921 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of centos 8.3
2021-11-12T08:08:19.932 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of centos 8.3
2021-11-12T08:08:20.347 INFO:teuthology.orchestra.console:Power off smithi102
2021-11-12T08:08:20.363 INFO:teuthology.orchestra.console:Power off smithi077
2021-11-12T08:08:32.826 INFO:teuthology.orchestra.console:Power off for smithi102 completed
2021-11-12T08:08:32.835 INFO:teuthology.orchestra.console:Power off for smithi077 completed
2021-11-12T08:08:32.927 INFO:teuthology.orchestra.console:Power on smithi102
2021-11-12T08:08:32.936 INFO:teuthology.orchestra.console:Power on smithi077
2021-11-12T08:08:37.181 INFO:teuthology.orchestra.console:Power on for smithi102 completed
2021-11-12T08:08:37.282 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish
2021-11-12T08:08:41.294 INFO:teuthology.orchestra.console:Power on for smithi077 completed
2021-11-12T08:08:41.395 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish
2021-11-12T08:13:28.193 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-12T08:13:28.501 INFO:teuthology.provision.fog.smithi102:Node is ready
2021-11-12T08:13:28.517 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com
2021-11-12T08:13:28.573 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102
2021-11-12T08:13:28.900 INFO:teuthology.provision.fog.smithi102:Deploy complete!
2021-11-12T08:14:17.660 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-12T08:14:17.939 INFO:teuthology.provision.fog.smithi077:Node is ready
2021-11-12T08:14:17.954 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com
2021-11-12T08:14:18.009 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077
2021-11-12T08:14:18.325 INFO:teuthology.provision.fog.smithi077:Deploy complete!
2021-11-12T08:14:18.472 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com
2021-11-12T08:14:18.473 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-12T08:14:18.493 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com
2021-11-12T08:14:18.493 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-12T08:14:18.511 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server
2021-11-12T08:14:18.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com'
2021-11-12T08:14:18.708 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64
2021-11-12T08:14:18.767 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Linux"
2021-11-12T08:14:18.768 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="8"
2021-11-12T08:14:18.768 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos"
2021-11-12T08:14:18.768 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora"
2021-11-12T08:14:18.769 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="8"
2021-11-12T08:14:18.769 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el8"
2021-11-12T08:14:18.769 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-12T08:14:18.769 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31"
2021-11-12T08:14:18.770 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-12T08:14:18.770 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/"
2021-11-12T08:14:18.770 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-12T08:14:18.770 INFO:teuthology.orchestra.run.smithi077.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-12T08:14:18.771 INFO:teuthology.orchestra.run.smithi077.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-12T08:14:18.772 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2021-11-12T08:14:18.790 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server
2021-11-12T08:14:18.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com'
2021-11-12T08:14:19.061 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64
2021-11-12T08:14:19.116 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Linux"
2021-11-12T08:14:19.116 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8"
2021-11-12T08:14:19.117 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos"
2021-11-12T08:14:19.117 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora"
2021-11-12T08:14:19.117 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8"
2021-11-12T08:14:19.117 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8"
2021-11-12T08:14:19.118 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-12T08:14:19.118 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2021-11-12T08:14:19.118 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-12T08:14:19.118 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/"
2021-11-12T08:14:19.118 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-12T08:14:19.119 INFO:teuthology.orchestra.run.smithi102.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-12T08:14:19.119 INFO:teuthology.orchestra.run.smithi102.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-12T08:14:19.119 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2021-11-12T08:14:19.220 INFO:teuthology.dispatcher.supervisor:Running job 6480307
2021-11-12T08:14:19.221 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology -v --owner scheduled_pdiazbou@teuthology --archive /home/teuthworker/archive/pdiazbou-2021-11-03_08:04:16-orch-wip-pereman2-testing-2021-11-01-2310-distro-basic-smithi/6480307 --name pdiazbou-2021-11-03_08:04:16-orch-wip-pereman2-testing-2021-11-01-2310-distro-basic-smithi --description orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/pdiazbou-2021-11-03_08:04:16-orch-wip-pereman2-testing-2021-11-01-2310-distro-basic-smithi/6480307/orig.config.yaml
2021-11-12T08:14:19.224 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdiazbou-2021-11-03_08:04:16-orch-wip-pereman2-testing-2021-11-01-2310-distro-basic-smithi/6480307
2021-11-12T08:14:19.225 INFO:teuthology.dispatcher.supervisor:Job PID: 13635
2021-11-12T08:14:19.225 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-12T20:15:13.304 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-12T20:15:13.515 INFO:teuthology.kill:Killing Pids: {13635}
2021-11-12T20:15:15.500 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2021-11-12T20:15:15.502 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2021-11-12T20:15:15.503 INFO:teuthology.misc:Compressing logs...
2021-11-12T20:15:15.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com'
2021-11-12T20:15:15.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com'
2021-11-12T20:15:16.000 INFO:teuthology.misc:Compressing logs...
2021-11-12T20:15:16.282 INFO:teuthology.misc:Compressing logs...
2021-11-12T20:15:20.350 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/3422c8f4-4392-11ec-8c2c-001a4aab830c/ceph-mds.cephfs.smithi077.oekfrx.log: file size changed while zipping
2021-11-12T20:15:22.794 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/3422c8f4-4392-11ec-8c2c-001a4aab830c/ceph-mon.smithi102.log: file size changed while zipping
2021-11-12T20:15:37.045 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/3422c8f4-4392-11ec-8c2c-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-11-12T20:15:40.659 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/3422c8f4-4392-11ec-8c2c-001a4aab830c/ceph-mon.smithi077.log: file size changed while zipping
2021-11-12T20:15:49.170 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/3422c8f4-4392-11ec-8c2c-001a4aab830c/ceph-mgr.smithi077.vkervf.log: file size changed while zipping
2021-11-12T20:15:54.754 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/3422c8f4-4392-11ec-8c2c-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-11-12T20:16:03.542 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/3422c8f4-4392-11ec-8c2c-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-11-12T20:16:07.946 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/3422c8f4-4392-11ec-8c2c-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-11-12T20:16:16.503 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/3422c8f4-4392-11ec-8c2c-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-11-12T20:16:32.079 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/3422c8f4-4392-11ec-8c2c-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-11-12T20:16:39.062 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/3422c8f4-4392-11ec-8c2c-001a4aab830c/ceph-mds.cephfs.smithi077.jixwsc.log: file size changed while zipping
2021-11-12T20:16:41.523 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/3422c8f4-4392-11ec-8c2c-001a4aab830c/ceph-mds.cephfs.smithi102.rppglt.log: file size changed while zipping
2021-11-12T20:17:16.518 INFO:teuthology.kill:No teuthology processes running
2021-11-12T20:17:17.686 INFO:teuthology.kill:Nuking machines: ['smithi077', 'smithi102']
2021-11-12T20:17:18.691 INFO:teuthology.kill:2021-11-12 20:17:18,690.690 INFO:teuthology.nuke:targets:
2021-11-12T20:17:18.691 INFO:teuthology.kill:  smithi077.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMqyNCF2+owXop/R8hQrSe+F7V/PzE0cWmfXXAL0PAMuDcDeHuUNNYdRHHQ8paRPYDttVBcITlRjaGJAuczqHGJN6LI+YeGDrovj41j9Y8LNv/HE4ZoZUnCanQFIzy86nQrfbQjbNbojLouO+Pwe4fwBzoHJaalsdqIaDMIrNx/nHuhWqxfMum3PCsFXDihaPSh18MtY4LQt9qZbVUTgycig9Fl1vQxYdocSmSusYBISvI0jI7Bjen5Y2HXJb0GSg4ddoONj7m44/Gsz90HsjD9o6mJp27AAPJXBb3Cmmsk4lAtz26yiwbVLWr9v6RKQ//SsuDiKVKdmIXC3i03h9rMl0I+kpWwR/qtH2/LHWxRKRpOPQHZKkaQpQa6nPjGidFCzVlO7LI0W7bIXDSfnh6VOOBNalCYfUFiaynyyLDBXC1um2rUtY9DwAfBi4vSJf3swVpYv4LZO3rx6jenURi8jHe73mCADEqTDQreNgzZsdaW4Dm0BARdxELQ361f/E=
2021-11-12T20:17:18.692 INFO:teuthology.kill:  smithi102.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAIyXjtTS6mKPoaMPL4xw4jFUT2l82AcqmDLDVOhlluvGCTlfhUXyk2vMS2lYN5JLJ+HfyLfbSTyI3Qa3IY7g9lrjdn1ZGOOuG5LV57C4/mYRZOnyq/dYH+GCdCm7HiNvaHYbj7/e6NhYMka0kaJgONeNHoYlhxUBiUJF/5gbJlakN1eS/X9e+/At+VR9K6aYlEmWfWKgK6f3hTd1mfk4ns9FQbkWJuas2LDT3SHvNZynuSB/a9bXv3m96OyDIaQCjmbf+L+yjBCwnZ5Gob3c8AcPsuiC25WM/kzO8VKli3aLJ1bdJkUpgX9Ujmhr+ze2aOc/1JcC/1voz1u6HKlDC9BfUeuIUtigdaewqmA7rdH1hmdoRotnl5ARmUa1u/pFxP664KTRQ1ha4dCv7uLo95rW4T7XY4tlldSaDym8ZSgVVtLEMpgG4wJH6As1fkfsdyB9ghWlhZ8nEpH6K2nMxJIH2CystCSVERXEwErAKRnFUaD+OJtCplGy9Lm8sMw8=
2021-11-12T20:17:18.718 INFO:teuthology.kill:2021-11-12 20:17:18,718.718 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-12T20:17:18.723 INFO:teuthology.kill:2021-11-12 20:17:18,722.722 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-12T20:17:18.798 INFO:teuthology.kill:2021-11-12 20:17:18,798.798 INFO:teuthology.orchestra.console:Power off smithi077
2021-11-12T20:17:18.812 INFO:teuthology.kill:2021-11-12 20:17:18,812.812 INFO:teuthology.orchestra.console:Power off smithi102
2021-11-12T20:17:27.172 INFO:teuthology.kill:2021-11-12 20:17:27,172.172 INFO:teuthology.orchestra.console:Power off for smithi077 completed
2021-11-12T20:17:27.348 INFO:teuthology.kill:2021-11-12 20:17:27,347.347 INFO:teuthology.lock.ops:unlocked: smithi077.front.sepia.ceph.com
2021-11-12T20:17:31.292 INFO:teuthology.kill:2021-11-12 20:17:31,292.292 INFO:teuthology.orchestra.console:Power off for smithi102 completed
2021-11-12T20:17:31.440 INFO:teuthology.kill:2021-11-12 20:17:31,439.439 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com
2021-11-12T20:19:31.781 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-12T20:19:31.898 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi077 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-12_18:55:52-rados-wip-yuri6-testing-2021-11-12-0808-distro-basic-smithi/6500183
2021-11-12T20:19:31.899 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi102 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-12_18:55:52-rados-wip-yuri6-testing-2021-11-12-0808-distro-basic-smithi/6500183