2021-12-10T17:56:29.526 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-10T17:56:29.661 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi063.front.sepia.ceph.com' reimaging
2021-12-10T17:56:29.662 INFO:teuthology.lock.ops:Updating [ubuntu@smithi063.front.sepia.ceph.com]: reset os type and version on server
2021-12-10T17:56:29.663 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2021-12-10T17:56:29.685 INFO:teuthology.lock.ops:Node 'ubuntu@smithi063.front.sepia.ceph.com' reimaging is complete
2021-12-10T17:56:29.686 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi096.front.sepia.ceph.com' reimaging
2021-12-10T17:56:29.686 INFO:teuthology.lock.ops:Updating [ubuntu@smithi096.front.sepia.ceph.com]: reset os type and version on server
2021-12-10T17:56:29.687 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server
2021-12-10T17:56:29.709 INFO:teuthology.lock.ops:Node 'ubuntu@smithi096.front.sepia.ceph.com' reimaging is complete
2021-12-10T17:56:29.908 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of centos 8.stream
2021-12-10T17:56:29.918 INFO:teuthology.provision.fog.smithi096:Scheduling deploy of centos 8.stream
2021-12-10T17:56:30.290 INFO:teuthology.orchestra.console:Power off smithi063
2021-12-10T17:56:30.306 INFO:teuthology.orchestra.console:Power off smithi096
2021-12-10T17:56:42.779 INFO:teuthology.orchestra.console:Power off for smithi063 completed
2021-12-10T17:56:42.784 INFO:teuthology.orchestra.console:Power off for smithi096 completed
2021-12-10T17:56:42.881 INFO:teuthology.orchestra.console:Power on smithi063
2021-12-10T17:56:42.890 INFO:teuthology.orchestra.console:Power on smithi096
2021-12-10T17:56:47.143 INFO:teuthology.orchestra.console:Power on for smithi096 completed
2021-12-10T17:56:47.245 INFO:teuthology.provision.fog.smithi096:Waiting for deploy to finish
2021-12-10T17:56:51.244 INFO:teuthology.orchestra.console:Power on for smithi063 completed
2021-12-10T17:56:51.345 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish
2021-12-10T18:01:36.993 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-10T18:01:37.298 INFO:teuthology.provision.fog.smithi096:Node is ready
2021-12-10T18:01:37.315 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096.front.sepia.ceph.com
2021-12-10T18:01:37.372 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96 smithi096.front.sepia.ceph.com smithi096
2021-12-10T18:01:37.701 INFO:teuthology.provision.fog.smithi096:Deploy complete!
2021-12-10T18:01:56.052 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-10T18:01:56.347 INFO:teuthology.provision.fog.smithi063:Node is ready
2021-12-10T18:01:56.365 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063.front.sepia.ceph.com
2021-12-10T18:01:56.424 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63 smithi063.front.sepia.ceph.com smithi063
2021-12-10T18:01:56.767 INFO:teuthology.provision.fog.smithi063:Deploy complete!
2021-12-10T18:01:56.920 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com
2021-12-10T18:01:56.921 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-10T18:01:56.948 INFO:teuthology.lock.ops:Checking smithi096.front.sepia.ceph.com
2021-12-10T18:01:56.948 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-10T18:01:56.971 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server
2021-12-10T18:01:56.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com'
2021-12-10T18:01:57.164 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64
2021-12-10T18:01:57.221 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream"
2021-12-10T18:01:57.221 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8"
2021-12-10T18:01:57.221 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos"
2021-12-10T18:01:57.222 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora"
2021-12-10T18:01:57.222 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8"
2021-12-10T18:01:57.222 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8"
2021-12-10T18:01:57.222 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-10T18:01:57.222 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31"
2021-12-10T18:01:57.223 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-10T18:01:57.223 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/"
2021-12-10T18:01:57.223 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-10T18:01:57.223 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-10T18:01:57.224 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-10T18:01:57.225 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2021-12-10T18:01:57.244 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: set os type and version on server
2021-12-10T18:01:57.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com'
2021-12-10T18:01:57.490 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64
2021-12-10T18:01:57.549 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream"
2021-12-10T18:01:57.550 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8"
2021-12-10T18:01:57.550 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos"
2021-12-10T18:01:57.551 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora"
2021-12-10T18:01:57.551 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8"
2021-12-10T18:01:57.552 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8"
2021-12-10T18:01:57.552 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-10T18:01:57.552 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31"
2021-12-10T18:01:57.553 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-10T18:01:57.553 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/"
2021-12-10T18:01:57.554 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-10T18:01:57.554 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-10T18:01:57.555 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-10T18:01:57.556 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server
2021-12-10T18:01:57.678 INFO:teuthology.dispatcher.supervisor:Running job 6557249
2021-12-10T18:01:57.679 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-12-10_16:36:47-rados-wip-yuri2-testing-2021-12-09-1306-distro-default-smithi/6557249 --name yuriw-2021-12-10_16:36:47-rados-wip-yuri2-testing-2021-12-09-1306-distro-default-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2021-12-10_16:36:47-rados-wip-yuri2-testing-2021-12-09-1306-distro-default-smithi/6557249/orig.config.yaml
2021-12-10T18:01:57.683 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-12-10_16:36:47-rados-wip-yuri2-testing-2021-12-09-1306-distro-default-smithi/6557249
2021-12-10T18:01:57.683 INFO:teuthology.dispatcher.supervisor:Job PID: 21910
2021-12-10T18:01:57.684 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-11T06:02:53.211 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-11T06:02:53.411 INFO:teuthology.kill:Killing Pids: {21910}
2021-12-11T06:02:54.635 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2021-12-11T06:02:54.636 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2021-12-11T06:02:54.637 INFO:teuthology.misc:Compressing logs...
2021-12-11T06:02:54.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com'
2021-12-11T06:02:54.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com'
2021-12-11T06:02:55.126 INFO:teuthology.misc:Compressing logs...
2021-12-11T06:02:56.508 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-11T06:02:56.960 INFO:teuthology.misc:Compressing logs...
2021-12-11T06:02:57.280 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/3bd18eec-59e4-11ec-8c31-001a4aab830c/ceph-mds.cephfs.smithi063.yrulwc.log: file size changed while zipping
2021-12-11T06:02:59.668 INFO:teuthology.orchestra.run.smithi096.stderr:gzip: /var/log/ceph/3bd18eec-59e4-11ec-8c31-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-12-11T06:03:00.431 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/3bd18eec-59e4-11ec-8c31-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-12-11T06:03:03.039 INFO:teuthology.orchestra.run.smithi096.stderr:gzip: /var/log/ceph/3bd18eec-59e4-11ec-8c31-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-12-11T06:03:03.265 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/3bd18eec-59e4-11ec-8c31-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-12-11T06:03:04.470 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/3bd18eec-59e4-11ec-8c31-001a4aab830c/ceph-mgr.smithi063.qfsmnk.log: file size changed while zipping
2021-12-11T06:03:05.572 INFO:teuthology.orchestra.run.smithi096.stderr:gzip: /var/log/ceph/3bd18eec-59e4-11ec-8c31-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-12-11T06:03:07.225 INFO:teuthology.orchestra.run.smithi096.stderr:gzip: /var/log/ceph/3bd18eec-59e4-11ec-8c31-001a4aab830c/ceph-mon.smithi096.log: file size changed while zipping
2021-12-11T06:03:07.815 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/3bd18eec-59e4-11ec-8c31-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-12-11T06:03:13.117 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/3bd18eec-59e4-11ec-8c31-001a4aab830c/ceph-mon.smithi063.log: file size changed while zipping
2021-12-11T06:04:12.850 INFO:teuthology.kill:No teuthology processes running
2021-12-11T06:04:13.961 INFO:teuthology.kill:Nuking machines: ['smithi063', 'smithi096']
2021-12-11T06:04:14.928 INFO:teuthology.kill:2021-12-11 06:04:14,928.928 INFO:teuthology.nuke:targets:
2021-12-11T06:04:14.929 INFO:teuthology.kill:  smithi063.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzX8bi3ZA+qfBJyQWmIkIV+mI/0bjlcNS6OeLCLGoAqiKYQ4wGoURKit1F/d95KJQovSNw1kpIwc6XPhGmWN++/sBD3iiV+LuiPM3r0Zax0f2PGn28b63ANEdYVWiZBsETZNRxCZCGt0V4lL91kYghfGo3CHvQ6NahZuGcVMlhgLD5fyRXiXmF4fRCiG0BWilNTYLzpsOILAlsSLe8ZkF59v2EWQ7SkL7Cv+3NnD/M7pJUEmyQCEEEhCKw8tkzOR0+3DgSvs4MAPMo/z45rmWgP90fVKcMOsDHu0g4yLxAGSGsmyf1ai3xCvteYAa2Byhsv61AeJgywkWCi8yhNHdE2OlpwyhVLIyRlIo+/EM/fZ+JiFPwfGD8JsB6C5XrGZzs7AdKjEvCnzZ7iWviuO6QKA5Q+CxTyC9XEZW13OxVmQW/wAev0birduuktFKNDsGzp9u7jSjJcESyxTWccWh76O5aFRIQ4l8s5RIZRZDyD5dlaszj6uM8lm0Qvju6TT8=
2021-12-11T06:04:14.930 INFO:teuthology.kill:  smithi096.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDHyyjcSBARYI+OVWMKtmxNujx9uEaTD9NL9cq8Xe+AG4UYLRP5+RLspCIY6hcINj94MLF5mvBnm2aN1gYEh9puJ3Vl22uLebDc+OOaJURAFXg3UpQs9riJpiUNuLVmbbC+s7gdwTydHzN4gO+7PkSDxGMEKgmRCGLOgc+rXBk342kU1mhoeJQMaa5dywiRcWDOm9wyIn8gjpHGZK9TI7lOpV4AwSFPX1yprhVzTSXORUVvL8nxFM/gESR8gqGxNt3dbp2O8C5kLqhHEKCC2sYN5QQiuKFV4odfPHA9+RtiQ3hnvc3pFlOYswcmvDw3vxGqs/5HQXhIVIfakSlMgZ1IcDoRQLZoKjpIacXbCsT9e1xsWbfE4aw35fBf4znvQRI+Whv9GPEYG59JuUZw3Huj2Wfj7jSPR+cRfCdVu2rS5T1iikCfG2SbCmufylJXrdaYG0XJUg2VWW0F4W/4njb3NTacZpP4lDUolt7Dc9ivM86p0xD+rx9iOOARC20Noc=
2021-12-11T06:04:14.956 INFO:teuthology.kill:2021-12-11 06:04:14,956.956 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-11T06:04:14.960 INFO:teuthology.kill:2021-12-11 06:04:14,959.959 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-11T06:04:15.036 INFO:teuthology.kill:2021-12-11 06:04:15,035.035 INFO:teuthology.orchestra.console:Power off smithi096
2021-12-11T06:04:15.050 INFO:teuthology.kill:2021-12-11 06:04:15,050.050 INFO:teuthology.orchestra.console:Power off smithi063
2021-12-11T06:04:23.405 INFO:teuthology.kill:2021-12-11 06:04:23,405.405 INFO:teuthology.orchestra.console:Power off for smithi096 completed
2021-12-11T06:04:23.413 INFO:teuthology.kill:2021-12-11 06:04:23,413.413 INFO:teuthology.orchestra.console:Power off for smithi063 completed
2021-12-11T06:04:23.551 INFO:teuthology.kill:2021-12-11 06:04:23,551.551 INFO:teuthology.lock.ops:unlocked: smithi096.front.sepia.ceph.com
2021-12-11T06:04:23.559 INFO:teuthology.kill:2021-12-11 06:04:23,559.559 INFO:teuthology.lock.ops:unlocked: smithi063.front.sepia.ceph.com
2021-12-11T06:06:23.889 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-11T06:06:24.003 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi063 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-10_03:20:03-krbd-master-testing-default-smithi/6555937
2021-12-11T06:06:24.003 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi096 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-10_03:20:03-krbd-master-testing-default-smithi/6555937