2021-10-29T00:10:12.772 INFO:root:teuthology version: 1.1.0-c56135d1
2021-10-29T00:10:12.895 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi012.front.sepia.ceph.com' reimaging
2021-10-29T00:10:12.896 INFO:teuthology.lock.ops:Updating [ubuntu@smithi012.front.sepia.ceph.com]: reset os type and version on server
2021-10-29T00:10:12.897 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server
2021-10-29T00:10:12.918 INFO:teuthology.lock.ops:Node 'ubuntu@smithi012.front.sepia.ceph.com' reimaging is complete
2021-10-29T00:10:12.919 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi124.front.sepia.ceph.com' reimaging
2021-10-29T00:10:12.919 INFO:teuthology.lock.ops:Updating [ubuntu@smithi124.front.sepia.ceph.com]: reset os type and version on server
2021-10-29T00:10:12.920 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2021-10-29T00:10:12.939 INFO:teuthology.lock.ops:Node 'ubuntu@smithi124.front.sepia.ceph.com' reimaging is complete
2021-10-29T00:10:13.128 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 8.3
2021-10-29T00:10:13.152 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of centos 8.3
2021-10-29T00:10:13.518 INFO:teuthology.orchestra.console:Power off smithi012
2021-10-29T00:10:13.591 INFO:teuthology.orchestra.console:Power off smithi124
2021-10-29T00:10:13.664 INFO:teuthology.orchestra.console:Power off for smithi012 completed
2021-10-29T00:10:13.731 INFO:teuthology.orchestra.console:Power off for smithi124 completed
2021-10-29T00:10:13.765 INFO:teuthology.orchestra.console:Power on smithi012
2021-10-29T00:10:13.832 INFO:teuthology.orchestra.console:Power on smithi124
2021-10-29T00:10:18.027 INFO:teuthology.orchestra.console:Power on for smithi012 completed
2021-10-29T00:10:18.128 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish
2021-10-29T00:10:22.198 INFO:teuthology.orchestra.console:Power on for smithi124 completed
2021-10-29T00:10:22.300 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish
2021-10-29T00:15:12.375 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-10-29T00:15:12.724 INFO:teuthology.provision.fog.smithi124:Node is ready
2021-10-29T00:15:12.739 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com
2021-10-29T00:15:12.795 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124
2021-10-29T00:15:13.118 INFO:teuthology.provision.fog.smithi124:Deploy complete!
2021-10-29T00:16:08.898 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-10-29T00:16:09.199 INFO:teuthology.provision.fog.smithi012:Node is ready
2021-10-29T00:16:09.214 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com
2021-10-29T00:16:09.271 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012
2021-10-29T00:16:09.595 INFO:teuthology.provision.fog.smithi012:Deploy complete!
2021-10-29T00:16:09.777 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com
2021-10-29T00:16:09.778 INFO:teuthology.lock.ops:New key found. Updating...
2021-10-29T00:16:09.797 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com
2021-10-29T00:16:09.797 INFO:teuthology.lock.ops:New key found. Updating...
2021-10-29T00:16:09.814 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server
2021-10-29T00:16:09.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com'
2021-10-29T00:16:10.025 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64
2021-10-29T00:16:10.080 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Linux"
2021-10-29T00:16:10.081 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="8"
2021-10-29T00:16:10.081 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos"
2021-10-29T00:16:10.081 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora"
2021-10-29T00:16:10.081 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="8"
2021-10-29T00:16:10.082 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el8"
2021-10-29T00:16:10.082 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Linux 8"
2021-10-29T00:16:10.082 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31"
2021-10-29T00:16:10.083 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-10-29T00:16:10.083 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/"
2021-10-29T00:16:10.083 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-10-29T00:16:10.083 INFO:teuthology.orchestra.run.smithi012.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-10-29T00:16:10.083 INFO:teuthology.orchestra.run.smithi012.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-10-29T00:16:10.085 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server
2021-10-29T00:16:10.103 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server
2021-10-29T00:16:10.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com'
2021-10-29T00:16:10.367 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64
2021-10-29T00:16:10.422 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Linux"
2021-10-29T00:16:10.422 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8"
2021-10-29T00:16:10.423 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos"
2021-10-29T00:16:10.423 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora"
2021-10-29T00:16:10.423 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8"
2021-10-29T00:16:10.423 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8"
2021-10-29T00:16:10.424 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Linux 8"
2021-10-29T00:16:10.424 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2021-10-29T00:16:10.424 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-10-29T00:16:10.424 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/"
2021-10-29T00:16:10.424 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-10-29T00:16:10.425 INFO:teuthology.orchestra.run.smithi124.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-10-29T00:16:10.425 INFO:teuthology.orchestra.run.smithi124.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-10-29T00:16:10.425 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2021-10-29T00:16:10.521 INFO:teuthology.dispatcher.supervisor:Running job 6465562
2021-10-29T00:16:10.522 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology -v --owner scheduled_nojha@teuthology --archive /home/teuthworker/archive/nojha-2021-10-28_21:32:34-rados-wip-43687-distro-basic-smithi/6465562 --name nojha-2021-10-28_21:32:34-rados-wip-43687-distro-basic-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/nojha-2021-10-28_21:32:34-rados-wip-43687-distro-basic-smithi/6465562/orig.config.yaml
2021-10-29T00:16:10.525 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nojha-2021-10-28_21:32:34-rados-wip-43687-distro-basic-smithi/6465562
2021-10-29T00:16:10.526 INFO:teuthology.dispatcher.supervisor:Job PID: 7707
2021-10-29T00:16:10.526 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-10-29T12:17:03.471 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-10-29T12:17:03.682 INFO:teuthology.kill:Killing Pids: {7707}
2021-10-29T12:17:04.897 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2021-10-29T12:17:04.898 INFO:teuthology.task.internal:roles: ubuntu@smithi124.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2021-10-29T12:17:04.898 INFO:teuthology.misc:Compressing logs...
2021-10-29T12:17:04.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com'
2021-10-29T12:17:05.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com'
2021-10-29T12:17:05.481 INFO:teuthology.misc:Compressing logs...
2021-10-29T12:17:05.868 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-10-29T12:17:05.965 INFO:teuthology.orchestra.run.smithi124.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-10-29T12:17:06.219 INFO:teuthology.misc:Compressing logs...
2021-10-29T12:17:32.073 INFO:teuthology.orchestra.run.smithi124.stderr:gzip: /var/log/ceph/4ab4e5b4-384f-11ec-8c28-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-10-29T12:17:37.679 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/4ab4e5b4-384f-11ec-8c28-001a4aab830c/ceph-mon.smithi012.log: file size changed while zipping
2021-10-29T12:17:43.817 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/4ab4e5b4-384f-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi012.cmizcs.log: file size changed while zipping
2021-10-29T12:18:18.507 INFO:teuthology.orchestra.run.smithi124.stderr:gzip: /var/log/ceph/4ab4e5b4-384f-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi124.dryogs.log: file size changed while zipping
2021-10-29T12:18:41.587 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/4ab4e5b4-384f-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi012.flsyux.log: file size changed while zipping
2021-10-29T12:18:51.066 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/4ab4e5b4-384f-11ec-8c28-001a4aab830c/ceph-mgr.smithi012.lchuzp.log: file size changed while zipping
2021-10-29T12:18:53.207 INFO:teuthology.orchestra.run.smithi124.stderr:gzip: /var/log/ceph/4ab4e5b4-384f-11ec-8c28-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-10-29T12:18:59.774 INFO:teuthology.orchestra.run.smithi124.stderr:gzip: /var/log/ceph/4ab4e5b4-384f-11ec-8c28-001a4aab830c/ceph-mon.smithi124.log: file size changed while zipping
2021-10-29T12:19:13.350 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/4ab4e5b4-384f-11ec-8c28-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-10-29T12:19:21.543 INFO:teuthology.orchestra.run.smithi124.stderr:gzip: /var/log/ceph/4ab4e5b4-384f-11ec-8c28-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-10-29T12:19:26.747 INFO:teuthology.orchestra.run.smithi124.stderr:gzip: /var/log/ceph/4ab4e5b4-384f-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi124.dtkkxx.log: file size changed while zipping
2021-10-29T12:19:40.651 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/4ab4e5b4-384f-11ec-8c28-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-10-29T12:20:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:tar: .: file changed as we read it
2021-10-29T12:20:42.567 INFO:teuthology.kill:No teuthology processes running
2021-10-29T12:20:43.861 INFO:teuthology.kill:Nuking machines: ['smithi012', 'smithi124']
2021-10-29T12:20:44.806 INFO:teuthology.kill:2021-10-29 12:20:44,805.805 INFO:teuthology.nuke:targets:
2021-10-29T12:20:44.807 INFO:teuthology.kill:  smithi012.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDS5MpgzwwfKZGwV4UxcRYfj8hA2Vpr/hb5J97bmlj57iEBgXjbirrA+/c3Rx/mn6IyETh/4n7+QS68ltcVUMVJgih3ib2bFRA75Gv3/Yy7w5zHmkT+NCqhHsxfj0NDrSPuuhdNFa0W+dj3HqkEk0k8diI9ewO2VRx3axu8FkV1O9aHjFaJ5mIaSIVWMkdR66JyJIRBJtXVq/Ripaysff9xn6/x24z9T3FjOciGyBBA2jGtnbluisyo7jN4G0VypOHW1q8mHXOPlK4hETLmx7bSfxtBLvASAkMsWUEErDxKaoIuOP3TNsIo5R6Ei+OjSKyeKSqp+tJsIMhuiRnu+AFuSgY//PcDPg1sFBS73FO8As1Pq/e+NEcICWWr0Sqj0tIabp7+BVXlFX/5KWuAoHlCG0eKkBYvX3Ecp73zo7q7/E2m2hs0FTW1/YuxXjwYvEJRhFpStIaJaUmyVsxdaDJYWpAuVAvLj7gnjZGxmQ9YxFvqDdTqYk/iYvhCiBk8G2s=
2021-10-29T12:20:44.807 INFO:teuthology.kill:  smithi124.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbfRrARhYqAsT6pQND7R+jU6nB5WNabhn7EBT3ZHs11L/SJ9h9qbyYCo0D0X8B6dtF73qvpNnM+nW1mwbecBHv0NImkMcBVkOiQLni0txMmquZqOHH/howoneUu9LkY7kAu8X8KIx0ftnkUfzO6d+nnxxlo50GfuH5iaF946i9WrvhtQZ7jK99Zcv1BoJRUWjthKErDjO0/+xT/jpap0D7YMM/nDkPF8zdR07mjptoXIOATx85a2zKQSgxeh1leJ6sl1hwbBaTmnoMmqSdOeUV+uCPMqn4yJPScdR7sS35PFJBBmzirhS2UIeLcbAgwD2a0hbHk9dWxy0lBxvS9OTd/jBSBAjebiB4FBwbS8CvEUElQBxT2KQhCyYC4uGCJxyq+puROn+6dXD6eFSg61JB1PT6iqTc9fVUVnl2Zwa3BCALuomzRj8BW4/UtLOGvnSXMVLD9Th7g1u/lIfiO6h49wBPf9ZqIDPxwih3021HRJS/lqex8gwpoL9kQH0OQ4E=
2021-10-29T12:20:44.833 INFO:teuthology.kill:2021-10-29 12:20:44,833.833 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-10-29T12:20:44.835 INFO:teuthology.kill:2021-10-29 12:20:44,834.834 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-10-29T12:20:44.909 INFO:teuthology.kill:2021-10-29 12:20:44,909.909 INFO:teuthology.orchestra.console:Power off smithi124
2021-10-29T12:20:44.922 INFO:teuthology.kill:2021-10-29 12:20:44,922.922 INFO:teuthology.orchestra.console:Power off smithi012
2021-10-29T12:20:53.285 INFO:teuthology.kill:2021-10-29 12:20:53,285.285 INFO:teuthology.orchestra.console:Power off for smithi124 completed
2021-10-29T12:20:53.432 INFO:teuthology.kill:2021-10-29 12:20:53,431.431 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com
2021-10-29T12:20:57.400 INFO:teuthology.kill:2021-10-29 12:20:57,400.400 INFO:teuthology.orchestra.console:Power off for smithi012 completed
2021-10-29T12:20:57.557 INFO:teuthology.kill:2021-10-29 12:20:57,557.557 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com
2021-10-29T12:22:57.792 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-10-29T12:22:57.902 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi012 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-10-28_23:09:03-rados-wip-yuri2-testing-2021-10-28-1343-distro-basic-smithi/6466205
2021-10-29T12:22:57.902 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi124 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-10-28_23:09:03-rados-wip-yuri2-testing-2021-10-28-1343-distro-basic-smithi/6466207