2021-11-08T19:17:52.116 INFO:root:teuthology version: 1.1.0-27954452
2021-11-08T19:17:52.236 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi008.front.sepia.ceph.com' reimaging
2021-11-08T19:17:52.247 INFO:teuthology.lock.ops:Updating [ubuntu@smithi008.front.sepia.ceph.com]: reset os type and version on server
2021-11-08T19:17:52.248 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server
2021-11-08T19:17:52.270 INFO:teuthology.lock.ops:Node 'ubuntu@smithi008.front.sepia.ceph.com' reimaging is complete
2021-11-08T19:17:52.271 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi064.front.sepia.ceph.com' reimaging
2021-11-08T19:17:52.271 INFO:teuthology.lock.ops:Updating [ubuntu@smithi064.front.sepia.ceph.com]: reset os type and version on server
2021-11-08T19:17:52.271 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server
2021-11-08T19:17:52.291 INFO:teuthology.lock.ops:Node 'ubuntu@smithi064.front.sepia.ceph.com' reimaging is complete
2021-11-08T19:17:52.486 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of centos 8.3
2021-11-08T19:17:52.512 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 8.3
2021-11-08T19:17:52.790 INFO:teuthology.orchestra.console:Power off smithi008
2021-11-08T19:17:52.838 INFO:teuthology.orchestra.console:Power off smithi064
2021-11-08T19:17:52.947 INFO:teuthology.orchestra.console:Power off for smithi008 completed
2021-11-08T19:17:52.976 INFO:teuthology.orchestra.console:Power off for smithi064 completed
2021-11-08T19:17:53.049 INFO:teuthology.orchestra.console:Power on smithi008
2021-11-08T19:17:53.079 INFO:teuthology.orchestra.console:Power on smithi064
2021-11-08T19:17:57.327 INFO:teuthology.orchestra.console:Power on for smithi064 completed
2021-11-08T19:17:57.429 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish
2021-11-08T19:18:01.418 INFO:teuthology.orchestra.console:Power on for smithi008 completed
2021-11-08T19:18:01.519 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish
2021-11-08T19:22:51.114 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-08T19:22:51.478 INFO:teuthology.provision.fog.smithi008:Node is ready
2021-11-08T19:22:51.494 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com
2021-11-08T19:22:51.549 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008
2021-11-08T19:22:51.870 INFO:teuthology.provision.fog.smithi008:Deploy complete!
2021-11-08T19:23:01.965 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-08T19:23:02.263 INFO:teuthology.provision.fog.smithi064:Node is ready
2021-11-08T19:23:02.279 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com
2021-11-08T19:23:02.334 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064
2021-11-08T19:23:02.693 INFO:teuthology.provision.fog.smithi064:Deploy complete!
2021-11-08T19:23:02.916 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com
2021-11-08T19:23:02.917 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-08T19:23:02.940 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com
2021-11-08T19:23:02.940 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-08T19:23:02.959 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server
2021-11-08T19:23:02.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com'
2021-11-08T19:23:03.278 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64
2021-11-08T19:23:03.334 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Linux"
2021-11-08T19:23:03.335 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8"
2021-11-08T19:23:03.335 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos"
2021-11-08T19:23:03.335 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora"
2021-11-08T19:23:03.335 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8"
2021-11-08T19:23:03.336 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8"
2021-11-08T19:23:03.336 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-08T19:23:03.336 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31"
2021-11-08T19:23:03.336 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-08T19:23:03.337 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/"
2021-11-08T19:23:03.337 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-08T19:23:03.337 INFO:teuthology.orchestra.run.smithi008.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-08T19:23:03.337 INFO:teuthology.orchestra.run.smithi008.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-08T19:23:03.338 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server
2021-11-08T19:23:03.359 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server
2021-11-08T19:23:03.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com'
2021-11-08T19:23:03.564 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64
2021-11-08T19:23:03.620 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Linux"
2021-11-08T19:23:03.620 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8"
2021-11-08T19:23:03.621 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos"
2021-11-08T19:23:03.621 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora"
2021-11-08T19:23:03.621 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8"
2021-11-08T19:23:03.630 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8"
2021-11-08T19:23:03.630 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-08T19:23:03.631 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31"
2021-11-08T19:23:03.631 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-08T19:23:03.631 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/"
2021-11-08T19:23:03.631 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-08T19:23:03.632 INFO:teuthology.orchestra.run.smithi064.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-08T19:23:03.632 INFO:teuthology.orchestra.run.smithi064.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-08T19:23:03.632 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server
2021-11-08T19:23:03.760 INFO:teuthology.dispatcher.supervisor:Running job 6491094
2021-11-08T19:23:03.761 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-11-08_15:14:19-rados-wip-yuri-testing-2021-11-04-0731-distro-basic-smithi/6491094 --name yuriw-2021-11-08_15:14:19-rados-wip-yuri-testing-2021-11-04-0731-distro-basic-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2021-11-08_15:14:19-rados-wip-yuri-testing-2021-11-04-0731-distro-basic-smithi/6491094/orig.config.yaml
2021-11-08T19:23:03.764 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-11-08_15:14:19-rados-wip-yuri-testing-2021-11-04-0731-distro-basic-smithi/6491094
2021-11-08T19:23:03.765 INFO:teuthology.dispatcher.supervisor:Job PID: 20374
2021-11-08T19:23:03.765 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-09T07:23:57.643 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-09T07:23:57.865 INFO:teuthology.kill:Killing Pids: {20374}
2021-11-09T07:23:59.042 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2021-11-09T07:23:59.042 INFO:teuthology.task.internal:roles: ubuntu@smithi064.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2021-11-09T07:23:59.043 INFO:teuthology.misc:Compressing logs...
2021-11-09T07:23:59.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com'
2021-11-09T07:23:59.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com'
2021-11-09T07:23:59.554 INFO:teuthology.misc:Compressing logs...
2021-11-09T07:23:59.865 INFO:teuthology.misc:Compressing logs...
2021-11-09T07:24:04.346 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/0faf7068-40cb-11ec-8c2c-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-11-09T07:24:04.378 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/0faf7068-40cb-11ec-8c2c-001a4aab830c/ceph-mds.cephfs.smithi008.xplijy.log: file size changed while zipping
2021-11-09T07:24:04.481 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/0faf7068-40cb-11ec-8c2c-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-11-09T07:24:08.342 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/0faf7068-40cb-11ec-8c2c-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-11-09T07:24:10.284 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/0faf7068-40cb-11ec-8c2c-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-11-09T07:24:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/0faf7068-40cb-11ec-8c2c-001a4aab830c/ceph-mgr.smithi008.zbggte.log: file size changed while zipping
2021-11-09T07:24:14.573 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/0faf7068-40cb-11ec-8c2c-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-11-09T07:24:16.077 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/0faf7068-40cb-11ec-8c2c-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-11-09T07:24:16.970 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/0faf7068-40cb-11ec-8c2c-001a4aab830c/ceph-mon.smithi064.log: file size changed while zipping
2021-11-09T07:24:23.002 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/0faf7068-40cb-11ec-8c2c-001a4aab830c/ceph-mon.smithi008.log: file size changed while zipping
2021-11-09T07:25:02.604 INFO:teuthology.kill:No teuthology processes running
2021-11-09T07:25:03.758 INFO:teuthology.kill:Nuking machines: ['smithi008', 'smithi064']
2021-11-09T07:25:04.748 INFO:teuthology.kill:2021-11-09 07:25:04,747.747 INFO:teuthology.nuke:targets:
2021-11-09T07:25:04.749 INFO:teuthology.kill:  smithi008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQChta7TEydN7xYT4RTfUwlTHXoGzo8AM2Gfy47DsfmF3WYopmVvNN2BP+1WJ9d5TXITe+RGDoC6Q3D6Es67Q6MEoJ31kblDG8nhjWhvN8q04l05L0+0jVbHQ1p/WBqTJaCpn7tJYfJb2+lfroPLcR0ae3/yMghA0oGy0U8AkZ2/zso47rLq+R6v2luerM6WIYLHCPIZ7e7mz0iHZirhqTtZWv6oicCFH/zBvPZV8xQwuyajSdH7FL0A1RhjgprBVw9ghWZcMmF4v6p8wrre1Nk6NWoa3m2W0IPO8AmecQVdKK7Nk7M19oQLVEJxZO2zffUb7s6aeswkAf2CbUcP25JxBkhOf6zCrxKUjZLf8BUKHxX7rLqhGapNsMwlyGfHh4AOen/ATuvpC5HLJaDQ3mlp2kUFD9PufzggjnySLzrLJicWI/a2fJ2YR9c5T/5q9MtZ+s3Y/Jkc9O+9auDjL1WNb1MRTY454zKLJX6Gr0kdCKb3LQ6htxZPyVcrKeL9LgM=
2021-11-09T07:25:04.749 INFO:teuthology.kill:  smithi064.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCQ35vwWNQet5rwOGJbx0wAOyenuIF5zXi2BVeskV02OlyWG6+Q4QQzbudUiPgm+NXowEfq661zwvxnMAazzpg6G5bu0B4Ba0xlODTvm0qji4KnP3CyiNqlSJ/vfuz7PxGu90XswMQP98x33ckble6Q/VkogBGUlWDOOZJ7HAZmcg6hfLORJA0j6ejJzykgLs/NpfzCqRj59dobQ3y20c7rGB7OV7lSNKr5IKzHs99r2fZ/0lJ+PX0i1ILHGC7YAQ/YNalCCQcS98JbKB9PHbCBIRRDC33MtL+YHNtMZqiFWrCpLxn8PO+zqsPyribRk8FZ/uns7Vzvf9elhNGvCh4T6QsZlnVEOc3/pVfpTLKRZa2yCFJ75mb08Q0D7HbSlfVAO/rtvtQGFFwML8y09N74Z0cJhqhUaB8Sun6/zO4nQmJL8z1HqMc4qS2YLxfnS7rYVJAT91ufmeeexYbZmaIu592ydrtgN0eCTbI6OMAf3sW4evhXURyEzlYChITjbKk=
2021-11-09T07:25:04.776 INFO:teuthology.kill:2021-11-09 07:25:04,776.776 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-09T07:25:04.778 INFO:teuthology.kill:2021-11-09 07:25:04,778.778 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-09T07:25:04.860 INFO:teuthology.kill:2021-11-09 07:25:04,859.859 INFO:teuthology.orchestra.console:Power off smithi064
2021-11-09T07:25:04.879 INFO:teuthology.kill:2021-11-09 07:25:04,879.879 INFO:teuthology.orchestra.console:Power off smithi008
2021-11-09T07:25:13.241 INFO:teuthology.kill:2021-11-09 07:25:13,241.241 INFO:teuthology.orchestra.console:Power off for smithi064 completed
2021-11-09T07:25:13.389 INFO:teuthology.kill:2021-11-09 07:25:13,388.388 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com
2021-11-09T07:25:17.361 INFO:teuthology.kill:2021-11-09 07:25:17,360.360 INFO:teuthology.orchestra.console:Power off for smithi008 completed
2021-11-09T07:25:17.505 INFO:teuthology.kill:2021-11-09 07:25:17,505.505 INFO:teuthology.lock.ops:unlocked: smithi008.front.sepia.ceph.com
2021-11-09T07:27:17.814 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-09T07:27:17.928 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi008 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-08_20:12:29-rados-wip-yuri4-testing-2021-11-08-1005-pacific-distro-basic-smithi/6491678
2021-11-09T07:27:17.928 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi064 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-08_20:12:29-rados-wip-yuri4-testing-2021-11-08-1005-pacific-distro-basic-smithi/6491679