2021-11-05T14:07:46.568 INFO:root:teuthology version: 1.1.0-27954452
2021-11-05T14:07:46.690 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi012.front.sepia.ceph.com' reimaging
2021-11-05T14:07:46.691 INFO:teuthology.lock.ops:Updating [ubuntu@smithi012.front.sepia.ceph.com]: reset os type and version on server
2021-11-05T14:07:46.691 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server
2021-11-05T14:07:46.709 INFO:teuthology.lock.ops:Node 'ubuntu@smithi012.front.sepia.ceph.com' reimaging is complete
2021-11-05T14:07:46.709 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi099.front.sepia.ceph.com' reimaging
2021-11-05T14:07:46.710 INFO:teuthology.lock.ops:Updating [ubuntu@smithi099.front.sepia.ceph.com]: reset os type and version on server
2021-11-05T14:07:46.710 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2021-11-05T14:07:46.728 INFO:teuthology.lock.ops:Node 'ubuntu@smithi099.front.sepia.ceph.com' reimaging is complete
2021-11-05T14:07:46.928 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 8.3
2021-11-05T14:07:46.931 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 8.3
2021-11-05T14:07:47.223 INFO:teuthology.orchestra.console:Power off smithi099
2021-11-05T14:07:47.236 INFO:teuthology.orchestra.console:Power off smithi012
2021-11-05T14:07:59.707 INFO:teuthology.orchestra.console:Power off for smithi099 completed
2021-11-05T14:07:59.714 INFO:teuthology.orchestra.console:Power off for smithi012 completed
2021-11-05T14:07:59.809 INFO:teuthology.orchestra.console:Power on smithi099
2021-11-05T14:07:59.818 INFO:teuthology.orchestra.console:Power on smithi012
2021-11-05T14:08:04.065 INFO:teuthology.orchestra.console:Power on for smithi099 completed
2021-11-05T14:08:04.070 INFO:teuthology.orchestra.console:Power on for smithi012 completed
2021-11-05T14:08:04.166 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish
2021-11-05T14:08:04.170 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish
2021-11-05T14:12:15.426 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-05T14:12:30.787 INFO:teuthology.provision.fog.smithi099:Node is ready
2021-11-05T14:12:30.846 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com
2021-11-05T14:12:30.903 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099
2021-11-05T14:12:31.247 INFO:teuthology.provision.fog.smithi099:Deploy complete!
2021-11-05T14:13:03.248 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-05T14:13:18.604 INFO:teuthology.provision.fog.smithi012:Node is ready
2021-11-05T14:13:18.664 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com
2021-11-05T14:13:18.721 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012
2021-11-05T14:13:19.067 INFO:teuthology.provision.fog.smithi012:Deploy complete!
2021-11-05T14:13:19.247 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com
2021-11-05T14:13:19.248 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-05T14:13:19.284 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com
2021-11-05T14:13:19.285 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-05T14:13:19.301 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server
2021-11-05T14:13:19.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com'
2021-11-05T14:13:19.501 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64
2021-11-05T14:13:19.556 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Linux"
2021-11-05T14:13:19.556 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="8"
2021-11-05T14:13:19.556 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos"
2021-11-05T14:13:19.557 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora"
2021-11-05T14:13:19.557 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="8"
2021-11-05T14:13:19.557 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el8"
2021-11-05T14:13:19.557 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-05T14:13:19.557 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31"
2021-11-05T14:13:19.558 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-05T14:13:19.558 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/"
2021-11-05T14:13:19.558 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-05T14:13:19.558 INFO:teuthology.orchestra.run.smithi012.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-05T14:13:19.559 INFO:teuthology.orchestra.run.smithi012.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-05T14:13:19.560 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server
2021-11-05T14:13:19.578 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server
2021-11-05T14:13:19.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2021-11-05T14:13:19.843 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64
2021-11-05T14:13:19.896 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Linux"
2021-11-05T14:13:19.897 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8"
2021-11-05T14:13:19.897 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2021-11-05T14:13:19.897 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2021-11-05T14:13:19.897 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8"
2021-11-05T14:13:19.898 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2021-11-05T14:13:19.898 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-05T14:13:19.898 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2021-11-05T14:13:19.898 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-05T14:13:19.899 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2021-11-05T14:13:19.899 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-05T14:13:19.899 INFO:teuthology.orchestra.run.smithi099.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-05T14:13:19.899 INFO:teuthology.orchestra.run.smithi099.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-05T14:13:19.900 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2021-11-05T14:13:19.997 INFO:teuthology.dispatcher.supervisor:Running job 6485497
2021-11-05T14:13:19.997 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-11-04_20:25:46-rados-wip-yuri-testing-2021-11-04-0731-distro-basic-smithi/6485497 --name yuriw-2021-11-04_20:25:46-rados-wip-yuri-testing-2021-11-04-0731-distro-basic-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2021-11-04_20:25:46-rados-wip-yuri-testing-2021-11-04-0731-distro-basic-smithi/6485497/orig.config.yaml
2021-11-05T14:13:20.001 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-11-04_20:25:46-rados-wip-yuri-testing-2021-11-04-0731-distro-basic-smithi/6485497
2021-11-05T14:13:20.001 INFO:teuthology.dispatcher.supervisor:Job PID: 30029
2021-11-05T14:13:20.002 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-06T02:14:11.339 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-06T02:14:11.507 INFO:teuthology.kill:Killing Pids: {30029}
2021-11-06T02:14:12.628 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2021-11-06T02:14:12.629 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2021-11-06T02:14:12.630 INFO:teuthology.misc:Compressing logs...
2021-11-06T02:14:12.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com'
2021-11-06T02:14:12.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2021-11-06T02:14:13.122 INFO:teuthology.misc:Compressing logs...
2021-11-06T02:14:13.462 INFO:teuthology.misc:Compressing logs...
2021-11-06T02:14:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/3f286f9a-3e44-11ec-8c28-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-11-06T02:14:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/3f286f9a-3e44-11ec-8c28-001a4aab830c/ceph-mon.smithi099.log: file size changed while zipping
2021-11-06T02:14:38.830 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/3f286f9a-3e44-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi012.fthkhj.log: file size changed while zipping
2021-11-06T02:14:52.901 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/3f286f9a-3e44-11ec-8c28-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-11-06T02:15:04.165 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/3f286f9a-3e44-11ec-8c28-001a4aab830c/ceph-mon.smithi012.log: file size changed while zipping
2021-11-06T02:15:06.008 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/3f286f9a-3e44-11ec-8c28-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-11-06T02:15:07.942 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/3f286f9a-3e44-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi012.zrpbee.log: file size changed while zipping
2021-11-06T02:15:20.152 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/3f286f9a-3e44-11ec-8c28-001a4aab830c/ceph-mgr.smithi012.ytvgst.log: file size changed while zipping
2021-11-06T02:15:24.188 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/3f286f9a-3e44-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi099.befzna.log: file size changed while zipping
2021-11-06T02:15:36.105 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/3f286f9a-3e44-11ec-8c28-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-11-06T02:15:53.009 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/3f286f9a-3e44-11ec-8c28-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-11-06T02:16:10.445 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/3f286f9a-3e44-11ec-8c28-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-11-06T02:16:48.801 INFO:teuthology.kill:No teuthology processes running
2021-11-06T02:16:49.927 INFO:teuthology.kill:Nuking machines: ['smithi012', 'smithi099']
2021-11-06T02:16:50.841 INFO:teuthology.kill:2021-11-06 02:16:50,840.840 INFO:teuthology.nuke:targets:
2021-11-06T02:16:50.841 INFO:teuthology.kill:  smithi012.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOHxwtiSlukGqSdiFFUrUh4anZABhld0DLcESY/8+e44ePGmE1iDsrno8bYxRdb+K/0qZRLoAHv2/yZDROmG3M4Zn13LoAf7PQ7sYGp2PA4MUSk6UUpjnGynhrxOTS3UPdETtdYAfUNFoDRI8dNMGlGerOU3+7VoVV3hRyEUkhkEaXNyKXLlDmvsrItvAy4MjpCK/W6FtNfw1zrjKnYt1WNNm7zCbdWA9y7QoLZTaSci6yQmFWztR5ggbzpCHo3KcECiS/TpFwzf8fqFUpm+cpo8yKXYQPfv9auMRRr5DMmYAW8+13eCeV07lOI8Gw5Px+BdKVp2i9pNbAKjkTuYIOGreY7pjpHENkkJDV54Ya3Guu2/DpOhFnLf81b6RjYDUbw+V3dFKANkl3oLVyEQUXS/TMUxOYePFnU5f2LSLeK9ZhdJjSlCwdQ5Hs5CDTSOPtSTvCX1edwYFlvIe5O3LXfx6Q5iCY21yzY9ZLF29BM7ztg/3Y+PFJCl8LVgAQYa8=
2021-11-06T02:16:50.842 INFO:teuthology.kill:  smithi099.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8KEGJJRQ7IU4U93fdfLg9BAYnUME4/OGZ+v3J3lCzTJ0AnT+DdBL/vQe1XI808hiyxnzvXENXX8Wy01+m8NmoecSVDWhWsnmmvaRraUjcJ56vD5tF82O8wTBitsHQK5LXxIwLJ6Zbc5vNyL6JkXnh8sxjScxLzFxXPzs3OrtpxqVTea6ggakcWZlp3VR6ypqwFj+QZJsuEsxfGLXkaUopYLXwDdt66VRUceT5/dQSUcme94O+W3R6lFMI+TCorsD0aJ+dnRDulsdlYzG+QrfAz367C+4dlmEQzWruQ8mMGCWN1JbelN6Yf1PTIAxyQOU/mWVlOE+uaYw0FR+RgJW1sKgyyhGxA0Jz/e7qld97+/cP5Gb9MvOq2HRR/ax7jmAwUDX6Gh7kEsO2PGHh6rNgeGCZRjBIpJByUuS0xBGSG/9luOVJ2UM+7TrpEBk5qUKn5reE00iC3ehuSBYYNyrNXpeIQRyC1H1AOenpK7S3E7e15oD0GSnzAQDSHjBjs1E=
2021-11-06T02:16:50.867 INFO:teuthology.kill:2021-11-06 02:16:50,867.867 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-06T02:16:50.870 INFO:teuthology.kill:2021-11-06 02:16:50,870.870 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-06T02:16:50.941 INFO:teuthology.kill:2021-11-06 02:16:50,940.940 INFO:teuthology.orchestra.console:Power off smithi099
2021-11-06T02:16:50.953 INFO:teuthology.kill:2021-11-06 02:16:50,953.953 INFO:teuthology.orchestra.console:Power off smithi012
2021-11-06T02:16:59.311 INFO:teuthology.kill:2021-11-06 02:16:59,310.310 INFO:teuthology.orchestra.console:Power off for smithi099 completed
2021-11-06T02:16:59.453 INFO:teuthology.kill:2021-11-06 02:16:59,453.453 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com
2021-11-06T02:17:03.428 INFO:teuthology.kill:2021-11-06 02:17:03,427.427 INFO:teuthology.orchestra.console:Power off for smithi012 completed
2021-11-06T02:17:03.572 INFO:teuthology.kill:2021-11-06 02:17:03,572.572 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com
2021-11-06T02:19:03.813 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-06T02:19:03.916 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi012 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-04_20:25:46-rados-wip-yuri-testing-2021-11-04-0731-distro-basic-smithi/6485622
2021-11-06T02:19:03.917 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi099 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-04_20:25:46-rados-wip-yuri-testing-2021-11-04-0731-distro-basic-smithi/6485622