2021-01-18T09:28:05.501 INFO:root:teuthology version: 1.0.0-04fddc54
2021-01-18T09:28:05.503 INFO:teuthology.results:subset: '3/4'
2021-01-18T09:28:05.503 INFO:teuthology.results:seed: '3971'
2021-01-18T09:39:35.490 INFO:root:teuthology version: 1.0.0-04fddc54
2021-01-18T09:39:35.500 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-01-18T21:30:47.902 INFO:teuthology.results:Tests finished! gathering results...
2021-01-18T21:30:52.682 INFO:scrape:Found 11 jobs
2021-01-18T21:30:55.181 INFO:scrape:Found 3 distinct failure reasons
2021-01-18T21:30:55.182 INFO:scrape:Failure: "2021-01-18T10:46:58.667204+0000 mon.b (mon.0) 2100 : cluster [WRN] Replacing daemon mds.a as rank 0 with standby daemon mds.c" in cluster log
2021-01-18T21:30:55.182 INFO:scrape:1 jobs: ['5798918']
2021-01-18T21:30:55.183 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/volumes/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'tasks/volumes/{overrides', 'test/clone}}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-01-18T21:30:55.183 INFO:scrape:
2021-01-18T21:30:55.184 INFO:scrape:Dead: b'2021-01-18T21:28:26.710 DEBUG:teuthology.exit:Finished running handlers'
2021-01-18T21:30:55.184 INFO:scrape:1 jobs: ['5798911']
2021-01-18T21:30:55.185 INFO:scrape:suites: ['cephfs-mirror/{one-per-cluster}', 'clients/{mirror}', 'cluster/{1-node}', 'fs/mirror/{begin', 'mount/fuse', 'objectstore/bluestore-bitmap', 'overrides/{whitelist_health}', 'supported-random-distros$/{rhel_8}', 'tasks/mirror}']
2021-01-18T21:30:55.185 INFO:scrape:
2021-01-18T21:30:55.185 INFO:scrape:Failure: Test failure: test_subvolumegroup_pin_distributed (tasks.cephfs.test_volumes.TestSubvolumeGroups)
2021-01-18T21:30:55.186 INFO:scrape:1 jobs: ['5798912']
2021-01-18T21:30:55.186 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs/volumes/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'tasks/volumes/{overrides', 'test/basic}}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-01-18T21:30:55.187 INFO:scrape:
2021-01-18T21:30:55.188 INFO:teuthology.results:Sending results to vshankar@redhat.com: Test Run: vshankar-2021-01-18_09:27:40-fs-wip-vshankar-cephfs-mirror-20210118-025530-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/vshankar-2021-01-18_09:27:40-fs-wip-vshankar-cephfs-mirror-20210118-025530-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/vshankar-2021-01-18_09:27:40-fs-wip-vshankar-cephfs-mirror-20210118-025530-distro-basic-smithi/
failed:  2
dead:    1
running: 0
waiting: 0
queued:  0
passed:  8


Fail
=================================================================
[5798912]  fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}}
-----------------------------------------------------------------
time:   00:27:19
info:   http://pulpito.ceph.com/vshankar-2021-01-18_09:27:40-fs-wip-vshankar-cephfs-mirror-20210118-025530-distro-basic-smithi/5798912/
log:    http://qa-proxy.ceph.com/teuthology/vshankar-2021-01-18_09:27:40-fs-wip-vshankar-cephfs-mirror-20210118-025530-distro-basic-smithi/5798912/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ab5a3a6e5f5345639f346bc434f993f7

    Test failure: test_subvolumegroup_pin_distributed
    (tasks.cephfs.test_volumes.TestSubvolumeGroups)

[5798918]  fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/clone}}
-----------------------------------------------------------------
time:   00:52:03
info:   http://pulpito.ceph.com/vshankar-2021-01-18_09:27:40-fs-wip-vshankar-cephfs-mirror-20210118-025530-distro-basic-smithi/5798918/
log:    http://qa-proxy.ceph.com/teuthology/vshankar-2021-01-18_09:27:40-fs-wip-vshankar-cephfs-mirror-20210118-025530-distro-basic-smithi/5798918/

    "2021-01-18T10:46:58.667204+0000 mon.b (mon.0) 2100 : cluster [WRN]
    Replacing daemon mds.a as rank 0 with standby daemon mds.c" in cluster log



Dead
=================================================================
[5798911]  fs/mirror/{begin cephfs-mirror/{one-per-cluster} clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distros$/{rhel_8} tasks/mirror}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/vshankar-2021-01-18_09:27:40-fs-wip-vshankar-cephfs-mirror-20210118-025530-distro-basic-smithi/5798911/
log:    http://qa-proxy.ceph.com/teuthology/vshankar-2021-01-18_09:27:40-fs-wip-vshankar-cephfs-mirror-20210118-025530-distro-basic-smithi/5798911/



Pass
=================================================================
[5798913] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/clone}}
time:   00:37:27
info:   http://pulpito.ceph.com/vshankar-2021-01-18_09:27:40-fs-wip-vshankar-cephfs-mirror-20210118-025530-distro-basic-smithi/5798913/

[5798914] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/misc}}
time:   00:13:57
info:   http://pulpito.ceph.com/vshankar-2021-01-18_09:27:40-fs-wip-vshankar-cephfs-mirror-20210118-025530-distro-basic-smithi/5798914/

[5798915] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/snapshot}}
time:   00:18:56
info:   http://pulpito.ceph.com/vshankar-2021-01-18_09:27:40-fs-wip-vshankar-cephfs-mirror-20210118-025530-distro-basic-smithi/5798915/

[5798916] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
time:   00:14:47
info:   http://pulpito.ceph.com/vshankar-2021-01-18_09:27:40-fs-wip-vshankar-cephfs-mirror-20210118-025530-distro-basic-smithi/5798916/

[5798917] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}}
time:   00:40:16
info:   http://pulpito.ceph.com/vshankar-2021-01-18_09:27:40-fs-wip-vshankar-cephfs-mirror-20210118-025530-distro-basic-smithi/5798917/

[5798919] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/misc}}
time:   00:14:56
info:   http://pulpito.ceph.com/vshankar-2021-01-18_09:27:40-fs-wip-vshankar-cephfs-mirror-20210118-025530-distro-basic-smithi/5798919/

[5798920] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/snapshot}}
time:   00:20:19
info:   http://pulpito.ceph.com/vshankar-2021-01-18_09:27:40-fs-wip-vshankar-cephfs-mirror-20210118-025530-distro-basic-smithi/5798920/

[5798921] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
time:   00:16:53
info:   http://pulpito.ceph.com/vshankar-2021-01-18_09:27:40-fs-wip-vshankar-cephfs-mirror-20210118-025530-distro-basic-smithi/5798921/