2021-03-28T17:36:16.951 INFO:root:teuthology version: 1.1.0-d5a60f86
2021-03-28T17:36:16.952 INFO:teuthology.results:subset: '5575/9999'
2021-03-28T17:36:16.953 INFO:teuthology.results:seed: '569'
2021-03-28T17:59:07.320 INFO:root:teuthology version: 1.1.0-d5a60f86
2021-03-28T17:59:07.324 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-03-28T18:13:37.827 INFO:teuthology.results:Tests finished! gathering results...
2021-03-28T18:13:40.052 INFO:scrape:Found 24 jobs
2021-03-28T18:13:43.021 INFO:scrape:Found 2 distinct failure reasons
2021-03-28T18:13:43.022 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e61b15880d42cb4248c17ea9494bc11be2b7a78
2021-03-28T18:13:43.023 INFO:scrape:23 jobs: ['5961976', '5961992', '5961991', '5961988', '5961972', '5961979', '5961975', '5961989', '5961987', '5961984', '5961981', '5961982', '5961986', '5961990', '5961980', '5961969', '5961970', '5961983', '5961978', '5961971', '5961977', '5961985', '5961973']
2021-03-28T18:13:43.024 INFO:scrape:suites intersection: ['conf/{client', 'mds', 'mon', 'osd}', 'session_timeout', 'whitelist_health']
2021-03-28T18:13:43.025 INFO:scrape:suites union: ['begin', 'centos_latest', 'ceph-thrash/mds', 'ceph-thrash/mon', 'clusters/3-mds', 'clusters/3-mds-2-standby', 'clusters/9-mds', 'clusters/9-mds-3-standby', 'conf/{client', 'fuse-default-perm-no}', 'inline/no', 'inline/yes', 'k-testing}', 'mds', 'mon', 'mon-debug', 'mount', 'mount/fuse', 'mount/kclient/{k-testing', 'mount/kclient/{mount', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'msgr-failures/osd-mds-delay', 'multimds/basic/{0-supported-random-distro$/{centos_latest}', 'multimds/basic/{0-supported-random-distro$/{rhel_latest}', 'multimds/basic/{0-supported-random-distro$/{ubuntu_latest}', 'multimds/thrash/{0-supported-random-distro$/{centos_latest}', 'multimds/thrash/{0-supported-random-distro$/{ubuntu_latest}', 'multimds/verify/{begin', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{fuse-default-perm-no', 'q_check_counter/check_counter', 'rhel_8}', 'session_timeout', 'tasks/cephfs_test_exports}', 'tasks/cephfs_test_snapshots}', 'tasks/cfuse_workunit_kernel_untar_build}', 'tasks/cfuse_workunit_misc}', 'tasks/cfuse_workunit_norstats}', 'tasks/cfuse_workunit_suites_blogbench}', 'tasks/cfuse_workunit_suites_dbench', 'tasks/cfuse_workunit_suites_dbench}', 'tasks/cfuse_workunit_suites_ffsb}', 'tasks/cfuse_workunit_suites_fsstress', 'tasks/cfuse_workunit_suites_fsstress}', 'tasks/cfuse_workunit_suites_fsx}', 'tasks/cfuse_workunit_suites_pjd}', 'thrash/{frag_enable', 'thrash_debug}', 'validater/lockdep}', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'whitelist_wrongly_marked_down}}']
2021-03-28T18:13:43.025 INFO:scrape:
2021-03-28T18:13:43.026 INFO:scrape:Failure: Command failed on gibba032 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/master'
2021-03-28T18:13:43.026 INFO:scrape:1 jobs: ['5961974']
2021-03-28T18:13:43.026 INFO:scrape:suites: ['begin', 'clusters/3-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/yes', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'multimds/basic/{0-supported-random-distro$/{rhel_latest}', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'q_check_counter/check_counter', 'session_timeout', 'tasks/cfuse_workunit_suites_pjd}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-28T18:13:43.027 INFO:scrape:
2021-03-28T18:13:43.029 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba
=================================================================
info:    http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/
failed:  24
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[5961969]  multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
-----------------------------------------------------------------
time:   00:03:52
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961969/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961969/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4836eea0393b454aa47a6b1774fb997d

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e6
    1b15880d42cb4248c17ea9494bc11be2b7a78

[5961970]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:04:58
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961970/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961970/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5d643db5b1bf43b991b82334145fbe0f

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e6
    1b15880d42cb4248c17ea9494bc11be2b7a78

[5961971]  multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:03:25
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961971/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961971/
sentry: https://sentry.ceph.com/organizations/ceph/?query=47dad242cc3f4942aa0bf436c5f15e9f

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1
    =5e61b15880d42cb4248c17ea9494bc11be2b7a78

[5961972]  multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
-----------------------------------------------------------------
time:   00:05:03
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961972/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961972/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ee2d7a2bd3a540b79a4dc82c7f39b21c

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e6
    1b15880d42cb4248c17ea9494bc11be2b7a78

[5961973]  multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   00:05:02
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961973/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961973/
sentry: https://sentry.ceph.com/organizations/ceph/?query=883be4773c9f44ca90ac18964e5f31c2

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e6
    1b15880d42cb4248c17ea9494bc11be2b7a78

[5961974]  multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961974/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961974/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bfe8c7bb2ed74e43b57d2b3b7f46f170

    Command failed on gibba032 with status 128: 'cd /lib/firmware/updates &&
    sudo git fetch origin && sudo git reset --hard origin/master'

[5961975]  multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   00:04:00
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961975/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961975/
sentry: https://sentry.ceph.com/organizations/ceph/?query=82d6048c14504dff96d3342bfc58d403

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e6
    1b15880d42cb4248c17ea9494bc11be2b7a78

[5961976]  multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
-----------------------------------------------------------------
time:   00:04:56
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961976/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961976/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9f3399e190b54f6f8f6bb306f03da2ef

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e6
    1b15880d42cb4248c17ea9494bc11be2b7a78

[5961977]  multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
-----------------------------------------------------------------
time:   00:03:57
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961977/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961977/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6e5417d1e13a466e804f223cd4fcae8f

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e6
    1b15880d42cb4248c17ea9494bc11be2b7a78

[5961978]  multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
-----------------------------------------------------------------
time:   00:04:53
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961978/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961978/
sentry: https://sentry.ceph.com/organizations/ceph/?query=aea6f450309b4ce8b1e4695fb7edc8fe

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e6
    1b15880d42cb4248c17ea9494bc11be2b7a78

[5961979]  multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:05:04
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961979/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961979/
sentry: https://sentry.ceph.com/organizations/ceph/?query=da46be072e9c48b799b2af129aac3132

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e6
    1b15880d42cb4248c17ea9494bc11be2b7a78

[5961980]  multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
-----------------------------------------------------------------
time:   00:04:59
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961980/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961980/
sentry: https://sentry.ceph.com/organizations/ceph/?query=00bcd162a8de4c91a78bcd6d3b7785d6

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e6
    1b15880d42cb4248c17ea9494bc11be2b7a78

[5961981]  multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
-----------------------------------------------------------------
time:   00:04:55
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961981/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961981/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7609ec6cc9d342e79abe106bb6eb8579

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e6
    1b15880d42cb4248c17ea9494bc11be2b7a78

[5961982]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
-----------------------------------------------------------------
time:   00:03:28
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961982/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961982/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e56a766bc8434b0e86113ab9e1e0a3d1

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1
    =5e61b15880d42cb4248c17ea9494bc11be2b7a78

[5961983]  multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   00:05:00
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961983/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961983/
sentry: https://sentry.ceph.com/organizations/ceph/?query=64189886b6584c4db651e840a3bfe305

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e6
    1b15880d42cb4248c17ea9494bc11be2b7a78

[5961984]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
-----------------------------------------------------------------
time:   00:03:00
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961984/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961984/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fcc7baf3843d4a81b39287e99695efa2

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1
    =5e61b15880d42cb4248c17ea9494bc11be2b7a78

[5961985]  multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
-----------------------------------------------------------------
time:   00:03:56
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961985/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961985/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fbb1459efb774e7f8c5ae4c1a12dcd3c

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e6
    1b15880d42cb4248c17ea9494bc11be2b7a78

[5961986]  multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
-----------------------------------------------------------------
time:   00:04:54
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961986/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961986/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3582967c475340c3a31794373f958e6d

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e6
    1b15880d42cb4248c17ea9494bc11be2b7a78

[5961987]  multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:03:26
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961987/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961987/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6a34836d123e481b825600d1706e421d

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1
    =5e61b15880d42cb4248c17ea9494bc11be2b7a78

[5961988]  multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
-----------------------------------------------------------------
time:   00:05:01
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961988/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961988/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e9634ebd63a14aea8a92256172775b03

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e6
    1b15880d42cb4248c17ea9494bc11be2b7a78

[5961989]  multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
-----------------------------------------------------------------
time:   00:05:03
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961989/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961989/
sentry: https://sentry.ceph.com/organizations/ceph/?query=59e6a6515c324a49b965aa65ffc82361

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e6
    1b15880d42cb4248c17ea9494bc11be2b7a78

[5961990]  multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
-----------------------------------------------------------------
time:   00:03:28
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961990/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961990/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7b3a41dbde2d4059b2996a341995f4ba

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1
    =5e61b15880d42cb4248c17ea9494bc11be2b7a78

[5961991]  multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   00:03:05
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961991/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961991/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b1a91e86200e483389db2ae307c13f97

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1
    =5e61b15880d42cb4248c17ea9494bc11be2b7a78

[5961992]  multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
-----------------------------------------------------------------
time:   00:04:03
info:   http://pulpito.ceph.com/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961992/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-13_13:15:04-multimds-octopus-distro-basic-gibba/5961992/
sentry: https://sentry.ceph.com/organizations/ceph/?query=057ac509cae644e5aae0d3f1be2ee7e1

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e6
    1b15880d42cb4248c17ea9494bc11be2b7a78