2021-09-23T01:14:02.408 INFO:root:teuthology version: 1.1.0-d3a488f5
2021-09-23T01:14:02.410 INFO:teuthology.results:subset: '29/32'
2021-09-23T01:14:02.410 INFO:teuthology.results:seed: '7111'
2021-09-24T18:46:11.678 INFO:root:teuthology version: 1.1.0-d3a488f5
2021-09-24T18:46:11.713 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-09-24T19:03:13.111 INFO:teuthology.results:Tests finished! gathering results...
2021-09-24T19:03:34.277 INFO:scrape:Found 261 jobs
2021-09-24T19:03:35.244 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377157/teuthology.log
2021-09-24T19:03:59.212 INFO:scrape:Found 2 distinct failure reasons
2021-09-24T19:03:59.214 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca906d0d7a65c8a598d397b764dd262cce645fe3
2021-09-24T19:03:59.214 INFO:scrape:223 jobs
2021-09-24T19:03:59.217 INFO:scrape:suites intersection: []
2021-09-24T19:03:59.217 INFO:scrape:suites union: ['1-client', '1-mount', '2-upgrade', '2-workload/dbench', '2-workunit/cfuse_workunit_snaptests}}', '2-workunit/cfuse_workunit_suites_fsstress}}', '2-workunit/cfuse_workunit_suites_pjd}}', '2-workunit/cfuse_workunit_trivial_sync}}', '2-workunit/ffsb}}', '2-workunit/fs/snaps}}', '2-workunit/fs/trivial_sync}}', '2-workunit/iozone}}', '2-workunit/suites/ffsb}}', '2-workunit/suites/fsstress}}', '2-workunit/suites/iozone}}', '2-workunit/suites/pjd}}', '3-compat_client/no}}', '3-compat_client/pacific}}', 'centos_latest', 'cephfs-mirror/one-per-cluster', 'clients/mirror', 'clients/{mirror}', 'cluster/1-node', 'cluster/{1-node}', 'clusters/1-mds-1-client-coloc', 'clusters/1-mds-2-client-micro', 'clusters/1-mds-3-client', 'clusters/1-node-1-mds-1-osd', 'clusters/1a11s-mds-1c-client-3node', 'clusters/1a3s-mds-1c-client', 'clusters/1a3s-mds-2c-client', 'clusters/1a3s-mds-4c-client', 'clusters/1a5s-mds-1c-client', 'clusters/fixed-2-ucephfs', 'clusters/small-cluster', 'conf/{client', 'debug', 'distro/centos_latest}', 'distro/{centos_8.stream}', 'distro/{centos_8}', 'distro/{rhel_8}', 'distro/{ubuntu/{latest', 'distro/{ubuntu_latest}', 'distros/ubuntu_latest', 'fs/32bits/{begin', 'fs/bugs/client_trim_caps/{begin', 'fs/cephadm/multivolume/{0-start', 'fs/full/{begin', 'fs/functional/{begin', 'fs/libcephfs/{begin', 'fs/mirror/{begin', 'fs/mixed-clients/{begin', 'fs/multiclient/{begin', 'fs/multifs/{begin', 'fs/permission/{begin', 'fs/shell/{begin', 'fs/snaps/{begin', 'fs/thrash/multifs/{begin', 'fs/thrash/workloads/{begin', 'fs/top/{begin', 'fs/traceless/{begin', 'fs/upgrade/featureful_client/old_client/{bluestore-bitmap', 'fs/valgrind/{begin', 'fs/verify/{begin', 'fs/volumes/{begin', 'fs/workload/{begin', 'k-testing}', 'kclient-overrides/{distro/stock/{k-stock', 'kclient-overrides/{distro/testing/{flavor/centos_latest', 'kclient-overrides/{distro/testing/{flavor/ubuntu_latest', 'mds', 'mirror/{cephfs-mirror/one-per-cluster', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{k-testing', 'mount/kclient/{mount', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'ms_mode/{crc}', 'ms_mode/{legacy}', 'ms_mode/{secure}', 'msgr-failures/none', 'msgr-failures/osd-mds-delay', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'omap_limit/10', 'omap_limit/10000', 'osd}', 'overrides', 'overrides/whitelist_health', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{faked-ino', 'overrides/{mon-debug', 'overrides/{multifs', 'overrides/{multimds/no', 'overrides/{multimds/yes', 'overrides/{no_client_pidfile', 'overrides/{osd-asserts', 'overrides/{session_timeout', 'overrides/{whitelist_health', 'overrides/{whitelist_health}', 'overrides}}', 'pg-warn', 'ranks/1', 'ranks/3', 'ranks/5', 'rhel_8}', 'scrub/no', 'scrub/yes', 'session_timeout', 'standby-replay', 'supported-random-distros$/{centos_8.stream}', 'supported-random-distros$/{centos_8}', 'tasks/acls}', 'tasks/asok_dump_tree}', 'tasks/auto-repair}', 'tasks/backtrace}', 'tasks/cap-flush}', 'tasks/cephfs-shell}', 'tasks/cfuse_workunit_misc}', 'tasks/cfuse_workunit_suites_blogbench', 'tasks/cfuse_workunit_suites_dbench', 'tasks/cfuse_workunit_suites_ffsb', 'tasks/cfuse_workunit_suites_fsstress', 'tasks/cfuse_workunit_suites_fsstress}', 'tasks/cfuse_workunit_suites_pjd}', 'tasks/client-limits}', 'tasks/client-readahead}', 'tasks/client-recovery}', 'tasks/client}', 'tasks/damage}', 'tasks/data-scan}', 'tasks/dbench', 'tasks/exports}', 'tasks/failover}', 'tasks/forward-scrub}', 'tasks/fragment}', 'tasks/fsstress', 'tasks/fstop}', 'tasks/ino_release_cb}', 'tasks/ior-shared-file}', 'tasks/journal-repair}', 'tasks/kernel_cfuse_workunits_dbench_iozone}', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}', 'tasks/libcephfs_python}', 'tasks/libcephfs}', 'tasks/mds-flush}', 'tasks/mds-full}', 'tasks/mds_creation_retry}', 'tasks/mdtest}', 'tasks/metrics}', 'tasks/mgr-osd-full}', 'tasks/mirror}', 'tasks/mirror}}', 'tasks/multifs-auth}', 'tasks/multimds_misc}', 'tasks/openfiletable}', 'tasks/pool-perm}', 'tasks/quota}', 'tasks/scrub}', 'tasks/sessionmap}', 'tasks/snap-schedule}', 'tasks/snapshots}', 'tasks/strays}', 'tasks/test_journal_migration}', 'tasks/trim-i24137}', 'tasks/truncate_delay}', 'tasks/volumes/{overrides', 'tasks/workunit/snaps}', 'tasks/{0-check-counter', 'tasks/{0-octopus', 'tasks/{1-thrash/mds', 'tasks/{1-thrash/mon', 'tasks/{1-thrash/osd', 'test/basic}}', 'test/clone}}', 'test/misc}}', 'test/snapshot}}', 'thrashosds-health', 'traceless/50pc}', 'validater/lockdep}', 'validater/valgrind}', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/direct_io}', 'workunit/fs/misc}', 'workunit/fs/norstats}', 'workunit/fs/test_o_trunc}', 'workunit/kernel_untar_build}', 'workunit/suites/blogbench}', 'workunit/suites/dbench}', 'workunit/suites/ffsb}', 'workunit/suites/fsstress}', 'workunit/suites/fsx}', 'workunit/suites/fsync-tester}', 'workunit/suites/iogen}', 'workunit/suites/iozone}', 'workunit/suites/pjd}', 'wsync/{no}}', 'wsync/{yes}}']
2021-09-24T19:03:59.218 INFO:scrape:
2021-09-24T19:03:59.219 INFO:scrape:Dead: None
2021-09-24T19:03:59.219 INFO:scrape:38 jobs
2021-09-24T19:03:59.220 INFO:scrape:
2021-09-24T19:03:59.229 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba
=================================================================
info:    http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/
failed:  223
dead:    38
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[6376986]  fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/snapshot}}
-----------------------------------------------------------------
time:   00:03:25
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376986/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376986/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0f0b171ffca54d3d8c8edca05b809fda

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6376987]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsstress} wsync/{no}}
-----------------------------------------------------------------
time:   00:05:01
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376987/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376987/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cfb61b266577413699ec279dbc51c772

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6376988]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/ffsb}}
-----------------------------------------------------------------
time:   00:04:21
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376988/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376988/
sentry: https://sentry.ceph.com/organizations/ceph/?query=67fe550128e943e8bdc2aaf660ba7908

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6376989]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/backtrace}
-----------------------------------------------------------------
time:   00:07:20
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376989/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376989/
sentry: https://sentry.ceph.com/organizations/ceph/?query=da9c8b9d93e44339b29aa9c70a4d5624

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6376990]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsx} wsync/{yes}}
-----------------------------------------------------------------
time:   00:03:53
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376990/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376990/
sentry: https://sentry.ceph.com/organizations/ceph/?query=15b456083da949778389bf1ca7c12b85

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6376991]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/fsstress}}
-----------------------------------------------------------------
time:   00:07:02
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376991/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376991/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7d74fc67687c4a81b1ea6357597d0542

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6376992]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsync-tester} wsync/{no}}
-----------------------------------------------------------------
time:   00:04:06
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376992/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376992/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8c8ea1c240d04b239898847674d2cfb8

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6376994]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}}
-----------------------------------------------------------------
time:   00:04:44
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376994/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376994/
sentry: https://sentry.ceph.com/organizations/ceph/?query=124dc157a2f0443a986ddccf1bc335fa

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6376995]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc} wsync/{yes}}
-----------------------------------------------------------------
time:   00:06:27
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376995/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376995/
sentry: https://sentry.ceph.com/organizations/ceph/?query=735740b2cb7946a195ba979480f1432b

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6376996]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{yes}}
-----------------------------------------------------------------
time:   00:04:50
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376996/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376996/
sentry: https://sentry.ceph.com/organizations/ceph/?query=970987c9e205448696d9043699a93069

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6376997]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/iozone}}
-----------------------------------------------------------------
time:   00:03:23
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376997/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376997/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cfc01be3985649d39e57a37c804de2f2

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6376998]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-limits}
-----------------------------------------------------------------
time:   00:03:35
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376998/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376998/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e6d429b5cccb40e493fae9577ddc922c

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6376999]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iozone} wsync/{no}}
-----------------------------------------------------------------
time:   00:03:38
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376999/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376999/
sentry: https://sentry.ceph.com/organizations/ceph/?query=97027d24184c41c482a6aafc4b91f28c

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377000]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/pjd}}
-----------------------------------------------------------------
time:   00:05:02
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377000/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377000/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c6ccfc08eb014b70a677d6d7a1d71001

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377001]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse ms_mode/{legacy} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/pjd} wsync/{no}}
-----------------------------------------------------------------
time:   00:03:16
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377001/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377001/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3c5747a968d74253bb256f9333ee4e88

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377002]  fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:06:23
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377002/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377002/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b9fbfe58a95f43058be1ff93a8457a1e

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377003]  fs/bugs/client_trim_caps/{begin centos_latest clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/trim-i24137}
-----------------------------------------------------------------
time:   00:04:01
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377003/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377003/
sentry: https://sentry.ceph.com/organizations/ceph/?query=678e1f470b95422a8807dc0595b44a83

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377004]  fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/centos_latest}
-----------------------------------------------------------------
time:   00:03:59
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377004/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377004/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cd33a99ff7fc4c259cd1eb91b06f4a57

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377005]  fs/full/{begin clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mgr-osd-full}
-----------------------------------------------------------------
time:   00:06:24
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377005/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377005/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c641b360a1e04c1199d56f972db60150

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377006]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-readahead}
-----------------------------------------------------------------
time:   00:06:22
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377006/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377006/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4efeb970927247939a200970a6da3688

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377007]  fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client}
-----------------------------------------------------------------
time:   00:03:53
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377007/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377007/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cd653640616c49cd94d95f75fd8e203e

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377008]  fs/mirror/{begin cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distros$/{centos_8} tasks/mirror}
-----------------------------------------------------------------
time:   00:03:51
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377008/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377008/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1e88f7147cdb4ac6867d39c9a66737ae

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377009]  fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone}
-----------------------------------------------------------------
time:   00:06:25
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377009/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377009/
sentry: https://sentry.ceph.com/organizations/ceph/?query=94f412f142464b7e9a308229fcede8a6

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377011]  fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover}
-----------------------------------------------------------------
time:   00:03:29
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377011/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377011/
sentry: https://sentry.ceph.com/organizations/ceph/?query=54056c5f13f24be4baed0bc8e4aa51e3

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377012]  fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
-----------------------------------------------------------------
time:   00:02:52
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377012/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377012/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f6129c06bbb8477892d78e42167b8483

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377013]  fs/shell/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cephfs-shell}
-----------------------------------------------------------------
time:   00:02:52
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377013/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377013/
sentry: https://sentry.ceph.com/organizations/ceph/?query=92329327a8c945dba14440b01518fcd9

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377014]  fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}}
-----------------------------------------------------------------
time:   00:04:53
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377014/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377014/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ccbfc30c9a9448c3a28ab8687cd1017f

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377015]  fs/top/{begin cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/whitelist_health supported-random-distros$/{centos_8.stream} tasks/fstop}
-----------------------------------------------------------------
time:   00:04:53
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377015/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377015/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cf5f0fd8830642aa9949f33e8903a8b3

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377016]  fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}}
-----------------------------------------------------------------
time:   00:13:26
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377016/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377016/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b41e19046bce425d80351c86f2972363

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377017]  fs/valgrind/{begin centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/whitelist_health tasks/mirror}}
-----------------------------------------------------------------
time:   00:03:54
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377017/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377017/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ad1d1efd765548e887d648cb60c416d1

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377018]  fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/fsstress validater/lockdep}
-----------------------------------------------------------------
time:   00:04:40
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377018/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377018/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1ab9f8259b094a48a9fdcfc014bd5019

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377019]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/direct_io} wsync/{yes}}
-----------------------------------------------------------------
time:   00:06:31
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377019/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377019/
sentry: https://sentry.ceph.com/organizations/ceph/?query=040a0797a7b74860b4726620bb3edc07

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377020]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}}
-----------------------------------------------------------------
time:   00:04:45
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377020/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377020/
sentry: https://sentry.ceph.com/organizations/ceph/?query=df4be39e649a4eeda4c71f4268eec5e2

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377021]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   00:06:24
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377021/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377021/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2f5a3cddd7254c76b444e377185465ab

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377022]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{no}}
-----------------------------------------------------------------
time:   00:03:25
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377022/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377022/
sentry: https://sentry.ceph.com/organizations/ceph/?query=769156e0bfb9443395ccbf4a25ab5f81

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377023]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery}
-----------------------------------------------------------------
time:   00:06:20
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377023/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377023/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e2326aa64e6340d0be33feb87a447683

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377024]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/ffsb}}
-----------------------------------------------------------------
time:   00:04:44
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377024/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377024/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8161dfbb32fc42b99e05ab164f212fdd

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377026]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/fsstress}}
-----------------------------------------------------------------
time:   00:03:20
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377026/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377026/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ecbf1a5c674f4e38b77c638adbb722ac

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377027]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{no}}
-----------------------------------------------------------------
time:   00:06:27
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377027/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377027/
sentry: https://sentry.ceph.com/organizations/ceph/?query=582cfaf834ef48859a011cc09a11dc08

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377028]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/damage}
-----------------------------------------------------------------
time:   00:04:54
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377028/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377028/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bf0aadc76b014279894c2dc01ae6ae7a

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377029]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{yes}}
-----------------------------------------------------------------
time:   00:04:41
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377029/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377029/
sentry: https://sentry.ceph.com/organizations/ceph/?query=278ae928f48349a088608b1e89600eca

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377030]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}}
-----------------------------------------------------------------
time:   00:06:21
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377030/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377030/
sentry: https://sentry.ceph.com/organizations/ceph/?query=01eaa0b5fb554358913d2f3a82ac14c0

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377031]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/norstats} wsync/{no}}
-----------------------------------------------------------------
time:   00:03:27
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377031/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377031/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e38defdb21f2480ead0aa40e58670f7a

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377032]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/data-scan}
-----------------------------------------------------------------
time:   00:03:36
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377032/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377032/
sentry: https://sentry.ceph.com/organizations/ceph/?query=039a8a29805f4339813d68bd05e87982

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377033]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/iozone}}
-----------------------------------------------------------------
time:   00:06:21
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377033/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377033/
sentry: https://sentry.ceph.com/organizations/ceph/?query=60fbaf02895f43fab011a88554bb9639

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377034]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse ms_mode/{crc} objectstore-ec/bluestore-comp omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsstress} wsync/{no}}
-----------------------------------------------------------------
time:   00:06:28
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377034/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377034/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dda170f310fe43548bc60606547a70a2

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377035]  fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
-----------------------------------------------------------------
time:   00:02:59
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377035/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377035/
sentry: https://sentry.ceph.com/organizations/ceph/?query=42227f0690234f50800e0d34989db21f

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377036]  fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc}
-----------------------------------------------------------------
time:   00:03:50
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377036/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377036/
sentry: https://sentry.ceph.com/organizations/ceph/?query=56d5c66e6eb44b43b3225b206dbace1d

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377037]  fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}}
-----------------------------------------------------------------
time:   00:03:51
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377037/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377037/
sentry: https://sentry.ceph.com/organizations/ceph/?query=811b6ce824d64fd3b54c10bb2e41341e

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377038]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/pjd}}
-----------------------------------------------------------------
time:   00:04:48
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377038/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377038/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1de462d248a84d15a6d6bf466bc982ea

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377040]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/exports}
-----------------------------------------------------------------
time:   00:02:55
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377040/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377040/
sentry: https://sentry.ceph.com/organizations/ceph/?query=775de7337d9c43e3a7ffd49f676de976

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377041]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsync-tester} wsync/{no}}
-----------------------------------------------------------------
time:   00:04:46
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377041/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377041/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a49282ce76c746348b655a88340e17e4

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377042]  fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/ffsb}}
-----------------------------------------------------------------
time:   00:06:20
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377042/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377042/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9301fbbbd5984a3f92c958ff4aadea0c

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377043]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc} wsync/{yes}}
-----------------------------------------------------------------
time:   00:03:29
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377043/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377043/
sentry: https://sentry.ceph.com/organizations/ceph/?query=513c28e11611418597641f8e05e91f28

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377044]  fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   00:06:23
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377044/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377044/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d9a1e6f5028a4830b10495f04f2ab985

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377045]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub}
-----------------------------------------------------------------
time:   00:06:19
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377045/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377045/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d84eab27a2c3425cb46ba087dc8349f5

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377046]  fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   00:02:53
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377046/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377046/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b9968ce85d2d4af79c77219334b9d78a

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377047]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   00:03:15
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377047/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377047/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3ffa8d3e6d664017a38d85350d95a1f0

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377048]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse ms_mode/{secure} objectstore-ec/bluestore-comp omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{yes}}
-----------------------------------------------------------------
time:   00:04:52
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377048/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377048/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0d0d8cd84da341df803eedc0746ff287

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377049]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/ffsb}}
-----------------------------------------------------------------
time:   00:05:03
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377049/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377049/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cd39d1965d1f49c791229e870fe56862

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377051]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iozone} wsync/{yes}}
-----------------------------------------------------------------
time:   00:06:25
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377051/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377051/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2d33173e25044efe8ec3d833e6e2cd2e

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377052]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/fragment}
-----------------------------------------------------------------
time:   00:04:49
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377052/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377052/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2a53606ecf38401889381423bb95bae9

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377053]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/pjd} wsync/{no}}
-----------------------------------------------------------------
time:   00:04:42
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377053/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377053/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3255476134b3414bb189eb378c1f85f8

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377054]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/fsstress}}
-----------------------------------------------------------------
time:   00:06:20
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377054/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377054/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c1a9ebf620b74015a54a26bed589742a

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377055]  fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
-----------------------------------------------------------------
time:   00:04:49
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377055/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377055/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4a0c6594424f44069e217b148134f5df

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377056]  fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file}
-----------------------------------------------------------------
time:   00:03:31
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377056/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377056/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cc4e081f75be490d81b2bd2b1035ddf0

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377057]  fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth}
-----------------------------------------------------------------
time:   00:03:51
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377057/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377057/
sentry: https://sentry.ceph.com/organizations/ceph/?query=964841dd4c5e4c9e87c76bc719971705

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377058]  fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/dbench validater/valgrind}
-----------------------------------------------------------------
time:   00:03:51
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377058/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377058/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ad5791653b8743ccb1cfddcc7e20abbc

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377059]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/direct_io} wsync/{yes}}
-----------------------------------------------------------------
time:   00:03:29
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377059/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377059/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6edbf582ad184e2eb16879e60baa4978

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377061]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair}
-----------------------------------------------------------------
time:   00:03:24
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377061/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377061/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3767a3284fbe4b38a22786f1b24f70af

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377062]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}}
-----------------------------------------------------------------
time:   00:05:03
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377062/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377062/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4c11d2cff26f400d841693865dc76791

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377063]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/iozone}}
-----------------------------------------------------------------
time:   00:03:19
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377063/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377063/
sentry: https://sentry.ceph.com/organizations/ceph/?query=db8a398fd515427f8df88c408088eafd

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377064]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{yes}}
-----------------------------------------------------------------
time:   00:06:26
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377064/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377064/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d8bafad908f64273990a2c6ba81eab57

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377065]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush}
-----------------------------------------------------------------
time:   00:04:47
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377065/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377065/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b42dac82a69041fa9b01ae96f5ec4f3c

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377066]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{yes}}
-----------------------------------------------------------------
time:   00:04:47
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377066/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377066/
sentry: https://sentry.ceph.com/organizations/ceph/?query=df58a372bbc948c4accaf29fe80f75bd

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377067]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/pjd}}
-----------------------------------------------------------------
time:   00:04:48
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377067/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377067/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b83f2daa5293488b8219b5be11fd41a4

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377069]  fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/iozone}}
-----------------------------------------------------------------
time:   00:04:49
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377069/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377069/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7c2754026e3c40428e12c26704576e32

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377070]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full}
-----------------------------------------------------------------
time:   00:06:19
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377070/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377070/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c8465ae243c54847b4a06cfc0be3c09e

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377071]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{yes}}
-----------------------------------------------------------------
time:   00:04:02
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377071/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377071/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9f0684c49cac48a2b93b8cc4786c94cb

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377072]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   00:06:25
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377072/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377072/
sentry: https://sentry.ceph.com/organizations/ceph/?query=eff63aafb01b47f9af5adf1f2c7d7c25

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377073]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/norstats} wsync/{no}}
-----------------------------------------------------------------
time:   00:06:27
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377073/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377073/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2948292dcb6e46e8b2dc458136a1d969

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377075]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds_creation_retry}
-----------------------------------------------------------------
time:   00:04:49
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377075/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377075/
sentry: https://sentry.ceph.com/organizations/ceph/?query=11cbb28128c244709e182370078ac2d2

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377076]  fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/ino_release_cb}
-----------------------------------------------------------------
time:   00:02:53
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377076/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377076/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f1c014272ccc4a669a0edf98cdfa09d7

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377077]  fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
-----------------------------------------------------------------
time:   00:02:51
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377077/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377077/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7d0058e52abc49b19a4c620147686dfb

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377078]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsstress} wsync/{yes}}
-----------------------------------------------------------------
time:   00:04:38
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377078/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377078/
sentry: https://sentry.ceph.com/organizations/ceph/?query=081fc08d07d74ca09b4df39d5ea59317

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377079]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/ffsb}}
-----------------------------------------------------------------
time:   00:04:53
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377079/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377079/
sentry: https://sentry.ceph.com/organizations/ceph/?query=532ef473eb6d4d2ba95a65492addb245

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377081]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/fsstress}}
-----------------------------------------------------------------
time:   00:03:15
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377081/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377081/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4224a6bbf4d241559c5401f53c892600

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377082]  fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
-----------------------------------------------------------------
time:   00:06:21
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377082/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377082/
sentry: https://sentry.ceph.com/organizations/ceph/?query=31ec452b473144a0bcbec9e8fd053314

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377083]  fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc}
-----------------------------------------------------------------
time:   00:02:54
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377083/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377083/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2994869465eb4176bc8883281aa58203

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377084]  fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/clone}}
-----------------------------------------------------------------
time:   00:06:19
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377084/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377084/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8079cd1662e749ed8a152dc2ae47c825

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377085]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsync-tester} wsync/{yes}}
-----------------------------------------------------------------
time:   00:04:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377085/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377085/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2d483b2baad7424eb8551f8089244524

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377086]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/metrics}
-----------------------------------------------------------------
time:   00:03:25
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377086/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377086/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c7e87f69782f4f7aa01bf0b058fa7f3d

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377087]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}}
-----------------------------------------------------------------
time:   00:04:52
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377087/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377087/
sentry: https://sentry.ceph.com/organizations/ceph/?query=056eaa45032249149b2417ff93835eb7

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377089]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc} wsync/{no}}
-----------------------------------------------------------------
time:   00:06:24
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377089/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377089/
sentry: https://sentry.ceph.com/organizations/ceph/?query=03fc88358d1648c5ad4b6060d7061730

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377090]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{yes}}
-----------------------------------------------------------------
time:   00:04:42
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377090/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377090/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9c1d4f94ef7a417491f645ce13238b24

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377091]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/multimds_misc}
-----------------------------------------------------------------
time:   00:04:48
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377091/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377091/
sentry: https://sentry.ceph.com/organizations/ceph/?query=67a937bffebd4d4abe117e269ddecb8e

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377093]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iozone} wsync/{yes}}
-----------------------------------------------------------------
time:   00:03:26
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377093/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377093/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8acc66f704414f3f88374e6814ef0c9e

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377094]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/pjd}}
-----------------------------------------------------------------
time:   00:04:35
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377094/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377094/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9f1e2663ba824222833f33eb941bf086

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377096]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/openfiletable}
-----------------------------------------------------------------
time:   00:06:20
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377096/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377096/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f9a91c5493d74d468b6de861ae95e6e4

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377097]  fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone}
-----------------------------------------------------------------
time:   00:03:33
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377097/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377097/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b3b227707d3046adbd2a664d15b5e35a

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377099]  fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth}
-----------------------------------------------------------------
time:   00:02:52
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377099/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377099/
sentry: https://sentry.ceph.com/organizations/ceph/?query=eed8454806ce49f9b93651ec8081ad0e

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377100]  fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}}
-----------------------------------------------------------------
time:   00:04:45
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377100/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377100/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bc24aaef50d9403bb82121932db349d9

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377101]  fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/fsstress validater/lockdep}
-----------------------------------------------------------------
time:   00:04:40
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377101/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377101/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b2ac0ab6f748470893d7ee9b6b7197c8

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377103]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}}
-----------------------------------------------------------------
time:   00:06:23
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377103/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377103/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2ea98b086f8241e18e520d96552e369c

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377104]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   00:04:39
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377104/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377104/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b06f52f82e7e47809a9c07d8b9bf69a4

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377105]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/pool-perm}
-----------------------------------------------------------------
time:   00:04:45
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377105/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377105/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ebc0a9ba78bc4e1a9ba012129d81f8f2

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377106]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{yes}}
-----------------------------------------------------------------
time:   00:07:54
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377106/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377106/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5aa709e57a58489fab2c72c459725f7c

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377107]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/ffsb}}
-----------------------------------------------------------------
time:   00:03:17
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377107/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377107/
sentry: https://sentry.ceph.com/organizations/ceph/?query=61f33ab5a1e54d4b9a280acf984454fc

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377108]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{no}}
-----------------------------------------------------------------
time:   00:03:24
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377108/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377108/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d01760b414ff484aa24d625b09096052

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377109]  fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   00:03:44
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377109/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377109/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0e05d392bd574840ad9c61de52faeab6

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377110]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/quota}
-----------------------------------------------------------------
time:   00:03:23
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377110/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377110/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3eca8b7ebad54c0687f55fcd8339aa2f

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377111]  fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   00:03:47
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377111/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377111/
sentry: https://sentry.ceph.com/organizations/ceph/?query=47796f7d5db6467c8c026025c362d6c4

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377112]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/fsstress}}
-----------------------------------------------------------------
time:   00:03:54
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377112/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377112/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5406b65952f34076ad485d72d0275539

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377115]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}}
-----------------------------------------------------------------
time:   00:06:18
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377115/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377115/
sentry: https://sentry.ceph.com/organizations/ceph/?query=43f40bd656ee46e5b9e88e23d45c0646

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377116]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/scrub}
-----------------------------------------------------------------
time:   00:06:14
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377116/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377116/
sentry: https://sentry.ceph.com/organizations/ceph/?query=609ce7cb269a409f87110878822a2e37

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377118]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/iozone}}
-----------------------------------------------------------------
time:   00:04:55
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377118/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377118/
sentry: https://sentry.ceph.com/organizations/ceph/?query=11a5c6113afe46108bf3d9856ad75154

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377120]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/sessionmap}
-----------------------------------------------------------------
time:   00:06:16
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377120/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377120/
sentry: https://sentry.ceph.com/organizations/ceph/?query=933664b588c641c1a874c1d3351a5ced

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377121]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/pjd}}
-----------------------------------------------------------------
time:   00:03:15
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377121/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377121/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8a037cb6a44b42a992f2646f081440d8

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377123]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsx} wsync/{yes}}
-----------------------------------------------------------------
time:   00:04:46
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377123/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377123/
sentry: https://sentry.ceph.com/organizations/ceph/?query=68ad8d05b3304df28211f355a7a8c09b

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377124]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsync-tester} wsync/{no}}
-----------------------------------------------------------------
time:   00:06:21
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377124/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377124/
sentry: https://sentry.ceph.com/organizations/ceph/?query=90916db9da544c57ab922b4caa78c9b3

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377125]  fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}}
-----------------------------------------------------------------
time:   00:03:19
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377125/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377125/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f799721d644649838537917684f17cf3

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377126]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:04:49
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377126/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377126/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a03786f1696948ad8c0c341cd6b38396

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377127]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc} wsync/{yes}}
-----------------------------------------------------------------
time:   00:04:43
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377127/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377127/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2970456956b64814aec848f658f0030f

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377128]  fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
-----------------------------------------------------------------
time:   00:04:36
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377128/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377128/
sentry: https://sentry.ceph.com/organizations/ceph/?query=40eb108762ad48a1bcceb086e2eb2e0c

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377129]  fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc}
-----------------------------------------------------------------
time:   00:02:47
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377129/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377129/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8de880b6f7644c4cbe3f7ea53a287c59

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377130]  fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/misc}}
-----------------------------------------------------------------
time:   00:04:46
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377130/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377130/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a685aeffd3c0475b9671cbccf14b85f8

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377131]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   00:04:51
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377131/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377131/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d947c2f161e841e1b2d2cfa470709a6f

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377133]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snapshots}
-----------------------------------------------------------------
time:   00:03:22
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377133/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377133/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5d285987dfaf4c66a78ef2f84a09904f

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377134]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/ffsb}}
-----------------------------------------------------------------
time:   00:06:16
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377134/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377134/
sentry: https://sentry.ceph.com/organizations/ceph/?query=05b61474909146f88529f11443ee20a0

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377135]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iozone} wsync/{yes}}
-----------------------------------------------------------------
time:   00:06:23
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377135/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377135/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0e661c8d67a643a88cee0cb724d3345e

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377136]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/pjd} wsync/{no}}
-----------------------------------------------------------------
time:   00:07:49
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377136/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377136/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d6b9081bfb6840678cf5d4a9b219c68f

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377137]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/fsstress}}
-----------------------------------------------------------------
time:   00:05:45
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377137/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377137/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3504e08795084804b578164bfe870ad4

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377138]  fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   00:04:54
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377138/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377138/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bf95afb595004d898b2d392525122878

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377139]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/strays}
-----------------------------------------------------------------
time:   00:07:26
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377139/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377139/
sentry: https://sentry.ceph.com/organizations/ceph/?query=444331eedf0d4ee78c4e5738d91827d0

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377140]  fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs}
-----------------------------------------------------------------
time:   00:04:40
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377140/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377140/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a3ce16fbc80d4e958bd1f1cb88fcb2ca

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377141]  fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
-----------------------------------------------------------------
time:   00:07:29
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377141/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377141/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8a5fedcceeb94b8ab7f54de92fc5912c

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377143]  fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover}
-----------------------------------------------------------------
time:   00:06:18
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377143/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377143/
sentry: https://sentry.ceph.com/organizations/ceph/?query=76527652e2ea4b2fa51019e18d3532b3

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377144]  fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   00:04:51
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377144/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377144/
sentry: https://sentry.ceph.com/organizations/ceph/?query=69f8189e394146258ab016f3a048c053

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377145]  fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/dbench validater/valgrind}
-----------------------------------------------------------------
time:   00:02:50
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377145/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377145/
sentry: https://sentry.ceph.com/organizations/ceph/?query=69284643caac45afbde6c696fe574355

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377146]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/direct_io} wsync/{yes}}
-----------------------------------------------------------------
time:   00:04:39
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377146/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377146/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4b69e2b646544d35bd261cc92bf99200

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377147]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}}
-----------------------------------------------------------------
time:   00:03:15
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377147/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377147/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a6da21df432d45108072f2501cd0eb51

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377149]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/iozone}}
-----------------------------------------------------------------
time:   00:04:49
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377149/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377149/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c2598626dc484b3090ac76fa682d3893

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377150]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{no}}
-----------------------------------------------------------------
time:   00:03:04
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377150/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377150/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9931d17b9532494282ff9fba619fbb61

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377151]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/test_journal_migration}
-----------------------------------------------------------------
time:   00:06:19
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377151/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377151/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4c2d3546a44d403cb6a36804b6c90644

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377152]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{yes}}
-----------------------------------------------------------------
time:   00:06:24
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377152/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377152/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b78717f7baf145d8be30b1a2cc98fa32

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377153]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/pjd}}
-----------------------------------------------------------------
time:   00:06:23
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377153/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377153/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3f5fb68b7d4043288d6584846c932216

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377154]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{no}}
-----------------------------------------------------------------
time:   00:04:40
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377154/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377154/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e968404da13645cb85fb7537678a7c05

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377155]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/truncate_delay}
-----------------------------------------------------------------
time:   00:04:45
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377155/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377155/
sentry: https://sentry.ceph.com/organizations/ceph/?query=318fb20108b8420ab25f1f13a34a8e11

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377156]  fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}}
-----------------------------------------------------------------
time:   00:04:55
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377156/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377156/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3045c8ee2f264d03b832fb45ccf524c0

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377158]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   00:04:40
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377158/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377158/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a4c084c203b94849bee3f4f53185ccd0

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377159]  fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}}
-----------------------------------------------------------------
time:   00:14:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377159/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377159/
sentry: https://sentry.ceph.com/organizations/ceph/?query=679e585131de456aa8f5dcceb9915a97

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377160]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/norstats} wsync/{no}}
-----------------------------------------------------------------
time:   00:03:54
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377160/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377160/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1d6f29e5ddc643bc946baaf1c224cba6

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377162]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsstress} wsync/{yes}}
-----------------------------------------------------------------
time:   00:06:21
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377162/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377162/
sentry: https://sentry.ceph.com/organizations/ceph/?query=65e490627d4a4915b06f0a85021046dd

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377164]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsx} wsync/{yes}}
-----------------------------------------------------------------
time:   00:04:41
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377164/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377164/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2497287160324e7eb71e430c3e0f3ae1

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377165]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/acls}
-----------------------------------------------------------------
time:   00:03:22
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377165/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377165/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f59706ff69df4a1e8683f0fa519a68da

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377166]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/fsstress}}
-----------------------------------------------------------------
time:   00:04:51
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377166/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377166/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a5d88fb3c27d43209abb8b9e51735863

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377168]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}}
-----------------------------------------------------------------
time:   00:06:55
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377168/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377168/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a8e46c9cc0df4b1fa46cc5cec6196372

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377169]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc} wsync/{no}}
-----------------------------------------------------------------
time:   00:04:51
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377169/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377169/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dcea2bcf6c8f49cd93308bd536309813

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377170]  fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:02:47
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377170/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377170/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5194db7a212048c78a185fcd32f03aea

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377172]  fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
-----------------------------------------------------------------
time:   00:04:43
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377172/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377172/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2cc51f18d3c340cdab46f3ace42edf43

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377173]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{yes}}
-----------------------------------------------------------------
time:   00:06:21
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377173/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377173/
sentry: https://sentry.ceph.com/organizations/ceph/?query=75dc47794bf243308d7ace496bb6f82d

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377174]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/iozone}}
-----------------------------------------------------------------
time:   00:05:11
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377174/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377174/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5b184712771945c397f58afb87e2bef1

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377175]  fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
-----------------------------------------------------------------
time:   00:03:11
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377175/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377175/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9a5ee3f6d309448eb31491323768f1a6

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377176]  fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc}
-----------------------------------------------------------------
time:   00:02:44
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377176/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377176/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fd6430f45cbf4943a7a63985e2d1b6eb

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377178]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iozone} wsync/{yes}}
-----------------------------------------------------------------
time:   00:10:22
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377178/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377178/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ff055e056e334be7ac238edf8e0b574e

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377181]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/pjd} wsync/{yes}}
-----------------------------------------------------------------
time:   00:03:19
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377181/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377181/
sentry: https://sentry.ceph.com/organizations/ceph/?query=de9ae217fad74c47b4cd0758c6ad7bc3

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377182]  fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone}
-----------------------------------------------------------------
time:   00:04:53
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377182/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377182/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a25ac1ad513641d4a089da87a5e8edb7

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377184]  fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth}
-----------------------------------------------------------------
time:   00:04:42
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377184/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377184/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0d8f3427e1a14721bd5b6e14b3f69c58

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377186]  fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/fsstress validater/lockdep}
-----------------------------------------------------------------
time:   00:08:04
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377186/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377186/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8c6a91236c904ed0b921c83ffd8c62d2

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377188]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/asok_dump_tree}
-----------------------------------------------------------------
time:   00:04:43
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377188/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377188/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b12128c84e19488a91b05fd220fc3066

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377190]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   00:03:42
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377190/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377190/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ab836bf9d6eb4de8ba8f82c66430bbae

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377192]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/ffsb}}
-----------------------------------------------------------------
time:   00:06:14
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377192/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377192/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a55ad0df2dd04f318a48da94820c801f

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377193]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair}
-----------------------------------------------------------------
time:   00:03:25
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377193/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377193/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c6fa0be98a7b44d295a4fe34f7b55116

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377195]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/fsstress}}
-----------------------------------------------------------------
time:   00:04:34
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377195/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377195/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6d6e8d011f2c4c71acf16f21ca916822

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377198]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/backtrace}
-----------------------------------------------------------------
time:   00:02:54
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377198/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377198/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7f39910826744ba785f54a23bbc5f5a5

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377199]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{no}}
-----------------------------------------------------------------
time:   00:06:29
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377199/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377199/
sentry: https://sentry.ceph.com/organizations/ceph/?query=40eefc09de0b4254b410d28190204fd1

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377200]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}}
-----------------------------------------------------------------
time:   00:03:17
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377200/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377200/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fc252e181d804159bb09e173d9a6d19b

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377201]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/norstats} wsync/{no}}
-----------------------------------------------------------------
time:   00:04:49
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377201/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377201/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5d865714e2274e19bad33cf5aa864295

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377202]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/iozone}}
-----------------------------------------------------------------
time:   00:02:55
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377202/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377202/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d899edb3b9524792ae84de76385b1c8d

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377203]  fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   00:02:56
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377203/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377203/
sentry: https://sentry.ceph.com/organizations/ceph/?query=110086d61fcb4647a9e105cc0ac69816

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377204]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cap-flush}
-----------------------------------------------------------------
time:   00:06:23
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377204/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377204/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0b441cb991684167bab2bffea8825326

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377205]  fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs_python}
-----------------------------------------------------------------
time:   00:06:22
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377205/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377205/
sentry: https://sentry.ceph.com/organizations/ceph/?query=22201732d8824e4cb2498d06b48428ac

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377206]  fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   00:04:55
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377206/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377206/
sentry: https://sentry.ceph.com/organizations/ceph/?query=361e7e28acb74b3da849e6e4b8ea7d6f

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377207]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsstress} wsync/{no}}
-----------------------------------------------------------------
time:   00:03:25
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377207/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377207/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c6f5da686fe3440b8e96d570c71744a1

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377208]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/pjd}}
-----------------------------------------------------------------
time:   00:06:28
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377208/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377208/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a5eaa4bf365e4a04a47f943a34e0f854

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377209]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsx} wsync/{yes}}
-----------------------------------------------------------------
time:   00:04:58
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377209/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377209/
sentry: https://sentry.ceph.com/organizations/ceph/?query=68dbc253618a4f4ca9a0048e63e78c86

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377210]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsync-tester} wsync/{no}}
-----------------------------------------------------------------
time:   00:06:27
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377210/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377210/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4211be789ad14a8c90e45020dc1ca1ba

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377211]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-limits}
-----------------------------------------------------------------
time:   00:04:49
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377211/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377211/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ff6f9e968196494daf0234eeb591bf7b

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377212]  fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/ffsb}}
-----------------------------------------------------------------
time:   00:04:56
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377212/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377212/
sentry: https://sentry.ceph.com/organizations/ceph/?query=affe6d8923944cf9beeedf722ae87c99

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377213]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc} wsync/{no}}
-----------------------------------------------------------------
time:   00:04:42
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377213/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377213/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9860558db0114692991262698c5714f8

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377214]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   00:04:43
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377214/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377214/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c4d4ebe8683143e793a31379e72a45f6

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377215]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{no}}
-----------------------------------------------------------------
time:   00:03:31
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377215/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377215/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5abba62cc6bd467e9e581fef3c639d17

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377216]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-readahead}
-----------------------------------------------------------------
time:   00:03:27
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377216/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377216/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4676613c649948e59aae8a7f8cebee1b

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377217]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/ffsb}}
-----------------------------------------------------------------
time:   00:03:21
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377217/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377217/
sentry: https://sentry.ceph.com/organizations/ceph/?query=76e5ce39b5bb4f8d947b000995e0c7d3

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377218]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse ms_mode/{crc} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iozone} wsync/{no}}
-----------------------------------------------------------------
time:   00:03:06
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377218/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377218/
sentry: https://sentry.ceph.com/organizations/ceph/?query=49f3543411d942ccad8afb44c04bc81b

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377219]  fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
-----------------------------------------------------------------
time:   00:03:16
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377219/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377219/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a948c14ee933415e88952db4dd236beb

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377220]  fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc}
-----------------------------------------------------------------
time:   00:02:53
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377220/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377220/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bc1b2cecc2a544319853e7ee3beafd44

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377221]  fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}}
-----------------------------------------------------------------
time:   00:03:24
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377221/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377221/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fd9733bd39d74514b99c2b0fb669253e

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377222]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/pjd} wsync/{yes}}
-----------------------------------------------------------------
time:   00:06:23
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377222/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377222/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fa45006d89064ec1b57c50dbaee7ace8

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377223]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery}
-----------------------------------------------------------------
time:   00:02:48
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377223/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377223/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d80a8bb9c349436a9a58b49dd4e4c84f

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377224]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/fsstress}}
-----------------------------------------------------------------
time:   00:06:17
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377224/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377224/
sentry: https://sentry.ceph.com/organizations/ceph/?query=140d5b84acd14d4f85109c354dea20eb

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377225]  fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
-----------------------------------------------------------------
time:   00:03:20
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377225/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377225/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dc5287530d224bfa8b452109ad319252

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377226]  fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/mdtest}
-----------------------------------------------------------------
time:   00:03:24
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377226/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377226/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4eff46d702904af38f1bd326f8828941

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377227]  fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover}
-----------------------------------------------------------------
time:   00:03:23
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377227/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377227/
sentry: https://sentry.ceph.com/organizations/ceph/?query=aba2eb5c72c24960b25dad8c89db2faf

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377228]  fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/dbench validater/valgrind}
-----------------------------------------------------------------
time:   00:02:49
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377228/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377228/
sentry: https://sentry.ceph.com/organizations/ceph/?query=aaee45717a554405999c4bd1037ae159

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377229]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/direct_io} wsync/{no}}
-----------------------------------------------------------------
time:   00:04:38
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377229/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377229/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6bb853f4bd584d6f82c3c9200e77d73e

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377230]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}}
-----------------------------------------------------------------
time:   00:06:22
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377230/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377230/
sentry: https://sentry.ceph.com/organizations/ceph/?query=827d58e84bde4083859abace65eeb694

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377231]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}}
-----------------------------------------------------------------
time:   00:03:21
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377231/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377231/
sentry: https://sentry.ceph.com/organizations/ceph/?query=788eef42599c43bd8f79120aa9d4da12

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377232]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/damage}
-----------------------------------------------------------------
time:   00:06:19
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377232/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377232/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3fe4de2443d94df1b255731aa46cdadf

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377233]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/iozone}}
-----------------------------------------------------------------
time:   00:05:21
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377233/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377233/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bacb0a75b0424ba2ba30072ff766f134

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377234]  fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}}
-----------------------------------------------------------------
time:   00:16:07
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377234/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377234/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3bd0d4358aee434896a857ca6d1ae11a

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377235]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{yes}}
-----------------------------------------------------------------
time:   00:07:41
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377235/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377235/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e2d244ea7a9f48feb99584dc7b881fc9

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377236]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{no}}
-----------------------------------------------------------------
time:   00:07:19
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377236/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377236/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8c894f51a54e40c19464243b444ad0a6

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377237]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/pjd}}
-----------------------------------------------------------------
time:   00:03:17
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377237/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377237/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8024036593324b26b758c77a3b1b452b

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377238]  fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:04:42
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377238/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377238/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2747a302ddde41b4941b431ea417dee6

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377239]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/data-scan}
-----------------------------------------------------------------
time:   00:04:42
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377239/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377239/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2d2716a68df949e3951ba6260a809ec2

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377240]  fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
-----------------------------------------------------------------
time:   00:06:21
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377240/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377240/
sentry: https://sentry.ceph.com/organizations/ceph/?query=25f0db7a6c8b48cab0a7f2d41c54646f

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377241]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{no}}
-----------------------------------------------------------------
time:   00:05:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377241/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377241/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d44b083b8f9e4f1f82a1eb2a940f8f45

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377242]  fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/iozone}}
-----------------------------------------------------------------
time:   00:03:23
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377242/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377242/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7ca8d5fd5d7d414f9e892a232858407a

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377243]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{no}}
-----------------------------------------------------------------
time:   00:03:27
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377243/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377243/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4340b1393f874edd96901041d206d2e5

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377244]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/exports}
-----------------------------------------------------------------
time:   00:03:43
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377244/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377244/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ce64819c4d4d4cec951e3db8313cab27

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1
    =ca906d0d7a65c8a598d397b764dd262cce645fe3

[6377245]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   00:06:45
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377245/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377245/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bd35d1be418d4e49a218e5b7ec148c55

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3

[6377246]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse ms_mode/{legacy} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/norstats} wsync/{yes}}
-----------------------------------------------------------------
time:   00:05:18
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377246/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377246/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dbdc1459358c44e1a519ee4474571daf

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ca9
    06d0d7a65c8a598d397b764dd262cce645fe3



Dead
=================================================================
[6376993]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cap-flush}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376993/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6376993/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377010]  fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377010/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377010/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377025]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse ms_mode/{secure} objectstore-ec/bluestore-comp omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{yes}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377025/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377025/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377039]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsx} wsync/{yes}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377039/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377039/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377050]  fs/upgrade/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-upgrade}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377050/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377050/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377060]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377060/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377060/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377068]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{yes}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377068/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377068/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377074]  fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377074/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377074/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377080]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsx} wsync/{yes}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377080/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377080/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377088]  fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377088/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377088/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377092]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/iozone}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377092/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377092/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377095]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/pjd} wsync/{no}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377095/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377095/

    Error reimaging machines: Failed to power on gibba028

[6377098]  fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/mdtest}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377098/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377098/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377102]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse ms_mode/{legacy} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/direct_io} wsync/{no}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377102/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377102/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377113]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse ms_mode/{legacy} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{no}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377113/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377113/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377114]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{yes}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377114/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377114/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377117]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/norstats} wsync/{no}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377117/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377117/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377119]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsstress} wsync/{no}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377119/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377119/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377122]  fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377122/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377122/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377132]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{yes}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377132/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377132/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377142]  fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377142/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377142/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377148]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377148/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377148/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377157]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{no}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377157/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377157/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377161]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/workunit/quota}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377161/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377161/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377163]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/ffsb}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377163/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377163/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377167]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsync-tester} wsync/{yes}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377167/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377167/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377171]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/admin}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377171/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377171/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377177]  fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/snapshot}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377177/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377177/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377179]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/alternate-pool}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377179/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377179/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377180]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/pjd}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377180/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377180/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377183]  fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377183/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377183/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377185]  fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377185/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377185/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377187]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse ms_mode/{crc} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/direct_io} wsync/{yes}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377187/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377187/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377189]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377189/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377189/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377191]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{yes}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377191/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377191/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377194]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{yes}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377194/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377194/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377196]  fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377196/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377196/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6377197]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse ms_mode/{crc} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{no}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377197/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-07_03:15:03-fs-master-distro-basic-gibba/6377197/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds