2020-12-03T15:54:24.664 INFO:root:teuthology version: 1.0.0-e6b33b7b
2020-12-03T15:54:24.666 INFO:teuthology.results:seed: '1377'
2020-12-03T21:12:00.162 INFO:root:teuthology version: 1.0.0-e6b33b7b
2020-12-03T21:12:00.208 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-12-03T23:05:02.610 INFO:teuthology.results:Tests finished! gathering results...
2020-12-03T23:05:13.420 INFO:scrape:Found 100 jobs
2020-12-03T23:05:14.870 INFO:scrape:Found 4 distinct failure reasons
2020-12-03T23:05:14.871 INFO:scrape:Failure: Test failure: test_damaged_dentry (tasks.cephfs.test_damage.TestDamage)
2020-12-03T23:05:14.871 INFO:scrape:1 jobs: ['5677395']
2020-12-03T23:05:14.872 INFO:scrape:suites: ['clusters/1-mds-4-client-coloc', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'tasks/damage}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-12-03T23:05:14.872 INFO:scrape:
2020-12-03T23:05:14.873 INFO:scrape:Timeout 120 running ceph --cluster ceph pg dump --format=json
2020-12-03T23:05:14.873 INFO:scrape:1 jobs: ['5677325']
2020-12-03T23:05:14.873 INFO:scrape:suites: ['2-workunit/cfuse_workunit_suites_fsstress}}', 'clusters/1-mds-1-client-coloc', 'conf/{client', 'distro/{centos_8}', 'fs/thrash/workloads/{begin', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag_enable', 'rhel_8}', 'session_timeout', 'tasks/{1-thrash/mon', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-12-03T23:05:14.874 INFO:scrape:
2020-12-03T23:05:14.874 INFO:scrape:Failure: reached maximum tries (60) after waiting for 900 seconds
2020-12-03T23:05:14.875 INFO:scrape:1 jobs: ['5677340']
2020-12-03T23:05:14.875 INFO:scrape:
2020-12-03T23:05:14.876 INFO:scrape:Failure: Test failure: test_dispatch_queue_throttle (tasks.cephfs.test_misc.TestMisc)
2020-12-03T23:05:14.876 INFO:scrape:1 jobs: ['5677312']
2020-12-03T23:05:14.877 INFO:scrape:suites: ['clusters/1-mds-2-client', 'conf/{client', 'distros/ubuntu_latest', 'fs/multiclient/{begin', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/cephfs_misc_tests}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-12-03T23:05:14.877 INFO:scrape:
2020-12-03T23:05:14.881 INFO:teuthology.results:Sending results to jcollin@redhat.com: Test Run: jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/
failed:  3
dead:    1
running: 0
waiting: 0
queued:  0
passed:  96


Fail
=================================================================
[5677312]  fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}
-----------------------------------------------------------------
time:   00:13:42
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677312/
log:    http://qa-proxy.ceph.com/teuthology/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677312/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ae40753dfdfd49f8b4d672ec296fb5f7

    Test failure: test_dispatch_queue_throttle
    (tasks.cephfs.test_misc.TestMisc)

[5677325]  fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}}
-----------------------------------------------------------------
time:   00:20:21
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677325/
log:    http://qa-proxy.ceph.com/teuthology/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677325/

    Command failed on smithi171 with status 124: 'sudo adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster
    ceph pg dump --format=json'

[5677395]  fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/damage}
-----------------------------------------------------------------
time:   00:09:41
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677395/
log:    http://qa-proxy.ceph.com/teuthology/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677395/
sentry: https://sentry.ceph.com/organizations/ceph/?query=88e83dd89b6541fb8dd015b5894c7ba9

    Test failure: test_damaged_dentry (tasks.cephfs.test_damage.TestDamage)



Dead
=================================================================
[5677340]  fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677340/
log:    http://qa-proxy.ceph.com/teuthology/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677340/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2625e976df4a45eaaaf2d858416a4807

    reached maximum tries (60) after waiting for 900 seconds



Pass
=================================================================
[5677307] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:11:15
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677307/

[5677308] fs/bugs/client_trim_caps/{begin clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/trim-i22073}
time:   00:07:28
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677308/

[5677309] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/acls}
time:   00:08:28
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677309/

[5677310] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs}
time:   00:10:27
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677310/

[5677311] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   01:31:46
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677311/

[5677313] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover}
time:   00:40:40
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677313/

[5677314] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:08:22
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677314/

[5677315] fs/shell/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cephfs-shell}
time:   00:27:39
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677315/

[5677316] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
time:   00:53:22
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677316/

[5677317] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}}
time:   02:55:26
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677317/

[5677318] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc}
time:   00:18:26
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677318/

[5677319] fs/upgrade/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/no}}
time:   00:30:55
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677319/

[5677320] fs/verify/{begin centos_latest clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:26:56
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677320/

[5677321] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volume-client}
time:   00:24:08
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677321/

[5677322] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/direct_io}
time:   00:10:16
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677322/

[5677323] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}}
time:   01:04:15
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677323/

[5677324] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/fs/misc}
time:   00:27:22
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677324/

[5677326] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/kernel_untar_build}
time:   00:34:37
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677326/

[5677327] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/cfuse_workunit_suites_pjd}}
time:   00:11:28
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677327/

[5677328] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/admin}
time:   00:20:40
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677328/

[5677329] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}}
time:   00:08:10
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677329/

[5677330] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/blogbench}
time:   00:21:24
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677330/

[5677331] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/filestore-xfs overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/ffsb}}
time:   00:24:09
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677331/

[5677332] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/filestore-xfs omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/dbench}
time:   00:42:50
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677332/

[5677333] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/iozone}}
time:   00:09:54
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677333/

[5677334] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/cfuse_workunit_snaptests}}
time:   01:10:11
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677334/

[5677335] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/alternate-pool}
time:   00:10:21
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677335/

[5677336] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/ffsb}
time:   00:24:05
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677336/

[5677337] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}}
time:   00:19:10
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677337/

[5677338] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/fs/norstats}
time:   00:11:09
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677338/

[5677339] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}}
time:   00:20:00
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677339/

[5677341] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/fsstress}
time:   00:12:57
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677341/

[5677342] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/asok_dump_tree}
time:   00:19:57
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677342/

[5677343] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/cfuse_workunit_trivial_sync}}
time:   00:07:42
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677343/

[5677344] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/fsx}
time:   00:25:27
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677344/

[5677345] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/ffsb}}
time:   00:25:52
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677345/

[5677346] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/iozone}}
time:   00:16:51
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677346/

[5677347] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/fsync-tester}
time:   00:08:27
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677347/

[5677348] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}}
time:   00:57:33
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677348/

[5677349] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair}
time:   00:08:42
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677349/

[5677350] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/fs/test_o_trunc}
time:   00:19:18
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677350/

[5677351] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/cfuse_workunit_suites_fsstress}}
time:   00:19:40
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677351/

[5677352] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}}
time:   00:10:29
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677352/

[5677353] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/iogen}
time:   00:34:59
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677353/

[5677354] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}}
time:   00:12:48
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677354/

[5677355] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/iozone}
time:   00:12:24
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677355/

[5677356] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}}
time:   00:08:42
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677356/

[5677357] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/backtrace}
time:   00:07:23
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677357/

[5677358] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/pjd}
time:   00:09:36
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677358/

[5677359] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/ffsb}}
time:   00:44:23
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677359/

[5677360] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/iozone}}
time:   00:12:37
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677360/

[5677361] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth}
time:   00:15:54
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677361/

[5677362] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/direct_io}
time:   00:09:09
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677362/

[5677363] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}}
time:   00:59:56
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677363/

[5677364] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cap-flush}
time:   00:10:05
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677364/

[5677365] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/fs/misc}
time:   00:29:25
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677365/

[5677366] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}}
time:   00:15:53
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677366/

[5677367] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/cfuse_workunit_suites_pjd}}
time:   00:09:41
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677367/

[5677368] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/kernel_untar_build}
time:   01:39:33
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677368/

[5677369] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}}
time:   00:07:16
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677369/

[5677370] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/blogbench}
time:   00:19:54
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677370/

[5677371] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/ffsb}}
time:   00:36:11
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677371/

[5677372] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-limits}
time:   00:16:50
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677372/

[5677373] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}}
time:   00:09:45
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677373/

[5677374] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/dbench}
time:   00:46:18
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677374/

[5677375] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/iozone}}
time:   00:12:14
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677375/

[5677376] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
time:   00:41:21
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677376/

[5677377] fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file}
time:   00:07:48
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677377/

[5677378] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/ffsb}
time:   00:22:13
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677378/

[5677379] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/filestore-xfs overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/cfuse_workunit_snaptests}}
time:   01:15:35
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677379/

[5677380] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}}
time:   00:18:01
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677380/

[5677381] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-readahead}
time:   00:07:20
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677381/

[5677382] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/fs/norstats}
time:   00:10:23
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677382/

[5677383] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}}
time:   00:11:20
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677383/

[5677384] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/fsstress}
time:   00:11:21
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677384/

[5677385] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/cfuse_workunit_trivial_sync}}
time:   00:09:27
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677385/

[5677386] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/ffsb}}
time:   00:47:52
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677386/

[5677387] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/fsx}
time:   00:19:52
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677387/

[5677388] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery}
time:   00:24:52
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677388/

[5677389] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/iozone}}
time:   00:16:42
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677389/

[5677390] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/fsync-tester}
time:   00:10:06
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677390/

[5677391] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/ffsb}}
time:   00:45:47
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677391/

[5677392] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/filestore-xfs omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/fs/test_o_trunc}
time:   00:17:37
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677392/

[5677393] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}}
time:   00:53:11
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677393/

[5677394] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/cfuse_workunit_suites_fsstress}}
time:   00:18:38
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677394/

[5677396] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/iogen}
time:   00:57:50
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677396/

[5677397] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}}
time:   00:09:43
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677397/

[5677398] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/iozone}
time:   00:14:18
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677398/

[5677399] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}}
time:   00:08:27
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677399/

[5677400] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/ffsb}}
time:   00:23:26
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677400/

[5677401] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/pjd}
time:   00:11:10
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677401/

[5677402] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/iozone}}
time:   00:12:22
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677402/

[5677403] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/data-scan}
time:   00:25:39
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677403/

[5677404] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover}
time:   00:49:01
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677404/

[5677405] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
time:   00:41:33
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677405/

[5677406] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc}
time:   00:57:51
info:   http://pulpito.ceph.com/jcollin-2020-12-03_09:59:05-fs-wip-F46226-log-dq-throttle-limit-new-distro-basic-smithi/5677406/