2020-10-02T01:07:47.176 INFO:root:teuthology version: 1.0.0-75888fc
2020-10-02T01:07:47.178 INFO:teuthology.results:subset: '1/10'
2020-10-02T01:07:47.178 INFO:teuthology.results:seed: '3167'
2020-10-02T02:04:18.790 INFO:root:teuthology version: 1.0.0-75888fc
2020-10-02T02:04:18.812 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-10-02T07:03:25.064 INFO:teuthology.results:Tests finished! gathering results...
2020-10-02T07:03:32.225 INFO:scrape:Found 64 jobs
2020-10-02T07:03:33.079 INFO:scrape:Found 1 distinct failure reasons
2020-10-02T07:03:33.080 INFO:scrape:Failure: "2020-10-02 03:35:42.069012 mon.a (mon.0) 578 : cluster [WRN] Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST)" in cluster log
2020-10-02T07:03:33.080 INFO:scrape:1 jobs: ['5487482']
2020-10-02T07:03:33.081 INFO:scrape:suites: ['clusters/1-mds-4-client', 'conf/{client', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp-ec-root', 'osd-asserts', 'osd}', 'overrides/{distro/rhel/{k-distro', 'overrides/{frag_enable', 'rhel_latest}', 'tasks/journal-repair}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-10-02T07:03:33.081 INFO:scrape:
2020-10-02T07:03:33.085 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/
failed:  1
dead:    0
running: 0
waiting: 0
queued:  0
passed:  63


Fail
=================================================================
[5487482]  kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair}
-----------------------------------------------------------------
time:   00:21:36
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487482/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487482/

    "2020-10-02 03:35:42.069012 mon.a (mon.0) 578 : cluster [WRN] Health check
    failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST)" in cluster log



Pass
=================================================================
[5487436] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub}
time:   00:16:44
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487436/

[5487437] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_direct_io}
time:   00:12:38
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487437/

[5487438] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   00:49:05
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487438/

[5487439] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/default workloads/kclient_workunit_suites_ffsb}
time:   00:59:29
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487439/

[5487440] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair}
time:   00:21:33
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487440/

[5487441] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_kernel_untar_build}
time:   00:28:49
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487441/

[5487442] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush}
time:   00:12:53
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487442/

[5487443] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_misc}
time:   00:37:23
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487443/

[5487444] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
time:   00:39:51
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487444/

[5487445] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/mds-full}
time:   00:29:56
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487445/

[5487446] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_o_trunc}
time:   00:20:42
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487446/

[5487447] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_snaps}
time:   00:45:23
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487447/

[5487448] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/pool-perm}
time:   00:13:26
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487448/

[5487449] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mds workloads/kclient_workunit_suites_iozone}
time:   00:15:18
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487449/

[5487450] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_dbench}
time:   00:55:11
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487450/

[5487451] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   00:50:10
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487451/

[5487452] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/sessionmap}
time:   00:15:09
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487452/

[5487453] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_ffsb}
time:   00:32:09
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487453/

[5487454] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/strays}
time:   00:27:28
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487454/

[5487455] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsstress}
time:   00:15:29
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487455/

[5487456] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/volume-client}
time:   00:23:54
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487456/

[5487457] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
time:   00:41:06
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487457/

[5487458] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsx}
time:   00:16:54
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487458/

[5487459] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair}
time:   00:14:19
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487459/

[5487460] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mon workloads/kclient_workunit_suites_ffsb}
time:   00:51:32
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487460/

[5487461] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsync}
time:   00:12:14
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487461/

[5487462] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/backtrace}
time:   00:12:47
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487462/

[5487463] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_iozone}
time:   00:17:01
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487463/

[5487464] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   00:41:38
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487464/

[5487465] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/client-limits}
time:   00:19:56
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487465/

[5487466] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_pjd}
time:   00:11:59
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487466/

[5487467] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_trivial_sync}
time:   00:11:13
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487467/

[5487468] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery}
time:   00:44:49
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487468/

[5487469] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_direct_io}
time:   00:11:19
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487469/

[5487470] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
time:   00:28:12
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487470/

[5487471] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/default workloads/kclient_workunit_suites_iozone}
time:   00:17:43
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487471/

[5487472] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/damage}
time:   00:23:17
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487472/

[5487473] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_kernel_untar_build}
time:   00:27:18
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487473/

[5487474] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/data-scan}
time:   00:28:58
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487474/

[5487475] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_misc}
time:   00:34:46
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487475/

[5487476] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   00:59:04
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487476/

[5487477] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/failover}
time:   00:27:23
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487477/

[5487478] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_o_trunc}
time:   00:22:06
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487478/

[5487479] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub}
time:   00:16:01
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487479/

[5487480] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_snaps}
time:   00:52:38
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487480/

[5487481] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mds workloads/kclient_workunit_suites_ffsb}
time:   00:31:10
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487481/

[5487483] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_dbench}
time:   00:42:20
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487483/

[5487484] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
time:   00:28:04
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487484/

[5487485] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_ffsb}
time:   00:28:43
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487485/

[5487486] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush}
time:   00:13:39
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487486/

[5487487] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsstress}
time:   00:15:32
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487487/

[5487488] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/mds-full}
time:   00:29:59
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487488/

[5487489] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   00:54:25
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487489/

[5487490] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsx}
time:   00:18:01
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487490/

[5487491] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/pool-perm}
time:   00:13:08
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487491/

[5487492] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mon workloads/kclient_workunit_suites_iozone}
time:   00:17:15
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487492/

[5487493] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsync}
time:   00:12:04
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487493/

[5487494] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/sessionmap}
time:   00:15:30
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487494/

[5487495] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_iozone}
time:   00:17:11
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487495/

[5487496] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
time:   00:29:15
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487496/

[5487497] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/strays}
time:   00:27:17
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487497/

[5487498] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_pjd}
time:   00:12:09
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487498/

[5487499] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/volume-client}
time:   00:22:48
info:   http://pulpito.ceph.com/yuriw-2020-10-02_01:07:34-kcephfs-wip-yuri3-testing-2020-10-01-1619-nautilus-distro-basic-smithi/5487499/