2021-04-22T11:30:26.530 INFO:root:teuthology version: 1.1.0-2713a3cd 2021-04-22T11:30:26.531 INFO:teuthology.results:subset: '111/120000' 2021-04-22T11:30:26.531 INFO:teuthology.results:seed: '620' 2021-04-22T13:17:17.702 INFO:root:teuthology version: 1.1.0-2713a3cd 2021-04-22T13:17:17.732 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-04-22T13:59:10.939 INFO:teuthology.results:Tests finished! gathering results... 2021-04-22T13:59:15.353 INFO:scrape:Found 49 jobs 2021-04-22T13:59:17.052 INFO:scrape:Found 3 distinct failure reasons 2021-04-22T13:59:17.052 INFO:scrape:Failure: invalid syntax (test_volume_client.py, line 568) 2021-04-22T13:59:17.052 INFO:scrape:1 jobs: ['6062702'] 2021-04-22T13:59:17.053 INFO:scrape:suites: ['clusters/1-mds-4-client', 'conf/{client', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp-ec-root', 'osd-asserts', 'osd}', 'overrides/{distro/rhel/{k-distro', 'overrides/{frag_enable', 'rhel_latest}', 'tasks/volume-client}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-04-22T13:59:17.053 INFO:scrape: 2021-04-22T13:59:17.053 INFO:scrape:Failure: "2021-04-22 12:58:25.359081 mon.a (mon.0) 528 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log 2021-04-22T13:59:17.053 INFO:scrape:1 jobs: ['6062683'] 2021-04-22T13:59:17.053 INFO:scrape:suites: ['clusters/1-mds-1-client', 'conf/{client', 'kcephfs/thrash/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp-ec-root', 'osd-asserts', 'osd}', 'overrides/{distro/rhel/{k-distro', 'overrides/{frag_enable', 'rhel_latest}', 'thrash-health-whitelist', 'thrashers/default', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workloads/kclient_workunit_suites_ffsb}'] 2021-04-22T13:59:17.053 INFO:scrape: 2021-04-22T13:59:17.053 INFO:scrape:Failure: Test failure: test_evicted_caps (tasks.cephfs.test_client_recovery.TestClientRecovery) 2021-04-22T13:59:17.053 INFO:scrape:2 jobs: ['6062636', '6062734'] 2021-04-22T13:59:17.053 INFO:scrape:suites intersection: ['clusters/1-mds-4-client', 'conf/{client', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'osd-asserts', 'osd}', 'overrides/{distro/rhel/{k-distro', 'overrides/{frag_enable', 'rhel_latest}', 'tasks/client-recovery}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-04-22T13:59:17.054 INFO:scrape:suites union: ['clusters/1-mds-4-client', 'conf/{client', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/filestore-xfs', 'osd-asserts', 'osd}', 'overrides/{distro/rhel/{k-distro', 'overrides/{frag_enable', 'rhel_latest}', 'tasks/client-recovery}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-04-22T13:59:17.054 INFO:scrape: 2021-04-22T13:59:17.056 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/ failed: 4 dead: 0 running: 0 waiting: 0 queued: 0 passed: 45 Fail ================================================================= [6062636] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery} ----------------------------------------------------------------- time: 00:31:16 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062636/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062636/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b3b492de532843759bab45dda22ec8cc Test failure: test_evicted_caps (tasks.cephfs.test_client_recovery.TestClientRecovery) [6062683] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/default workloads/kclient_workunit_suites_ffsb} ----------------------------------------------------------------- time: 00:45:38 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062683/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062683/ "2021-04-22 12:58:25.359081 mon.a (mon.0) 528 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log [6062702] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/volume-client} ----------------------------------------------------------------- time: 00:12:11 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062702/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062702/ sentry: https://sentry.ceph.com/organizations/ceph/?query=556724d237d64e0099f1202e1a5011a9 invalid syntax (test_volume_client.py, line 568) [6062734] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery} ----------------------------------------------------------------- time: 00:30:14 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062734/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062734/ sentry: https://sentry.ceph.com/organizations/ceph/?query=43571a3098304f7d9ca72f8cf4047313 Test failure: test_evicted_caps (tasks.cephfs.test_client_recovery.TestClientRecovery) Pass ================================================================= [6062632] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/client-limits} time: 00:19:44 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062632/ [6062634] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_pjd} time: 00:12:06 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062634/ [6062638] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} time: 00:52:35 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062638/ [6062640] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/damage} time: 00:22:55 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062640/ [6062641] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_trivial_sync} time: 00:10:47 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062641/ [6062644] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/data-scan} time: 00:29:51 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062644/ [6062645] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mds workloads/kclient_workunit_suites_ffsb} time: 00:21:53 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062645/ [6062647] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_direct_io} time: 00:10:35 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062647/ [6062649] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 00:30:57 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062649/ [6062651] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/failover} time: 00:27:48 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062651/ [6062653] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_kernel_untar_build} time: 00:29:40 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062653/ [6062655] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub} time: 00:15:31 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062655/ [6062657] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} time: 00:48:10 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062657/ [6062660] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair} time: 00:21:52 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062660/ [6062661] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_misc} time: 00:32:29 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062661/ [6062663] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mon workloads/kclient_workunit_suites_iozone} time: 00:13:09 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062663/ [6062665] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush} time: 00:13:12 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062665/ [6062667] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 00:29:02 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062667/ [6062670] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_o_trunc} time: 00:20:32 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062670/ [6062671] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} time: 00:29:52 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062671/ [6062673] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_snaps} time: 00:50:32 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062673/ [6062678] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/pool-perm} time: 00:14:58 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062678/ [6062681] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} time: 00:45:57 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062681/ [6062688] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/sessionmap} time: 00:14:39 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062688/ [6062691] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_dbench} time: 00:39:36 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062691/ [6062694] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/strays} time: 00:26:26 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062694/ [6062697] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 00:36:17 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062697/ [6062699] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_ffsb} time: 00:31:14 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062699/ [6062704] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mds workloads/kclient_workunit_suites_iozone} time: 00:15:39 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062704/ [6062707] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsstress} time: 00:15:14 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062707/ [6062710] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} time: 00:45:34 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062710/ [6062713] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair} time: 00:14:05 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062713/ [6062716] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsx} time: 00:17:09 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062716/ [6062719] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/backtrace} time: 00:12:51 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062719/ [6062722] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 00:36:14 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062722/ [6062725] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/client-limits} time: 00:20:01 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062725/ [6062728] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsync} time: 00:12:06 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062728/ [6062731] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mon workloads/kclient_workunit_suites_ffsb} time: 00:50:20 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062731/ [6062737] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_iozone} time: 00:16:59 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062737/ [6062740] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} time: 00:39:37 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062740/ [6062743] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/damage} time: 00:22:52 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062743/ [6062746] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_pjd} time: 00:11:49 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062746/ [6062749] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/data-scan} time: 00:28:39 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062749/ [6062752] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 00:31:02 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062752/ [6062755] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/default workloads/kclient_workunit_suites_iozone} time: 00:19:19 info: http://pulpito.ceph.com/yuriw-2021-04-21_16:47:23-kcephfs-wip-yuri8-testing-2021-04-20-0734-nautilus-distro-basic-smithi/6062755/