2020-12-25T06:23:31.029 INFO:root:teuthology version: 1.0.0-8e49dda4 2020-12-25T06:23:31.031 INFO:teuthology.results:seed: '9610' 2020-12-25T10:36:31.167 INFO:root:teuthology version: 1.0.0-8e49dda4 2020-12-25T10:36:31.232 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-12-25T11:52:32.888 INFO:teuthology.results:Tests finished! gathering results... 2020-12-25T11:52:53.757 INFO:scrape:Found 100 jobs 2020-12-25T11:52:57.355 INFO:scrape:Found 5 distinct failure reasons 2020-12-25T11:52:57.357 INFO:scrape:Failure: Test failure: test_evict_client (tasks.cephfs.test_volume_client.TestVolumeClient) 2020-12-25T11:52:57.357 INFO:scrape:1 jobs: ['5736333'] 2020-12-25T11:52:57.358 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/volumes/{begin', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/volume-client}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-12-25T11:52:57.359 INFO:scrape: 2020-12-25T11:52:57.359 INFO:scrape:Failure: Command failed (workunit test libcephfs/test.sh) on smithi086 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d599eeb83da65495bedab642d39c42e7ef85c2f8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' 2020-12-25T11:52:57.360 INFO:scrape:1 jobs: ['5736322'] 2020-12-25T11:52:57.361 INFO:scrape:suites: ['clusters/1-mds-1-client-coloc', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/libcephfs/{begin', 'mds', 'mon', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/libcephfs}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-12-25T11:52:57.362 INFO:scrape: 2020-12-25T11:52:57.362 INFO:scrape:Failure: Test failure: test_dispatch_queue_throttle_message (tasks.cephfs.test_misc.TestMisc) 2020-12-25T11:52:57.363 INFO:scrape:1 jobs: ['5736324'] 2020-12-25T11:52:57.364 INFO:scrape:suites: ['clusters/1-mds-2-client', 'conf/{client', 'distros/ubuntu_latest', 'fs/multiclient/{begin', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/cephfs_misc_tests}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-12-25T11:52:57.365 INFO:scrape: 2020-12-25T11:52:57.365 INFO:scrape:Failure: "2020-12-25T07:00:06.960248+0000 mds.b (mds.0) 94 : cluster [WRN] Scrub error on inode 0x100000158e0 (/client.0/tmp/payload.2/multiple_rsync_payload.145040/modules/4.18.0-240.1.1.el8_3.x86_64/kernel/net/netfilter) see mds.b log and `damage ls` output for details" in cluster log 2020-12-25T11:52:57.366 INFO:scrape:1 jobs: ['5736335'] 2020-12-25T11:52:57.367 INFO:scrape:suites: ['clusters/1a2s-mds-1c-client-3node', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/workload/{begin', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag_enable', 'rhel_8}', 'scrub/yes', 'session_timeout', 'tasks/workunit/fs/misc}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-12-25T11:52:57.368 INFO:scrape: 2020-12-25T11:52:57.368 INFO:scrape:Failure: Test failure: test_acls (tasks.cephfs.test_acls.TestACLs) 2020-12-25T11:52:57.369 INFO:scrape:1 jobs: ['5736321'] 2020-12-25T11:52:57.369 INFO:scrape:suites: ['clusters/1-mds-4-client-coloc', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/acls}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-12-25T11:52:57.370 INFO:scrape: 2020-12-25T11:52:57.375 INFO:teuthology.results:Sending results to jcollin@redhat.com: Test Run: jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/ failed: 5 dead: 0 running: 0 waiting: 0 queued: 0 passed: 95 Fail ================================================================= [5736321] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/acls} ----------------------------------------------------------------- time: 00:08:56 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736321/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736321/ sentry: https://sentry.ceph.com/organizations/ceph/?query=72b99f32b17c4ca7b8e2cc4a90a590bc Test failure: test_acls (tasks.cephfs.test_acls.TestACLs) [5736322] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs} ----------------------------------------------------------------- time: 00:09:31 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736322/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736322/ sentry: https://sentry.ceph.com/organizations/ceph/?query=103f318fc32e4f1eac1cd0615e694d7b Command failed (workunit test libcephfs/test.sh) on smithi086 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d599eeb83da65495bedab642d39c42e7ef85c2f8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' [5736324] fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} ----------------------------------------------------------------- time: 00:16:37 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736324/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736324/ sentry: https://sentry.ceph.com/organizations/ceph/?query=40a775d28b5744d9afa35ae004a39f67 Test failure: test_dispatch_queue_throttle_message (tasks.cephfs.test_misc.TestMisc) [5736333] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volume-client} ----------------------------------------------------------------- time: 00:15:26 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736333/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736333/ sentry: https://sentry.ceph.com/organizations/ceph/?query=da87821cee5b49948738509e95691c4d Test failure: test_evict_client (tasks.cephfs.test_volume_client.TestVolumeClient) [5736335] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/fs/misc} ----------------------------------------------------------------- time: 00:31:41 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736335/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736335/ "2020-12-25T07:00:06.960248+0000 mds.b (mds.0) 94 : cluster [WRN] Scrub error on inode 0x100000158e0 (/client.0/tmp/payload.2/multiple_rsync_payloa d.145040/modules/4.18.0-240.1.1.el8_3.x86_64/kernel/net/netfilter) see mds.b log and `damage ls` output for details" in cluster log Pass ================================================================= [5736319] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:13:21 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736319/ [5736320] fs/bugs/client_trim_caps/{begin clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/trim-i22073} time: 00:07:31 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736320/ [5736323] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} time: 01:20:15 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736323/ [5736325] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover} time: 00:42:59 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736325/ [5736326] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:09:17 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736326/ [5736327] fs/shell/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cephfs-shell} time: 00:31:11 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736327/ [5736328] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 01:27:34 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736328/ [5736329] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} time: 03:34:23 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736329/ [5736330] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc} time: 00:20:15 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736330/ [5736331] fs/upgrade/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/no}} time: 00:31:28 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736331/ [5736332] fs/verify/{begin centos_latest clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench validater/lockdep} time: 01:00:44 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736332/ [5736334] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/direct_io} time: 00:13:37 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736334/ [5736336] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} time: 02:12:03 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736336/ [5736337] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/kernel_untar_build} time: 00:34:56 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736337/ [5736338] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:18:56 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736338/ [5736339] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/suites/blogbench} time: 00:22:30 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736339/ [5736340] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/filestore-xfs omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/suites/dbench} time: 00:46:19 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736340/ [5736341] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/cfuse_workunit_suites_pjd}} time: 00:14:44 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736341/ [5736342] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/admin} time: 00:22:06 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736342/ [5736343] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/suites/ffsb} time: 00:24:39 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736343/ [5736344] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}} time: 00:09:36 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736344/ [5736345] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/fs/norstats} time: 00:15:22 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736345/ [5736346] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/filestore-xfs overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/ffsb}} time: 00:27:13 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736346/ [5736347] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/suites/fsstress} time: 00:14:18 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736347/ [5736348] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/suites/fsx} time: 00:25:15 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736348/ [5736349] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/iozone}} time: 00:11:37 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736349/ [5736350] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/suites/fsync-tester} time: 00:09:49 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736350/ [5736351] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/cfuse_workunit_snaptests}} time: 01:11:14 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736351/ [5736352] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/alternate-pool} time: 00:13:41 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736352/ [5736353] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/fs/test_o_trunc} time: 00:22:44 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736353/ [5736354] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:17:01 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736354/ [5736355] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/suites/iogen} time: 00:39:52 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736355/ [5736356] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/suites/iozone} time: 00:14:05 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736356/ [5736357] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:21:02 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736357/ [5736358] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/suites/pjd} time: 00:10:47 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736358/ [5736359] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}} time: 00:10:48 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736359/ [5736360] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/direct_io} time: 00:12:22 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736360/ [5736361] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/asok_dump_tree} time: 00:20:59 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736361/ [5736362] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/fs/misc} time: 00:32:48 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736362/ [5736363] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/cfuse_workunit_trivial_sync}} time: 00:08:58 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736363/ [5736364] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/kernel_untar_build} time: 01:41:48 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736364/ [5736365] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/ffsb}} time: 00:27:54 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736365/ [5736366] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/suites/blogbench} time: 00:18:04 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736366/ [5736367] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/iozone}} time: 00:17:05 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736367/ [5736368] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/suites/dbench} time: 00:51:28 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736368/ [5736369] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/suites/ffsb} time: 00:23:15 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736369/ [5736370] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} time: 00:58:49 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736370/ [5736371] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair} time: 00:08:54 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736371/ [5736372] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/fs/norstats} time: 00:12:59 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736372/ [5736373] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:21:31 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736373/ [5736374] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/suites/fsstress} time: 00:12:57 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736374/ [5736375] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} time: 00:14:26 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736375/ [5736376] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/suites/fsx} time: 00:24:25 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736376/ [5736377] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/suites/fsync-tester} time: 00:11:28 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736377/ [5736378] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} time: 00:15:22 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736378/ [5736379] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/filestore-xfs omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/fs/test_o_trunc} time: 00:18:36 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736379/ [5736380] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}} time: 00:10:31 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736380/ [5736381] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/backtrace} time: 00:09:21 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736381/ [5736382] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/suites/iogen} time: 00:57:26 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736382/ [5736383] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/suites/iozone} time: 00:17:29 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736383/ [5736384] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/ffsb}} time: 00:50:38 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736384/ [5736385] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/suites/pjd} time: 00:12:01 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736385/ [5736386] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/iozone}} time: 00:14:01 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736386/ [5736387] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth} time: 00:16:56 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736387/ [5736388] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/direct_io} time: 00:13:37 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736388/ [5736389] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} time: 01:00:40 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736389/ [5736390] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/fs/misc} time: 00:28:01 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736390/ [5736391] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cap-flush} time: 00:13:44 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736391/ [5736392] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/kernel_untar_build} time: 00:32:49 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736392/ [5736393] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:14:51 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736393/ [5736394] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/suites/blogbench} time: 00:22:24 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736394/ [5736395] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/cfuse_workunit_suites_pjd}} time: 00:11:02 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736395/ [5736396] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/suites/dbench} time: 00:52:27 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736396/ [5736397] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}} time: 00:09:15 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736397/ [5736398] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/suites/ffsb} time: 00:36:28 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736398/ [5736399] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/fs/norstats} time: 00:15:01 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736399/ [5736400] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/ffsb}} time: 00:39:10 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736400/ [5736401] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-limits} time: 00:18:02 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736401/ [5736402] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/suites/fsstress} time: 00:14:02 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736402/ [5736403] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}} time: 00:10:52 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736403/ [5736404] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/suites/fsx} time: 00:18:22 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736404/ [5736405] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/suites/fsync-tester} time: 00:10:12 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736405/ [5736406] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/iozone}} time: 00:13:38 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736406/ [5736407] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 00:42:46 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736407/ [5736408] fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file} time: 00:09:02 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736408/ [5736409] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/fs/test_o_trunc} time: 00:22:30 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736409/ [5736410] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/filestore-xfs overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/cfuse_workunit_snaptests}} time: 01:09:31 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736410/ [5736411] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/suites/iogen} time: 00:20:42 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736411/ [5736412] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:19:55 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736412/ [5736413] fs/functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-readahead} time: 00:09:58 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736413/ [5736414] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/suites/iozone} time: 00:10:38 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736414/ [5736415] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/yes tasks/workunit/suites/pjd} time: 00:10:34 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736415/ [5736416] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}} time: 00:14:50 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736416/ [5736417] fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} scrub/no tasks/workunit/direct_io} time: 00:13:05 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736417/ [5736418] fs/thrash/workloads/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/osd 2-workunit/cfuse_workunit_trivial_sync}} time: 00:09:56 info: http://pulpito.ceph.com/jcollin-2020-12-25_05:41:25-fs-wip-jcollin-dispatch-throttle-default-config-values-distro-basic-smithi/5736418/