2021-03-14T00:30:58.312 INFO:root:teuthology version: 1.1.0-b9656917
2021-03-14T00:30:58.314 INFO:teuthology.results:subset: '1/8'
2021-03-14T00:30:58.314 INFO:teuthology.results:seed: '1048'
2021-03-14T01:26:42.957 INFO:root:teuthology version: 1.1.0-b9656917
2021-03-14T01:26:42.985 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-03-14T01:59:45.551 INFO:teuthology.results:Tests finished! gathering results...
2021-03-14T02:02:10.149 INFO:scrape:Found 64 jobs
2021-03-14T02:02:35.741 INFO:scrape:Found 10 distinct failure reasons
2021-03-14T02:02:35.742 INFO:scrape:Failure: Test failure: test_deep_split (tasks.cephfs.test_fragment.TestFragmentation)
2021-03-14T02:02:35.742 INFO:scrape:2 jobs: ['5962235', '5962267']
2021-03-14T02:02:35.743 INFO:scrape:suites intersection: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'fs:functional/{begin', 'mds', 'mon', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/fragment}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-14T02:02:35.743 INFO:scrape:suites union: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'fs:functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/fuse', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/fragment}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-14T02:02:35.744 INFO:scrape:
2021-03-14T02:02:35.744 INFO:scrape:Failure: "2021-03-14T01:24:12.757681+0000 mds.c (mds.0) 4 : cluster [WRN] Corrupt dentry 'shadow' in dir frag 0x10000000000: Invalid tag char '4' pos 2: Malformed input(/parent)" in cluster log
2021-03-14T02:02:35.745 INFO:scrape:2 jobs: ['5962245', '5962277']
2021-03-14T02:02:35.745 INFO:scrape:suites intersection: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'fs:functional/{begin', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/scrub}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-14T02:02:35.746 INFO:scrape:suites union: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{ubuntu_latest}', 'fs:functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'rhel_8}', 'tasks/scrub}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-14T02:02:35.746 INFO:scrape:
2021-03-14T02:02:35.747 INFO:scrape:Failure: Test failure: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules)
2021-03-14T02:02:35.747 INFO:scrape:2 jobs: ['5962247', '5962279']
2021-03-14T02:02:35.747 INFO:scrape:suites intersection: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'fs:functional/{begin', 'mds', 'mon', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/snap-schedule}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-14T02:02:35.748 INFO:scrape:suites union: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'fs:functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/fuse', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/snap-schedule}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-14T02:02:35.748 INFO:scrape:
2021-03-14T02:02:35.749 INFO:scrape:Failure: Test failure: test_flush (tasks.cephfs.test_flush.TestFlush)
2021-03-14T02:02:35.749 INFO:scrape:2 jobs: ['5962269', '5962237']
2021-03-14T02:02:35.750 INFO:scrape:suites intersection: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'fs:functional/{begin', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/mds-flush}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-14T02:02:35.750 INFO:scrape:suites union: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{ubuntu_latest}', 'fs:functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'rhel_8}', 'tasks/mds-flush}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-14T02:02:35.751 INFO:scrape:
2021-03-14T02:02:35.751 INFO:scrape:Failure: Test failure: test_inject_to_empty (tasks.cephfs.test_journal_repair.TestJournalRepair)
2021-03-14T02:02:35.752 INFO:scrape:2 jobs: ['5962268', '5962236']
2021-03-14T02:02:35.752 INFO:scrape:suites intersection: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'fs:functional/{begin', 'mds', 'mon', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{frag_enable', 'tasks/journal-repair}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-14T02:02:35.753 INFO:scrape:suites union: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'fs:functional/{begin', 'mds', 'mon', 'mount/fuse', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag_enable', 'rhel_8}', 'tasks/journal-repair}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-14T02:02:35.753 INFO:scrape:
2021-03-14T02:02:35.753 INFO:scrape:Failure: Test failure: test_object_deletion (tasks.cephfs.test_damage.TestDamage)
2021-03-14T02:02:35.754 INFO:scrape:2 jobs: ['5962263', '5962231']
2021-03-14T02:02:35.754 INFO:scrape:suites intersection: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'fs:functional/{begin', 'mds', 'mon', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/damage}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-14T02:02:35.755 INFO:scrape:suites union: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{ubuntu_latest}', 'fs:functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/fuse', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/damage}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-14T02:02:35.755 INFO:scrape:
2021-03-14T02:02:35.756 INFO:scrape:Failure: Test failure: test_full_fsync (tasks.cephfs.test_full.TestClusterFull)
2021-03-14T02:02:35.756 INFO:scrape:2 jobs: ['5962270', '5962238']
2021-03-14T02:02:35.757 INFO:scrape:suites intersection: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'fs:functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{frag_enable', 'tasks/mds-full}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-14T02:02:35.757 INFO:scrape:suites union: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'fs:functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/mds-full}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-14T02:02:35.757 INFO:scrape:
2021-03-14T02:02:35.758 INFO:scrape:Failure: Command failed (workunit test fs/quota/quota.sh) on smithi031 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && cd -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=33030d887a051abf158c8f2fb01e65d3ce765422 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="2" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.2 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.2/qa/workunits/fs/quota/quota.sh'
2021-03-14T02:02:35.758 INFO:scrape:1 jobs: ['5962252']
2021-03-14T02:02:35.759 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs:functional/{begin', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag_enable', 'rhel_8}', 'tasks/workunit/quota}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-14T02:02:35.759 INFO:scrape:
2021-03-14T02:02:35.760 INFO:scrape:Failure: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
2021-03-14T02:02:35.760 INFO:scrape:2 jobs: ['5962264', '5962232']
2021-03-14T02:02:35.760 INFO:scrape:suites intersection: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'fs:functional/{begin', 'mds', 'mon', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{frag_enable', 'tasks/data-scan}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-14T02:02:35.761 INFO:scrape:suites union: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'fs:functional/{begin', 'mds', 'mon', 'mount/fuse', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag_enable', 'rhel_8}', 'tasks/data-scan}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-14T02:02:35.761 INFO:scrape:
2021-03-14T02:02:35.762 INFO:scrape:Failure: Test failure: test_mirroring_command_idempotency (tasks.cephfs.test_admin.TestMirroringCommands)
2021-03-14T02:02:35.762 INFO:scrape:2 jobs: ['5962222', '5962254']
2021-03-14T02:02:35.763 INFO:scrape:suites intersection: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'fs:functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{frag_enable', 'tasks/admin}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-14T02:02:35.763 INFO:scrape:suites union: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'fs:functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/admin}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-03-14T02:02:35.764 INFO:scrape:
2021-03-14T02:02:35.768 INFO:teuthology.results:Sending results to pdonnell@redhat.com: Test Run: pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/
failed:  19
dead:    0
running: 0
waiting: 0
queued:  0
passed:  45


Fail
=================================================================
[5962222]  fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/admin}
-----------------------------------------------------------------
time:   00:20:25
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962222/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962222/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a7ae08c1b2d34622a65410494c474e4c

    Test failure: test_mirroring_command_idempotency
    (tasks.cephfs.test_admin.TestMirroringCommands)

[5962231]  fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/damage}
-----------------------------------------------------------------
time:   00:09:34
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962231/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962231/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f16d0b74d5874024a5d075d5e003a2a3

    Test failure: test_object_deletion (tasks.cephfs.test_damage.TestDamage)

[5962232]  fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/data-scan}
-----------------------------------------------------------------
time:   00:10:20
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962232/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962232/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4882a5df471d4688a6ec25345ff9d201

    Test failure: test_fragmented_injection
    (tasks.cephfs.test_data_scan.TestDataScan)

[5962235]  fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/fragment}
-----------------------------------------------------------------
time:   00:10:34
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962235/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962235/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1af5f1d7d6b4406fb41af56e3e96d9a6

    Test failure: test_deep_split
    (tasks.cephfs.test_fragment.TestFragmentation)

[5962236]  fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair}
-----------------------------------------------------------------
time:   00:10:55
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962236/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962236/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a9b91afcfbff4357816c7e34c30407b4

    Test failure: test_inject_to_empty
    (tasks.cephfs.test_journal_repair.TestJournalRepair)

[5962237]  fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush}
-----------------------------------------------------------------
time:   00:12:56
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962237/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962237/
sentry: https://sentry.ceph.com/organizations/ceph/?query=47a91a846f79456fac7f06a2bc1f49b6

    Test failure: test_flush (tasks.cephfs.test_flush.TestFlush)

[5962238]  fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full}
-----------------------------------------------------------------
time:   00:15:39
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962238/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962238/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7753032d77254107ad108de68ca15787

    Test failure: test_full_fsync (tasks.cephfs.test_full.TestClusterFull)

[5962245]  fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/scrub}
-----------------------------------------------------------------
time:   00:23:38
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962245/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962245/

    "2021-03-14T01:24:12.757681+0000 mds.c (mds.0) 4 : cluster [WRN] Corrupt
    dentry 'shadow' in dir frag 0x10000000000: Invalid tag char '4' pos 2:
    Malformed input(/parent)" in cluster log

[5962247]  fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:12:39
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962247/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962247/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a3028c235d994edabfa2637655275a3d

    Test failure: test_non_existent_schedule
    (tasks.cephfs.test_snap_schedules.TestSnapSchedules)

[5962252]  fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/workunit/quota}
-----------------------------------------------------------------
time:   00:11:44
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962252/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962252/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3eeca1c3f0df435fb89d83a043e8d00e

    Command failed (workunit test fs/quota/quota.sh) on smithi031 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && cd --
    /home/ubuntu/cephtest/mnt.2/client.2/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=33030d887a051abf158c8f2fb01e65d3ce765422
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="2"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.2
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.2 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.2/qa/workunits/fs/quota/quota.sh'

[5962254]  fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/admin}
-----------------------------------------------------------------
time:   00:26:39
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962254/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962254/
sentry: https://sentry.ceph.com/organizations/ceph/?query=50e85dbca5254fc58a7f0cbd3f357efe

    Test failure: test_mirroring_command_idempotency
    (tasks.cephfs.test_admin.TestMirroringCommands)

[5962263]  fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/damage}
-----------------------------------------------------------------
time:   00:12:07
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962263/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962263/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8c090720f1984c278e5549dbd67ddca7

    Test failure: test_object_deletion (tasks.cephfs.test_damage.TestDamage)

[5962264]  fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/data-scan}
-----------------------------------------------------------------
time:   00:11:05
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962264/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962264/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9beab46d8b01462ebb99195735307ce4

    Test failure: test_fragmented_injection
    (tasks.cephfs.test_data_scan.TestDataScan)

[5962267]  fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/fragment}
-----------------------------------------------------------------
time:   00:12:11
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962267/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962267/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f79b02684f58434b946f1873af9b0e5f

    Test failure: test_deep_split
    (tasks.cephfs.test_fragment.TestFragmentation)

[5962268]  fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair}
-----------------------------------------------------------------
time:   00:09:05
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962268/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962268/
sentry: https://sentry.ceph.com/organizations/ceph/?query=eb259cdce04249b2815dcc01f731f486

    Test failure: test_inject_to_empty
    (tasks.cephfs.test_journal_repair.TestJournalRepair)

[5962269]  fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush}
-----------------------------------------------------------------
time:   00:10:14
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962269/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962269/
sentry: https://sentry.ceph.com/organizations/ceph/?query=82532727e626410ab9dcd0d7f747c905

    Test failure: test_flush (tasks.cephfs.test_flush.TestFlush)

[5962270]  fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full}
-----------------------------------------------------------------
time:   00:19:10
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962270/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962270/
sentry: https://sentry.ceph.com/organizations/ceph/?query=234d622c584048819627e8a561339fb2

    Test failure: test_full_fsync (tasks.cephfs.test_full.TestClusterFull)

[5962277]  fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/scrub}
-----------------------------------------------------------------
time:   00:18:27
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962277/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962277/

    "2021-03-14T01:43:39.537713+0000 mds.c (mds.0) 4 : cluster [WRN] Corrupt
    dentry 'shadow' in dir frag 0x10000000000: Invalid tag char '4' pos 2:
    Malformed input(/parent)" in cluster log

[5962279]  fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:15:08
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962279/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962279/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ebe57dce61914a16a24f286a12771236

    Test failure: test_non_existent_schedule
    (tasks.cephfs.test_snap_schedules.TestSnapSchedules)



Pass
=================================================================
[5962221] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/acls}
time:   00:14:35
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962221/

[5962223] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/alternate-pool}
time:   00:08:54
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962223/

[5962224] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/asok_dump_tree}
time:   00:24:23
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962224/

[5962225] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair}
time:   00:13:25
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962225/

[5962226] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/backtrace}
time:   00:10:35
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962226/

[5962227] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cap-flush}
time:   00:08:38
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962227/

[5962228] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-limits}
time:   00:17:38
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962228/

[5962229] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-readahead}
time:   00:12:00
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962229/

[5962230] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery}
time:   00:30:20
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962230/

[5962233] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/exports}
time:   00:52:01
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962233/

[5962234] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub}
time:   00:14:32
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962234/

[5962239] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds_creation_retry}
time:   00:08:20
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962239/

[5962240] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/metrics}
time:   00:19:58
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962240/

[5962241] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/multimds_misc}
time:   00:20:26
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962241/

[5962242] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/openfiletable}
time:   00:16:58
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962242/

[5962243] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/pool-perm}
time:   00:09:43
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962243/

[5962244] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/quota}
time:   00:11:09
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962244/

[5962246] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/sessionmap}
time:   00:14:17
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962246/

[5962248] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snapshots}
time:   00:20:55
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962248/

[5962249] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/strays}
time:   00:31:08
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962249/

[5962250] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/test_journal_migration}
time:   00:17:37
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962250/

[5962251] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/truncate_delay}
time:   00:11:07
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962251/

[5962253] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/acls}
time:   00:11:17
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962253/

[5962255] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/alternate-pool}
time:   00:11:03
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962255/

[5962256] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/asok_dump_tree}
time:   00:20:48
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962256/

[5962257] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair}
time:   00:11:05
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962257/

[5962258] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/backtrace}
time:   00:12:55
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962258/

[5962259] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cap-flush}
time:   00:10:40
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962259/

[5962260] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-limits}
time:   00:19:25
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962260/

[5962261] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-readahead}
time:   00:10:22
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962261/

[5962262] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery}
time:   00:35:03
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962262/

[5962265] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/exports}
time:   00:42:02
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962265/

[5962266] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub}
time:   00:16:58
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962266/

[5962271] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds_creation_retry}
time:   00:10:13
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962271/

[5962272] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/metrics}
time:   00:19:05
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962272/

[5962273] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/multimds_misc}
time:   00:17:31
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962273/

[5962274] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/openfiletable}
time:   00:18:13
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962274/

[5962275] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/pool-perm}
time:   00:11:07
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962275/

[5962276] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/quota}
time:   00:12:18
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962276/

[5962278] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/sessionmap}
time:   00:15:51
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962278/

[5962280] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snapshots}
time:   00:27:07
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962280/

[5962281] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/strays}
time:   00:23:05
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962281/

[5962282] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/test_journal_migration}
time:   00:19:58
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962282/

[5962283] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/truncate_delay}
time:   00:11:06
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962283/

[5962284] fs:functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/workunit/quota}
time:   00:11:27
info:   http://pulpito.ceph.com/pdonnell-2021-03-13_16:59:03-fs:functional-wip-pdonnell-testing-20210312.221823-distro-basic-smithi/5962284/