2021-02-06T14:13:18.797 INFO:root:teuthology version: 1.1.0-17c09965 2021-02-06T14:13:18.798 INFO:teuthology.results:seed: '7816' 2021-02-06T19:34:21.590 INFO:root:teuthology version: 1.1.0-17c09965 2021-02-06T19:34:21.627 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-02-06T20:24:22.585 INFO:teuthology.results:Tests finished! gathering results... 2021-02-06T20:24:26.356 INFO:scrape:Found 20 jobs 2021-02-06T20:24:29.163 INFO:scrape:Found 3 distinct failure reasons 2021-02-06T20:24:29.163 INFO:scrape:Failure: "2021-02-06T17:05:31.950056+0000 mds.f (mds.0) 14 : cluster [WRN] Scrub error on inode 0x10000000aef (/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-13) see mds.f log and `damage ls` output for details" in cluster log 2021-02-06T20:24:29.164 INFO:scrape:2 jobs: ['5861439', '5861431'] 2021-02-06T20:24:29.164 INFO:scrape:suites intersection: ['clusters/1a5s-mds-1c-client-3node', 'conf/{client', 'fs/workload/{begin', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag_enable', 'rhel_8}', 'scrub/yes', 'session_timeout', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-02-06T20:24:29.164 INFO:scrape:suites union: ['clusters/1a5s-mds-1c-client-3node', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'fs/workload/{begin', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag_enable', 'ranks/3', 'ranks/5', 'rhel_8}', 'scrub/yes', 'session_timeout', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/fs/misc}}', 'workunit/suites/blogbench}}'] 2021-02-06T20:24:29.164 INFO:scrape: 2021-02-06T20:24:29.164 INFO:scrape:Failure: SELinux denials found on ubuntu@gibba004.front.sepia.ceph.com: ['type=AVC msg=audit(1612634409.975:8472): avc: denied { read write open } for pid=15643 comm="cachefilesd" path="/home/ubuntu/cephtest/archive/coredump/1612634407.15643.core" dev="sda1" ino=524499 scontext=system_u:system_r:cachefilesd_t:s0 tcontext=system_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1612634408.842:8468): avc: denied { add_name } for pid=15643 comm="cachefilesd" name="1612634407.15643.core" scontext=system_u:system_r:cachefilesd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1612634407.838:8463): avc: denied { search } for pid=15643 comm="cachefilesd" name="ubuntu" dev="sda1" ino=2387 scontext=system_u:system_r:cachefilesd_t:s0 tcontext=unconfined_u:object_r:user_home_dir_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1612634408.842:8469): avc: denied { create } for pid=15643 comm="cachefilesd" name="1612634407.15643.core" scontext=system_u:system_r:cachefilesd_t:s0 tcontext=system_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1612634408.842:8467): avc: denied { write } for pid=15643 comm="cachefilesd" name="coredump" dev="sda1" ino=524299 scontext=system_u:system_r:cachefilesd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1'] 2021-02-06T20:24:29.164 INFO:scrape:1 jobs: ['5861442'] 2021-02-06T20:24:29.164 INFO:scrape:suites: ['clusters/1a5s-mds-1c-client-3node', 'conf/{client', 'distro/{rhel_8}', 'fs/workload/{begin', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag_enable', 'ranks/3', 'rhel_8}', 'scrub/yes', 'session_timeout', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/suites/iogen}}'] 2021-02-06T20:24:29.164 INFO:scrape: 2021-02-06T20:24:29.164 INFO:scrape:Crash: Command failed on gibba004 with status 1: 'sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp' 2021-02-06T20:24:29.164 INFO:scrape:ceph version 17.0.0-29-g70828cb1 (70828cb1a8014f8c92cf86014114fd7aab6861c9) pacific (dev) 1: /lib64/libpthread.so.0(+0x12b20) [0x7f47b00ceb20] 2: gsignal() 3: abort() 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f47b1321a6b] 5: /usr/lib64/ceph/libceph-common.so.2(+0x275c34) [0x7f47b1321c34] 6: (ScrubStack::handle_scrub(boost::intrusive_ptr const&)+0x1412) [0x55aadba8ed82] 7: (ScrubStack::dispatch(boost::intrusive_ptr const&)+0x134) [0x55aadba8f004] 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xc22) [0x55aadb7bfa72] 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x7bb) [0x55aadb7c207b] 10: (MDSRank::retry_dispatch(boost::intrusive_ptr const&)+0x16) [0x55aadb7c2616] 11: (MDSContext::complete(int)+0x56) [0x55aadbac1aa6] 12: (C_GatherBase::sub_finish(MDSContext*, int)+0x10b) [0x55aadb7f455b] 13: (C_GatherBase::C_GatherSub::complete(int)+0x25) [0x55aadb7f4995] 14: (MDSRank::_advance_queues()+0x84) [0x55aadb7c10e4] 15: (MDSRank::ProgressThread::entry()+0xc5) [0x55aadb7c1805] 16: /lib64/libpthread.so.0(+0x814a) [0x7f47b00c414a] 17: clone() 2021-02-06T20:24:29.165 INFO:scrape:1 jobs: ['5861445'] 2021-02-06T20:24:29.165 INFO:scrape:suites: ['clusters/1a5s-mds-1c-client-3node', 'conf/{client', 'distro/{centos_8}', 'fs/workload/{begin', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag_enable', 'ranks/5', 'rhel_8}', 'scrub/yes', 'session_timeout', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/fs/misc}}'] 2021-02-06T20:24:29.165 INFO:scrape: 2021-02-06T20:24:29.166 INFO:teuthology.results:Sending results to jlayton@redhat.com: Test Run: jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba ================================================================= info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/ logs: http://qa-proxy.ceph.com/teuthology/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/ failed: 4 dead: 0 running: 0 waiting: 0 queued: 0 passed: 16 Fail ================================================================= [5861431] fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/fs/misc}} ----------------------------------------------------------------- time: 00:41:13 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861431/ log: http://qa-proxy.ceph.com/teuthology/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861431/ "2021-02-06T15:02:15.812436+0000 mds.e (mds.0) 19 : cluster [WRN] Scrub error on inode 0x10000000262 (/client.0/tmp/testdir/dir1) see mds.e log and `damage ls` output for details" in cluster log [5861439] fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/suites/blogbench}} ----------------------------------------------------------------- time: 01:58:49 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861439/ log: http://qa-proxy.ceph.com/teuthology/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861439/ "2021-02-06T17:05:31.950056+0000 mds.f (mds.0) 14 : cluster [WRN] Scrub error on inode 0x10000000aef (/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-13) see mds.f log and `damage ls` output for details" in cluster log [5861442] fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/suites/iogen}} ----------------------------------------------------------------- time: 01:10:42 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861442/ log: http://qa-proxy.ceph.com/teuthology/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861442/ SELinux denials found on ubuntu@gibba004.front.sepia.ceph.com: ['type=AVC msg=audit(1612634409.975:8472): avc: denied { read write open } for pid=15643 comm="cachefilesd" path="/home/ubuntu/cephtest/archive/coredump/1612634407.15643.core" dev="sda1" ino=524499 scontext=system_u:system_r:cachefilesd_t:s0 tcontext=system_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1612634408.842:8468): avc: denied { add_name } for pid=15643 comm="cachefilesd" name="1612634407.15643.core" scontext=system_u:system_r:cachefilesd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1612634407.838:8463): avc: denied { search } for pid=15643 comm="cachefilesd" name="ubuntu" dev="sda1" ino=2387 scontext=system_u:system_r:cachefilesd_t:s0 tcontext=unconfined_u:object_r:user_home_dir_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1612634408.842:8469): avc: denied { create } for pid=15643 comm="cachefilesd" name="1612634407.15643.core" scontext=system_u:system_r:cachefilesd_t:s0 tcontext=system_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1612634408.842:8467): avc: denied { write } for pid=15643 comm="cachefilesd" name="coredump" dev="sda1" ino=524299 scontext=system_u:system_r:cachefilesd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1'] [5861445] fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/fs/misc}} ----------------------------------------------------------------- time: 01:18:36 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861445/ log: http://qa-proxy.ceph.com/teuthology/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861445/ sentry: https://sentry.ceph.com/organizations/ceph/?query=69c25ea7c4cc411c889f1bbe5faae9c6 Command failed on gibba004 with status 1: 'sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp' Pass ================================================================= [5861430] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} time: 01:33:43 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861430/ [5861432] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} time: 00:40:11 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861432/ [5861433] fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/suites/ffsb}} time: 00:49:23 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861433/ [5861434] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/pjd}} time: 00:15:20 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861434/ [5861435] fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/suites/fsync-tester}} time: 00:12:27 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861435/ [5861436] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/admin} time: 00:27:06 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861436/ [5861437] fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/suites/pjd}} time: 00:13:53 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861437/ [5861438] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} time: 00:12:09 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861438/ [5861440] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} time: 00:48:05 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861440/ [5861441] fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/suites/fsstress}} time: 00:15:02 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861441/ [5861443] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/pjd}} time: 00:13:34 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861443/ [5861444] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:18:41 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861444/ [5861446] fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/suites/ffsb}} time: 00:28:13 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861446/ [5861447] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} time: 00:10:30 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861447/ [5861448] fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/suites/fsync-tester}} time: 00:11:54 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861448/ [5861449] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} time: 00:39:13 info: http://pulpito.ceph.com/jlayton-2021-02-06_13:15:22-fs-master-wip-netfs-lib-basic-gibba/5861449/