2021-04-17T03:44:59.152 INFO:root:teuthology version: 1.1.0-2713a3cd
2021-04-17T03:44:59.156 INFO:teuthology.results:seed: '2510'
2021-04-17T04:04:20.632 INFO:root:teuthology version: 1.1.0-2713a3cd
2021-04-17T04:04:20.654 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-04-17T08:30:46.920 INFO:teuthology.results:Tests finished! gathering results...
2021-04-17T08:30:49.341 INFO:scrape:Found 24 jobs
2021-04-17T08:31:01.840 INFO:scrape:Found 2 distinct failure reasons
2021-04-17T08:31:01.842 INFO:scrape:Failure: "2021-04-17T04:08:50.752833+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log
2021-04-17T08:31:01.843 INFO:scrape:23 jobs: ['6052534', '6052541', '6052540', '6052523', '6052520', '6052525', '6052533', '6052539', '6052527', '6052522', '6052531', '6052526', '6052536', '6052530', '6052524', '6052535', '6052542', '6052521', '6052532', '6052537', '6052528', '6052543', '6052538']
2021-04-17T08:31:01.844 INFO:scrape:suites intersection: ['2-workunit/fs/snaps}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'fs:thrash/workloads/{begin', 'mds', 'mon', 'mount/fuse', 'osd}', 'overrides/{frag_enable', 'ranks/1', 'session_timeout', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-04-17T08:31:01.845 INFO:scrape:suites union: ['2-workunit/fs/snaps}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'fs:thrash/workloads/{begin', 'mds', 'mon', 'mount/fuse', 'msgr-failures/none', 'msgr-failures/osd-mds-delay', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{frag_enable', 'ranks/1', 'session_timeout', 'tasks/{1-thrash/mds', 'tasks/{1-thrash/mon', 'tasks/{1-thrash/osd', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-04-17T08:31:01.845 INFO:scrape:
2021-04-17T08:31:01.846 INFO:scrape:Failure: Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi008 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d8a37fe4faed75141863d6c0a9fde6b4a0ff502a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-multiple-capsnaps.sh'
2021-04-17T08:31:01.847 INFO:scrape:1 jobs: ['6052529']
2021-04-17T08:31:01.848 INFO:scrape:suites: ['2-workunit/fs/snaps}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_8}', 'fs:thrash/workloads/{begin', 'mds', 'mon', 'mount/fuse', 'msgr-failures/none', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{frag_enable', 'ranks/1', 'session_timeout', 'tasks/{1-thrash/osd', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-04-17T08:31:01.849 INFO:scrape:
2021-04-17T08:31:01.852 INFO:teuthology.results:Sending results to pdonnell@redhat.com: Test Run: pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/
failed:  24
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[6052520]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   00:50:30
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052520/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052520/

    "2021-04-17T04:01:33.658644+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052521]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   00:50:22
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052521/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052521/

    "2021-04-17T04:02:42.112395+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052522]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   00:54:34
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052522/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052522/

    "2021-04-17T04:01:09.434012+0000 mgr.y (mgr.4113) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052523]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   01:32:14
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052523/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052523/

    "2021-04-17T04:04:53.512032+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052524]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   02:00:42
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052524/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052524/

    "2021-04-17T04:03:03.709534+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052525]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   03:26:52
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052525/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052525/

    "2021-04-17T04:02:51.653125+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052526]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   01:54:35
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052526/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052526/

    "2021-04-17T04:03:21.652545+0000 mgr.y (mgr.4113) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052527]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   01:04:06
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052527/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052527/

    "2021-04-17T04:03:50.386522+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052528]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   01:02:53
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052528/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052528/

    "2021-04-17T04:05:21.750482+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052529]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   00:30:27
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052529/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052529/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4dbdc3081a6f4692a0f782b0f6fbee92

    Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on
    smithi008 with status 1: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=d8a37fe4faed75141863d6c0a9fde6b4a0ff502a
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-
    multiple-capsnaps.sh'

[6052530]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   01:25:43
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052530/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052530/

    "2021-04-17T04:06:06.297135+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052531]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   01:19:11
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052531/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052531/

    "2021-04-17T04:07:00.302023+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052532]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   01:43:25
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052532/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052532/

    "2021-04-17T04:07:29.206861+0000 mgr.x (mgr.4110) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052533]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   01:21:51
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052533/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052533/

    "2021-04-17T04:09:01.223162+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052534]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   01:37:22
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052534/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052534/

    "2021-04-17T04:08:50.752833+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052535]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   02:16:43
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052535/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052535/

    "2021-04-17T04:18:14.252804+0000 mgr.y (mgr.4110) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052536]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   01:44:20
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052536/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052536/

    "2021-04-17T04:12:44.699499+0000 mgr.y (mgr.4119) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052537]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   04:25:12
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052537/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052537/

    "2021-04-17T04:14:43.556647+0000 mgr.x (mgr.4111) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052538]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   02:53:15
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052538/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052538/

    "2021-04-17T04:18:19.058492+0000 mgr.x (mgr.4111) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052539]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   01:45:12
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052539/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052539/

    "2021-04-17T04:15:42.531778+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052540]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   01:31:40
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052540/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052540/

    "2021-04-17T04:15:37.378860+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052541]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   03:34:03
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052541/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052541/

    "2021-04-17T04:17:16.721883+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052542]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   02:09:29
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052542/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052542/

    "2021-04-17T04:16:07.588435+0000 mgr.x (mgr.4101) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log

[6052543]  fs:thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   01:37:13
info:   http://pulpito.ceph.com/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052543/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2021-04-17_03:44:12-fs:thrash-master-distro-basic-smithi/6052543/

    "2021-04-17T04:21:01.250981+0000 mgr.y (mgr.4123) 1 : cluster [ERR] Failed
    to load ceph-mgr modules: rook" in cluster log