2022-01-23T06:56:28.801 INFO:root:teuthology version: 1.1.0-75f1bcd2
2022-01-23T06:56:28.805 INFO:teuthology.results:seed: '3467'
2022-01-23T07:03:05.399 INFO:root:teuthology version: 1.1.0-75f1bcd2
2022-01-23T07:03:05.401 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-01-23T07:28:07.285 INFO:teuthology.results:Tests finished! gathering results...
2022-01-23T07:28:07.697 INFO:scrape:Found 10 jobs
2022-01-23T07:28:08.522 INFO:scrape:Found 1 distinct failure reasons
2022-01-23T07:28:08.523 INFO:scrape:Failure: "2022-01-23T07:15:09.717478+0000 mon.a (mon.0) 160 : cluster [ERR] Health check failed: Module 'feedback' has failed: Not found or unloadable (MGR_MODULE_ERROR)" in cluster log
2022-01-23T07:28:08.524 INFO:scrape:10 jobs: ['6636635', '6636647', '6636645', '6636637', '6636653', '6636639', '6636651', '6636649', '6636643', '6636641']
2022-01-23T07:28:08.524 INFO:scrape:suites intersection: ['clusters/{fixed-3', 'features/defaults', 'msgr-failures/few', 'openstack}', 'supported-random-distro$/{centos_8.stream}', 'workloads/qemu_xfstests_luks2}']
2022-01-23T07:28:08.525 INFO:scrape:suites union: ['clusters/{fixed-3', 'features/defaults', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/filestore-xfs', 'openstack}', 'pool/ec-cache-pool', 'pool/none', 'pool/replicated-data-pool', 'pool/small-cache-pool', 'rbd/encryption/{cache/writearound', 'rbd/encryption/{cache/writethrough', 'supported-random-distro$/{centos_8.stream}', 'workloads/qemu_xfstests_luks2}']
2022-01-23T07:28:08.525 INFO:scrape:
2022-01-23T07:28:08.528 INFO:teuthology.results:Sending results to oro@il.ibm.com: Test Run: oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/
failed:  10
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[6636635]  rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/ec-cache-pool supported-random-distro$/{centos_8.stream} workloads/qemu_xfstests_luks2}
-----------------------------------------------------------------
time:   00:15:03
info:   http://pulpito.ceph.com/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636635/
log:    http://qa-proxy.ceph.com/teuthology/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636635/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7ac14364827242eb8fc3f7e97e2c10c3

    "2022-01-23T07:15:09.717478+0000 mon.a (mon.0) 160 : cluster [ERR] Health
    check failed: Module 'feedback' has failed: Not found or unloadable
    (MGR_MODULE_ERROR)" in cluster log

[6636637]  rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{centos_8.stream} workloads/qemu_xfstests_luks2}
-----------------------------------------------------------------
time:   00:14:20
info:   http://pulpito.ceph.com/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636637/
log:    http://qa-proxy.ceph.com/teuthology/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636637/
sentry: https://sentry.ceph.com/organizations/ceph/?query=042104b4383240239cc7c83cc373a5f3

    "2022-01-23T07:14:07.733658+0000 mon.a (mon.0) 104 : cluster [ERR] Health
    check failed: Module 'feedback' has failed: Not found or unloadable
    (MGR_MODULE_ERROR)" in cluster log

[6636639]  rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zstd pool/replicated-data-pool supported-random-distro$/{centos_8.stream} workloads/qemu_xfstests_luks2}
-----------------------------------------------------------------
time:   00:14:32
info:   http://pulpito.ceph.com/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636639/
log:    http://qa-proxy.ceph.com/teuthology/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636639/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a32cc89a58b54cb58cde7a23f1f9fa12

    "2022-01-23T07:14:07.001759+0000 mon.a (mon.0) 120 : cluster [ERR] Health
    check failed: Module 'feedback' has failed: Not found or unloadable
    (MGR_MODULE_ERROR)" in cluster log

[6636641]  rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{centos_8.stream} workloads/qemu_xfstests_luks2}
-----------------------------------------------------------------
time:   00:14:19
info:   http://pulpito.ceph.com/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636641/
log:    http://qa-proxy.ceph.com/teuthology/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636641/
sentry: https://sentry.ceph.com/organizations/ceph/?query=16c599da15004448a2cd5565affab1fb

    "2022-01-23T07:14:25.857235+0000 mon.a (mon.0) 104 : cluster [ERR] Health
    check failed: Module 'feedback' has failed: Not found or unloadable
    (MGR_MODULE_ERROR)" in cluster log

[6636643]  rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{centos_8.stream} workloads/qemu_xfstests_luks2}
-----------------------------------------------------------------
time:   00:14:46
info:   http://pulpito.ceph.com/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636643/
log:    http://qa-proxy.ceph.com/teuthology/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636643/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ceb1d60af29a4d7cb9e8fa33be6a57a1

    "2022-01-23T07:15:17.151150+0000 mon.a (mon.0) 102 : cluster [ERR] Health
    check failed: Module 'feedback' has failed: Not found or unloadable
    (MGR_MODULE_ERROR)" in cluster log

[6636645]  rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/ec-cache-pool supported-random-distro$/{centos_8.stream} workloads/qemu_xfstests_luks2}
-----------------------------------------------------------------
time:   00:14:18
info:   http://pulpito.ceph.com/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636645/
log:    http://qa-proxy.ceph.com/teuthology/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636645/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9a8e9441f82647a6b0a250e23fcf8377

    "2022-01-23T07:16:28.319152+0000 mon.a (mon.0) 108 : cluster [ERR] Health
    check failed: Module 'feedback' has failed: Not found or unloadable
    (MGR_MODULE_ERROR)" in cluster log

[6636647]  rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/small-cache-pool supported-random-distro$/{centos_8.stream} workloads/qemu_xfstests_luks2}
-----------------------------------------------------------------
time:   00:14:12
info:   http://pulpito.ceph.com/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636647/
log:    http://qa-proxy.ceph.com/teuthology/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636647/
sentry: https://sentry.ceph.com/organizations/ceph/?query=65137daa47fd407e968f062fde6f2178

    "2022-01-23T07:16:51.879139+0000 mon.a (mon.0) 105 : cluster [ERR] Health
    check failed: Module 'feedback' has failed: Not found or unloadable
    (MGR_MODULE_ERROR)" in cluster log

[6636649]  rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/replicated-data-pool supported-random-distro$/{centos_8.stream} workloads/qemu_xfstests_luks2}
-----------------------------------------------------------------
time:   00:14:18
info:   http://pulpito.ceph.com/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636649/
log:    http://qa-proxy.ceph.com/teuthology/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636649/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d161a1a475cc4b03a2f4adece95b16ad

    "2022-01-23T07:19:01.029710+0000 mon.a (mon.0) 156 : cluster [ERR] Health
    check failed: Module 'feedback' has failed: Not found or unloadable
    (MGR_MODULE_ERROR)" in cluster log

[6636651]  rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{centos_8.stream} workloads/qemu_xfstests_luks2}
-----------------------------------------------------------------
time:   00:13:57
info:   http://pulpito.ceph.com/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636651/
log:    http://qa-proxy.ceph.com/teuthology/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636651/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0c66b07e31b14a55ada9fa2a15ccb2b8

    "2022-01-23T07:19:54.307198+0000 mon.a (mon.0) 97 : cluster [ERR] Health
    check failed: Module 'feedback' has failed: Not found or unloadable
    (MGR_MODULE_ERROR)" in cluster log

[6636653]  rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{centos_8.stream} workloads/qemu_xfstests_luks2}
-----------------------------------------------------------------
time:   00:14:18
info:   http://pulpito.ceph.com/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636653/
log:    http://qa-proxy.ceph.com/teuthology/oro-2022-01-23_06:56:04-rbd-wip-oro-qa-qemu-nbd-ide-interface-distro-default-smithi/6636653/
sentry: https://sentry.ceph.com/organizations/ceph/?query=742d52d1f34a48c4bd60cf66b0035a7a

    "2022-01-23T07:21:47.619136+0000 mon.a (mon.0) 155 : cluster [ERR] Health
    check failed: Module 'feedback' has failed: Not found or unloadable
    (MGR_MODULE_ERROR)" in cluster log