2021-06-03T05:22:03.000 INFO:root:teuthology version: 1.1.0-f359b10d
2021-06-03T05:22:03.001 INFO:teuthology.results:seed: '1875'
2021-06-03T05:44:20.668 INFO:root:teuthology version: 1.1.0-f359b10d
2021-06-03T05:44:20.701 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-06-03T17:40:14.587 INFO:teuthology.results:Tests finished! gathering results...
2021-06-03T17:40:23.096 INFO:scrape:Found 80 jobs
2021-06-03T17:40:24.411 INFO:scrape:Found 3 distinct failure reasons
2021-06-03T17:40:24.412 INFO:scrape:Crash: failed to reach quorum size 3 before timeout expired
2021-06-03T17:40:24.412 INFO:scrape:ceph version 14.2.21-288-g045a4d03d5 (045a4d03d58a3af5d7ae689f1612ee4c0594794e) nautilus (stable)
 1: (()+0x12980) [0x7fe138dcb980]
 2: (gsignal()+0xc7) [0x7fe137ec3fb7]
 3: (abort()+0x141) [0x7fe137ec5921]
 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x7fe139f52543]
 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fe139f526cd]
 6: (OSDMonitor::update_from_paxos(bool*)+0x3c52) [0x563ee2ea0be2]
 7: (PaxosService::refresh(bool*)+0x25a) [0x563ee2e1c54a]
 8: (Monitor::refresh_from_paxos(bool*)+0x10c) [0x563ee2cf90fc]
 9: (Paxos::do_refresh()+0x4f) [0x563ee2e0b59f]
 10: (Paxos::handle_last(boost::intrusive_ptr<MonOpRequest>)+0x8d8) [0x563ee2e15c68]
 11: (Paxos::dispatch(boost::intrusive_ptr<MonOpRequest>)+0x24b) [0x563ee2e16a1b]
 12: (Monitor::dispatch_op(boost::intrusive_ptr<MonOpRequest>)+0x19ef) [0x563ee2d2d83f]
 13: (Monitor::_ms_dispatch(Message*)+0x50a) [0x563ee2d2ddba]
 14: (Monitor::ms_dispatch(Message*)+0x26) [0x563ee2d5f356]
 15: (Dispatcher::ms_dispatch2(boost::intrusive_ptr<Message> const&)+0x26) [0x563ee2d5b406]
 16: (DispatchQueue::entry()+0x1219) [0x7fe13a182c89]
 17: (DispatchQueue::DispatchThread::entry()+0xd) [0x7fe13a233efd]
 18: (()+0x76db) [0x7fe138dc06db]
 19: (clone()+0x3f) [0x7fe137fa671f]
2021-06-03T17:40:24.413 INFO:scrape:7 jobs: ['6148876', '6148903', '6148922', '6148893', '6148923', '6148914', '6148899']
2021-06-03T17:40:24.413 INFO:scrape:suites intersection: ['rados', 'rados/singleton/{all/rebuild-mondb', 'supported-random-distro$/{ubuntu_latest}}']
2021-06-03T17:40:24.414 INFO:scrape:suites union: ['msgr-failures/few', 'msgr-failures/many', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'msgr/random', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'rados', 'rados/singleton/{all/rebuild-mondb', 'supported-random-distro$/{ubuntu_latest}}']
2021-06-03T17:40:24.414 INFO:scrape:
2021-06-03T17:40:24.415 INFO:scrape:Failure: "2021-06-03 05:43:09.087782 osd.0 (osd.0) 1 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running" in cluster log
2021-06-03T17:40:24.415 INFO:scrape:2 jobs: ['6148873', '6148913']
2021-06-03T17:40:24.415 INFO:scrape:suites intersection: ['msgr/random', 'objectstore/bluestore-comp-zstd', 'rados', 'rados/singleton/{all/rebuild-mondb', 'supported-random-distro$/{rhel_7}}']
2021-06-03T17:40:24.416 INFO:scrape:suites union: ['msgr-failures/few', 'msgr-failures/many', 'msgr/random', 'objectstore/bluestore-comp-zstd', 'rados', 'rados/singleton/{all/rebuild-mondb', 'supported-random-distro$/{rhel_7}}']
2021-06-03T17:40:24.416 INFO:scrape:
2021-06-03T17:40:24.417 INFO:scrape:Dead: b'2021-06-03T17:36:59.515 DEBUG:teuthology.exit:Finished running handlers'
2021-06-03T17:40:24.417 INFO:scrape:1 jobs: ['6148878']
2021-06-03T17:40:24.418 INFO:scrape:suites: ['msgr-failures/many', 'msgr/random', 'objectstore/bluestore-comp-zlib', 'rados', 'rados/singleton/{all/rebuild-mondb', 'supported-random-distro$/{rhel_7}}']
2021-06-03T17:40:24.418 INFO:scrape:
2021-06-03T17:40:24.421 INFO:teuthology.results:Sending results to bhubbard@redhat.com: Test Run: bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/
failed:  9
dead:    1
running: 0
waiting: 0
queued:  0
passed:  70


Fail
=================================================================
[6148873]  rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/random objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_7}}
-----------------------------------------------------------------
time:   00:14:45
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148873/
log:    http://qa-proxy.ceph.com/teuthology/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148873/

    "2021-06-03 05:43:09.087782 osd.0 (osd.0) 1 : cluster [WRN] Monitor daemon
    marked osd.0 down, but it is still running" in cluster log

[6148876]  rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/random objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:10:45
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148876/
log:    http://qa-proxy.ceph.com/teuthology/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148876/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ca29ae80ae054b2e90629264dff356fa

    failed to reach quorum size 3 before timeout expired

[6148893]  rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:10:49
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148893/
log:    http://qa-proxy.ceph.com/teuthology/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148893/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a897924c5e33464c9359fa992818f270

    failed to reach quorum size 3 before timeout expired

[6148899]  rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:10:43
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148899/
log:    http://qa-proxy.ceph.com/teuthology/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148899/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d86e49ec628845d78b412f472bdfac18

    failed to reach quorum size 3 before timeout expired

[6148903]  rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:10:49
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148903/
log:    http://qa-proxy.ceph.com/teuthology/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148903/
sentry: https://sentry.ceph.com/organizations/ceph/?query=188178a820444111807eeb2fbef59b5a

    failed to reach quorum size 3 before timeout expired

[6148913]  rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/random objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_7}}
-----------------------------------------------------------------
time:   00:15:45
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148913/
log:    http://qa-proxy.ceph.com/teuthology/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148913/

    "2021-06-03 05:56:20.912793 osd.0 (osd.0) 1 : cluster [WRN] Monitor daemon
    marked osd.0 down, but it is still running" in cluster log

[6148914]  rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/random objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:09:37
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148914/
log:    http://qa-proxy.ceph.com/teuthology/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148914/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7a8c997a15f44694a62af9ca59855cc5

    failed to reach quorum size 3 before timeout expired

[6148922]  rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:09:48
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148922/
log:    http://qa-proxy.ceph.com/teuthology/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148922/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4c4680cfe51f4d9a90dc4b699c94874a

    failed to reach quorum size 3 before timeout expired

[6148923]  rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:10:45
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148923/
log:    http://qa-proxy.ceph.com/teuthology/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148923/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f25283b5e1d74758b9217b1ba7c07de6

    failed to reach quorum size 3 before timeout expired



Dead
=================================================================
[6148878]  rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/random objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_7}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148878/
log:    http://qa-proxy.ceph.com/teuthology/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148878/

    hit max job timeout



Pass
=================================================================
[6148856] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
time:   00:14:55
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148856/

[6148857] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:17
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148857/

[6148858] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_latest}}
time:   00:13:20
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148858/

[6148859] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04}}
time:   00:11:58
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148859/

[6148860] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_7}}
time:   00:15:36
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148860/

[6148861] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
time:   00:13:42
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148861/

[6148862] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:26
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148862/

[6148863] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_16.04}}
time:   00:11:53
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148863/

[6148864] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/simple objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
time:   00:15:36
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148864/

[6148865] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/simple objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:50
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148865/

[6148866] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/simple objectstore/filestore-xfs rados supported-random-distro$/{rhel_7}}
time:   00:13:41
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148866/

[6148867] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/simple objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04}}
time:   00:12:33
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148867/

[6148868] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/simple objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
time:   00:14:56
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148868/

[6148869] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/simple objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_7}}
time:   00:16:02
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148869/

[6148870] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/simple objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_16.04}}
time:   00:11:41
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148870/

[6148871] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/simple objectstore/bluestore-stupid rados supported-random-distro$/{rhel_7}}
time:   00:14:51
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148871/

[6148872] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/random objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_16.04}}
time:   00:11:02
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148872/

[6148874] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/random objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04}}
time:   00:10:00
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148874/

[6148875] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   00:15:06
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148875/

[6148877] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/random objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
time:   00:14:58
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148877/

[6148879] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/random objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}}
time:   00:15:05
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148879/

[6148880] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
time:   00:14:19
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148880/

[6148881] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}}
time:   00:14:41
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148881/

[6148882] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04}}
time:   00:10:00
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148882/

[6148883] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04}}
time:   00:12:12
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148883/

[6148884] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
time:   00:14:36
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148884/

[6148885] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
time:   00:15:33
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148885/

[6148886] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:26
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148886/

[6148887] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:01
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148887/

[6148888] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
time:   00:14:19
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148888/

[6148889] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}}
time:   00:14:50
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148889/

[6148890] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_7}}
time:   00:14:03
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148890/

[6148891] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04}}
time:   00:11:45
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148891/

[6148892] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04}}
time:   00:11:17
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148892/

[6148894] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_7}}
time:   00:14:45
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148894/

[6148895] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}}
time:   00:15:22
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148895/

[6148896] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:36
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148896/

[6148897] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_16.04}}
time:   00:12:04
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148897/

[6148898] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_latest}}
time:   00:13:17
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148898/

[6148900] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_7}}
time:   00:15:14
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148900/

[6148901] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:41
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148901/

[6148902] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_16.04}}
time:   00:11:36
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148902/

[6148904] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/simple objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_16.04}}
time:   00:12:41
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148904/

[6148905] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/simple objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_16.04}}
time:   00:11:59
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148905/

[6148906] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/simple objectstore/filestore-xfs rados supported-random-distro$/{rhel_7}}
time:   00:13:40
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148906/

[6148907] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/simple objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04}}
time:   00:11:59
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148907/

[6148908] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/simple objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04}}
time:   00:12:25
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148908/

[6148909] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/simple objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:41
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148909/

[6148910] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/simple objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:52
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148910/

[6148911] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/simple objectstore/bluestore-stupid rados supported-random-distro$/{rhel_7}}
time:   00:15:36
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148911/

[6148912] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/random objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_7}}
time:   00:15:40
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148912/

[6148915] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04}}
time:   00:11:25
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148915/

[6148916] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/random objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04}}
time:   00:11:50
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148916/

[6148917] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/random objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_7}}
time:   00:15:23
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148917/

[6148918] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/random objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_7}}
time:   00:14:51
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148918/

[6148919] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/random objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}}
time:   00:15:24
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148919/

[6148920] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_7}}
time:   00:15:18
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148920/

[6148921] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_7}}
time:   00:15:26
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148921/

[6148924] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04}}
time:   00:11:58
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148924/

[6148925] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04}}
time:   00:11:24
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148925/

[6148926] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_7}}
time:   00:14:16
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148926/

[6148927] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_16.04}}
time:   00:11:53
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148927/

[6148928] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
time:   00:14:41
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148928/

[6148929] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}}
time:   00:14:41
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148929/

[6148930] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}}
time:   00:09:36
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148930/

[6148931] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   00:14:18
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148931/

[6148932] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
time:   00:15:21
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148932/

[6148933] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_7}}
time:   00:15:06
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148933/

[6148934] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_7}}
time:   00:14:08
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148934/

[6148935] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_7}}
time:   00:14:46
info:   http://pulpito.ceph.com/bhubbard-2021-06-03_05:17:17-rados-nautilus-distro-basic-smithi/6148935/