2022-05-09T00:03:23.826 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01
2022-05-09T00:03:23.828 INFO:teuthology.results:seed: '9781'
2022-05-09T03:22:30.310 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01
2022-05-09T03:22:30.358 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-05-09T05:19:40.615 INFO:teuthology.results:Tests finished! gathering results...
2022-05-09T05:19:57.310 INFO:scrape:Found 222 jobs
2022-05-09T05:20:06.874 INFO:scrape:Found 6 distinct failure reasons
2022-05-09T05:20:06.875 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nightly_pre-single-major
2022-05-09T05:20:06.876 INFO:scrape:1 jobs: ['6824131']
2022-05-09T05:20:06.876 INFO:scrape:suites: ['clusters/separate-client', 'conf', 'filestore-xfs', 'kernels/pre-single-major', 'krbd/unmap/{ceph/ceph', 'tasks/unmap}']
2022-05-09T05:20:06.876 INFO:scrape:
2022-05-09T05:20:06.877 INFO:scrape:Failure: "2022-05-09T01:29:16.254503+0000 mon.a (mon.0) 111 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log
2022-05-09T05:20:06.877 INFO:scrape:45 jobs
2022-05-09T05:20:06.878 INFO:scrape:suites intersection: ['conf']
2022-05-09T05:20:06.879 INFO:scrape:suites union: ['ceph/ceph', 'clusters/3-node', 'clusters/fixed-3', 'conf', 'features/object-map', 'install/ceph', 'krbd/fsx/{ceph/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'krbd/rbd/{bluestore-bitmap', 'krbd/singleton/{bluestore-bitmap', 'krbd/wac/wac/{bluestore-bitmap', 'ms_mode$/{crc}', 'ms_mode$/{secure}', 'ms_mode/crc$/{crc-rxbounce}', 'ms_mode/crc$/{crc}', 'ms_mode/legacy$/{legacy-rxbounce}', 'ms_mode/legacy$/{legacy}', 'ms_mode/secure', 'msgr-failures/few', 'msgr-failures/many', 'objectstore/bluestore-bitmap', 'randomized-striping-off}', 'striping/default/{msgr-failures/many', 'tasks/fsx-1-client}', 'tasks/krbd_data_pool}', 'tasks/krbd_exclusive_option}', 'tasks/krbd_fallocate}', 'tasks/krbd_huge_osdmap}', 'tasks/krbd_namespaces}', 'tasks/krbd_udev_enumerate}', 'tasks/krbd_udev_netlink_enobufs}', 'tasks/krbd_udev_netns}', 'tasks/krbd_udev_symlinks}', 'tasks/rbd_concurrent}', 'tasks/rbd_fio}', 'tasks/rbd_huge_tickets}', 'tasks/rbd_image_read}', 'tasks/rbd_kernel}', 'tasks/rbd_map_snapshot_io}', 'tasks/rbd_map_unmap}', 'tasks/rbd_simple_big}', 'tasks/rbd_workunit_kernel_untar_build}', 'tasks/rbd_workunit_suites_fsstress_ext4}', 'tasks/rbd_workunit_suites_fsstress}', 'tasks/rbd_workunit_suites_fsx}', 'tasks/rbd_workunit_suites_iozone}', 'tasks/rbd_xfstests}', 'tasks/wac', 'verify/many-resets}']
2022-05-09T05:20:06.879 INFO:scrape:
2022-05-09T05:20:06.880 INFO:scrape:Failure: Command failed on smithi123 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'
2022-05-09T05:20:06.880 INFO:scrape:1 jobs: ['6824308']
2022-05-09T05:20:06.880 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/secure', 'msgr-failures/many', 'tasks/rbd_map_unmap}']
2022-05-09T05:20:06.881 INFO:scrape:
2022-05-09T05:20:06.881 INFO:scrape:Failure: "2022-05-09T01:23:30.023378+0000 osd.3 (osd.3) 3 : cluster [WRN] 1 slow requests (by type [ 'waiting for sub ops' : 1 ] most affected pool [ 'rbd' : 1 ])" in cluster log
2022-05-09T05:20:06.882 INFO:scrape:1 jobs: ['6824142']
2022-05-09T05:20:06.882 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'krbd/rbd/{bluestore-bitmap', 'ms_mode/crc$/{crc}', 'msgr-failures/many', 'tasks/rbd_workunit_suites_ffsb}']
2022-05-09T05:20:06.883 INFO:scrape:
2022-05-09T05:20:06.883 INFO:scrape:Failure: Cannot connect to remote host smithi141
2022-05-09T05:20:06.883 INFO:scrape:1 jobs: ['6824261']
2022-05-09T05:20:06.884 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/legacy$/{legacy}', 'msgr-failures/many', 'tasks/rbd_concurrent}']
2022-05-09T05:20:06.884 INFO:scrape:
2022-05-09T05:20:06.885 INFO:scrape:Failure: Command failed on smithi114 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/exclude0gsmc5ny -r -- '-g auto -g blockdev -x clone'"
2022-05-09T05:20:06.885 INFO:scrape:1 jobs: ['6824129']
2022-05-09T05:20:06.886 INFO:scrape:suites: ['conf', 'krbd/singleton/{bluestore-bitmap', 'ms_mode$/{legacy}', 'msgr-failures/few', 'tasks/rbd_xfstests}']
2022-05-09T05:20:06.886 INFO:scrape:
2022-05-09T05:20:06.894 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi
=================================================================
info:    http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/
failed:  50
dead:    0
running: 0
waiting: 0
queued:  0
passed:  172


Fail
=================================================================
[6824127]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_fio}
-----------------------------------------------------------------
time:   00:18:46
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824127/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824127/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c907e92539d744d3aab5c98003400c59

    "2022-05-09T00:37:39.003079+0000 mon.a (mon.0) 197 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824129]  krbd/singleton/{bluestore-bitmap conf ms_mode$/{legacy} msgr-failures/few tasks/rbd_xfstests}
-----------------------------------------------------------------
time:   04:26:22
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824129/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824129/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f1e69a3a54894833b2ce9653707ecc01

    Command failed on smithi114 with status 1: "/usr/bin/sudo
    TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage /bin/bash
    /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s
    /dev/rbd1 -x /tmp/exclude0gsmc5ny -r -- '-g auto -g blockdev -x clone'"

[6824131]  krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824131/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824131/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5b073cfbf7084ddeb9770d73f4483344

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&re
    f=nightly_pre-single-major

[6824134]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_kernel_untar_build}
-----------------------------------------------------------------
time:   00:18:46
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824134/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824134/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a999e8ff39cf4985b23f6c13ddee204d

    "2022-05-09T00:32:02.699140+0000 mon.a (mon.0) 165 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6824136]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_huge_osdmap}
-----------------------------------------------------------------
time:   00:18:36
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824136/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824136/
sentry: https://sentry.ceph.com/organizations/ceph/?query=805210b81e924f409428189928267a34

    "2022-05-09T00:32:50.420701+0000 mon.a (mon.0) 197 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6824141]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_namespaces}
-----------------------------------------------------------------
time:   00:18:39
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824141/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824141/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d7b9eeddcd0a4c69a080631b4a958398

    "2022-05-09T00:50:18.912374+0000 mon.a (mon.0) 248 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824142]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_ffsb}
-----------------------------------------------------------------
time:   01:12:03
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824142/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824142/

    "2022-05-09T01:23:30.023378+0000 osd.3 (osd.3) 3 : cluster [WRN] 1 slow
    requests (by type [ 'waiting for sub ops' : 1 ] most affected pool [ 'rbd'
    : 1 ])" in cluster log

[6824144]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_udev_netlink_enobufs}
-----------------------------------------------------------------
time:   00:18:36
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824144/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824144/
sentry: https://sentry.ceph.com/organizations/ceph/?query=73020ea36bcf4e8e932d75917d50ca3f

    "2022-05-09T00:45:07.054545+0000 mon.a (mon.0) 120 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6824146]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netns}
-----------------------------------------------------------------
time:   00:18:15
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824146/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824146/
sentry: https://sentry.ceph.com/organizations/ceph/?query=60e0ea7a0a9b48c09554f3fe7cb6ddbe

    "2022-05-09T00:56:17.344024+0000 mon.a (mon.0) 310 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824150]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4}
-----------------------------------------------------------------
time:   00:18:26
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824150/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824150/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3b361328c5584469b919354bc8760472

    "2022-05-09T00:55:43.835673+0000 mon.a (mon.0) 114 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6824158]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_kernel}
-----------------------------------------------------------------
time:   00:19:11
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824158/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824158/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cc152c829f344f3e9bd6de92411c2f82

    "2022-05-09T01:03:34.588654+0000 mon.a (mon.0) 114 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6824159]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_iozone}
-----------------------------------------------------------------
time:   00:18:44
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824159/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824159/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b27e7ba12eed4a11bb58605a3b033584

    "2022-05-09T01:15:12.332177+0000 mon.a (mon.0) 303 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824161]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_map_unmap}
-----------------------------------------------------------------
time:   00:18:30
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824161/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824161/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5782e66ac59048d7bcbd8e57e577fa2b

    "2022-05-09T01:16:09.433996+0000 mon.a (mon.0) 326 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824166]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio}
-----------------------------------------------------------------
time:   00:18:41
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824166/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824166/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dff6419ecadb43359123533ad7a9aa95

    "2022-05-09T01:18:32.800678+0000 mon.a (mon.0) 138 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6824167]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_data_pool}
-----------------------------------------------------------------
time:   00:18:30
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824167/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824167/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3e28699ac4944f43acfac3b01ef06d39

    "2022-05-09T01:29:00.357130+0000 mon.a (mon.0) 274 : cluster [WRN] Health
    check failed: 2 osds down (OSD_DOWN)" in cluster log

[6824170]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_fallocate}
-----------------------------------------------------------------
time:   00:18:36
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824170/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824170/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7a1dd1d056f5495093e3f503b2fa57fc

    "2022-05-09T01:32:46.411815+0000 mon.a (mon.0) 275 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824178]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate}
-----------------------------------------------------------------
time:   00:18:57
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824178/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824178/
sentry: https://sentry.ceph.com/organizations/ceph/?query=42d9874b2b39448fbeade5e609c719c0

    "2022-05-09T01:39:08.428631+0000 mon.a (mon.0) 240 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824181]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_netns}
-----------------------------------------------------------------
time:   00:18:29
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824181/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824181/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2ce59e3ac2fa4b69a379fc8e58b3afbb

    "2022-05-09T01:29:16.254503+0000 mon.a (mon.0) 111 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6824187]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_concurrent}
-----------------------------------------------------------------
time:   00:18:40
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824187/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824187/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c60f7bd7e68c489288a2849d62b467cc

    "2022-05-09T01:48:15.546166+0000 mon.a (mon.0) 326 : cluster [WRN] Health
    check failed: 2 osds down (OSD_DOWN)" in cluster log

[6824190]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read}
-----------------------------------------------------------------
time:   00:19:22
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824190/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824190/
sentry: https://sentry.ceph.com/organizations/ceph/?query=049cea3495074ff794844d41e5b6b3f6

    "2022-05-09T01:54:25.087879+0000 mon.a (mon.0) 273 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824195]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_map_snapshot_io}
-----------------------------------------------------------------
time:   00:18:47
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824195/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824195/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d772327c583a4ac5b33dfa316c36ec86

    "2022-05-09T01:55:26.493098+0000 mon.a (mon.0) 251 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824204]  krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets}
-----------------------------------------------------------------
time:   00:18:46
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824204/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824204/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cb9c4258383a4e988d3ccb584cddf91d

    "2022-05-09T02:01:09.667640+0000 mon.a (mon.0) 311 : cluster [WRN] Health
    check failed: 2 osds down (OSD_DOWN)" in cluster log

[6824206]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_kernel_untar_build}
-----------------------------------------------------------------
time:   00:18:54
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824206/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824206/
sentry: https://sentry.ceph.com/organizations/ceph/?query=04e946d5aac44607b31a469dfb092b96

    "2022-05-09T01:53:53.358497+0000 mon.a (mon.0) 226 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6824208]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_huge_osdmap}
-----------------------------------------------------------------
time:   00:19:06
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824208/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824208/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3c3bfea1057d41bbaa7dd74a5934924a

    "2022-05-09T02:03:59.199534+0000 mon.a (mon.0) 225 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824217]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netlink_enobufs}
-----------------------------------------------------------------
time:   00:18:14
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824217/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824217/
sentry: https://sentry.ceph.com/organizations/ceph/?query=61ffdee743764bf4a3b833745dbb6e8d

    "2022-05-09T01:59:58.752451+0000 mon.a (mon.0) 162 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6824223]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4}
-----------------------------------------------------------------
time:   00:18:55
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824223/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824223/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9f0ef0c169cd47fb8759a1777ed8bbbe

    "2022-05-09T02:14:35.354369+0000 mon.a (mon.0) 267 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824225]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_huge_tickets}
-----------------------------------------------------------------
time:   00:19:35
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824225/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824225/
sentry: https://sentry.ceph.com/organizations/ceph/?query=727263dd6ab449be9b915f24ab0df0ac

    "2022-05-09T02:23:20.751844+0000 mon.a (mon.0) 246 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824230]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_kernel}
-----------------------------------------------------------------
time:   00:19:36
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824230/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824230/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e4cbb32b43244e80aaf4c3a561eb923a

    "2022-05-09T02:13:03.650365+0000 mon.a (mon.0) 143 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6824233]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_map_unmap}
-----------------------------------------------------------------
time:   00:19:00
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824233/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824233/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a5ae04ef31e6498994b95a2d23dbd5c1

    "2022-05-09T02:24:45.395756+0000 mon.a (mon.0) 309 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824235]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_simple_big}
-----------------------------------------------------------------
time:   00:18:37
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824235/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824235/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2af4c1e6040d4981b6aaa5a05e3df06b

    "2022-05-09T02:24:28.847054+0000 mon.a (mon.0) 251 : cluster [WRN] Health
    check failed: 3 osds down (OSD_DOWN)" in cluster log

[6824240]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_data_pool}
-----------------------------------------------------------------
time:   00:18:35
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824240/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824240/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6b74d6929b4d4efca2c6c395ac94e93b

    "2022-05-09T02:20:20.670630+0000 mon.a (mon.0) 131 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6824241]  krbd/singleton/{bluestore-bitmap conf ms_mode$/{secure} msgr-failures/many tasks/rbd_xfstests}
-----------------------------------------------------------------
time:   00:18:37
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824241/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824241/
sentry: https://sentry.ceph.com/organizations/ceph/?query=35f5816b7f1943b8a1f7444465ef362d

    "2022-05-09T02:31:41.588771+0000 mon.a (mon.0) 199 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824244]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_kernel_untar_build}
-----------------------------------------------------------------
time:   00:18:36
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824244/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824244/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3f8fe4a4cf7449a3b70066b6f168f235

    "2022-05-09T02:32:57.504666+0000 mon.a (mon.0) 272 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824255]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:18:51
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824255/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824255/
sentry: https://sentry.ceph.com/organizations/ceph/?query=99bd753fe4924616b61cdaf4c115d8fe

    "2022-05-09T02:42:58.400575+0000 mon.a (mon.0) 224 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824256]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netns}
-----------------------------------------------------------------
time:   00:18:58
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824256/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824256/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8822ae4725554b52b546590b463315d3

    "2022-05-09T02:32:27.779988+0000 mon.a (mon.0) 143 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6824258]  krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client}
-----------------------------------------------------------------
time:   00:18:54
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824258/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824258/
sentry: https://sentry.ceph.com/organizations/ceph/?query=85675361728048aba30d46f9486ef2ae

    "2022-05-09T02:45:28.587870+0000 mon.a (mon.0) 340 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824261]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_concurrent}
-----------------------------------------------------------------
time:   02:49:56
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824261/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824261/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8f5b7b0e0c744bdb9ce8cee4db3d2b32

    Cannot connect to remote host smithi141

[6824263]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsx}
-----------------------------------------------------------------
time:   00:18:48
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824263/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824263/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e978803e689443bb909693dc98ba3c9d

    "2022-05-09T02:48:32.644711+0000 mon.a (mon.0) 328 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824264]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_image_read}
-----------------------------------------------------------------
time:   00:18:24
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824264/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824264/
sentry: https://sentry.ceph.com/organizations/ceph/?query=79a0a021b8a44b558fb6115e262852d8

    "2022-05-09T02:38:31.124240+0000 mon.a (mon.0) 119 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6824270]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_snapshot_io}
-----------------------------------------------------------------
time:   00:18:55
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824270/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824270/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7d74be35d19c4b04b26a2c2dcd8cec32

    "2022-05-09T02:54:06.894313+0000 mon.a (mon.0) 207 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824280]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_exclusive_option}
-----------------------------------------------------------------
time:   00:18:50
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824280/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824280/
sentry: https://sentry.ceph.com/organizations/ceph/?query=633ff88450da4e98b77f71e7db5890b7

    "2022-05-09T02:59:12.514263+0000 mon.a (mon.0) 240 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824281]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_kernel_untar_build}
-----------------------------------------------------------------
time:   00:18:30
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824281/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824281/
sentry: https://sentry.ceph.com/organizations/ceph/?query=611cfa6c7f5947b199aee1598af94dde

    "2022-05-09T03:00:25.779430+0000 mon.a (mon.0) 224 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824288]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_namespaces}
-----------------------------------------------------------------
time:   00:18:33
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824288/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824288/
sentry: https://sentry.ceph.com/organizations/ceph/?query=607b0afd361044d499b29d409e84b94f

    "2022-05-09T03:05:29.405570+0000 mon.a (mon.0) 262 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824297]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_symlinks}
-----------------------------------------------------------------
time:   00:18:30
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824297/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824297/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c33b059d8fb64fe9b852596008b2834f

    "2022-05-09T03:13:40.749415+0000 mon.a (mon.0) 237 : cluster [WRN] Health
    check failed: 2 osds down (OSD_DOWN)" in cluster log

[6824298]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4}
-----------------------------------------------------------------
time:   00:18:36
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824298/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824298/
sentry: https://sentry.ceph.com/organizations/ceph/?query=adba1798ce9d49ba85f658c3a0a9638a

    "2022-05-09T03:05:32.947919+0000 mon.a (mon.0) 184 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6824300]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_huge_tickets}
-----------------------------------------------------------------
time:   00:18:42
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824300/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824300/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f84c9047837c4ca1ade25d023df875f8

    "2022-05-09T03:16:45.143695+0000 mon.a (mon.0) 231 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824308]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_unmap}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824308/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824308/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3fe10f5d143846e7b0a99b2b73b8e82b

    Command failed on smithi123 with status 128: 'cd /lib/firmware/updates &&
    sudo git fetch origin && sudo git reset --hard origin/main'

[6824316]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_fio}
-----------------------------------------------------------------
time:   00:19:00
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824316/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824316/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c6395e6585094fc99d8d7277fa427fa3

    "2022-05-09T03:26:29.812195+0000 mon.a (mon.0) 235 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6824317]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_data_pool}
-----------------------------------------------------------------
time:   00:18:29
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824317/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824317/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6ba2facb126041c8a155f9f3470ccb23

    "2022-05-09T03:29:09.370072+0000 mon.a (mon.0) 302 : cluster [WRN] Health
    check failed: 2 osds down (OSD_DOWN)" in cluster log

[6824332]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_udev_netns}
-----------------------------------------------------------------
time:   00:18:30
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824332/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824332/
sentry: https://sentry.ceph.com/organizations/ceph/?query=664887f2c6794832afd4dbb9eb4e3ed5

    "2022-05-09T03:40:09.861148+0000 mon.a (mon.0) 227 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log



Pass
=================================================================
[6824124] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_deep_flatten}
time:   00:09:14
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824124/

[6824125] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client}
time:   00:18:51
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824125/

[6824126] krbd/ms_modeless/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/krbd_default_map_options}
time:   00:09:48
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824126/

[6824128] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_data_pool}
time:   00:18:05
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824128/

[6824130] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/backoff thrashosds-health workloads/rbd_fio}
time:   00:41:21
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824130/

[6824132] krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes}
time:   00:08:14
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824132/

[6824133] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_exclusive_option}
time:   00:11:17
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824133/

[6824135] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_fallocate}
time:   00:10:45
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824135/

[6824137] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_dbench}
time:   00:36:30
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824137/

[6824138] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_latest_osdmap_on_map}
time:   00:13:18
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824138/

[6824139] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_discard}
time:   00:09:10
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824139/

[6824140] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc-rxbounce} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client}
time:   00:16:31
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824140/

[6824143] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_udev_enumerate}
time:   00:38:24
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824143/

[6824145] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsstress}
time:   00:11:05
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824145/

[6824147] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_huge_image}
time:   00:08:08
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824147/

[6824148] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client}
time:   00:21:07
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824148/

[6824149] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_udev_symlinks}
time:   00:11:27
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824149/

[6824151] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_concurrent}
time:   00:15:18
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824151/

[6824152] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_huge_tickets}
time:   00:10:26
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824152/

[6824153] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsx}
time:   00:19:09
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824153/

[6824154] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_image_read}
time:   00:09:50
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824154/

[6824155] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_modprobe}
time:   00:07:58
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824155/

[6824156] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client}
time:   00:15:21
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824156/

[6824157] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb}
time:   00:56:44
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824157/

[6824160] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io}
time:   00:10:33
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824160/

[6824162] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_trivial_sync}
time:   00:11:07
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824162/

[6824163] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_simple_big}
time:   00:22:53
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824163/

[6824164] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_msgr_segments}
time:   00:09:07
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824164/

[6824165] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client}
time:   00:24:18
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824165/

[6824168] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_exclusive_option}
time:   00:10:57
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824168/

[6824169] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_kernel_untar_build}
time:   00:17:53
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824169/

[6824171] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_huge_osdmap}
time:   00:11:43
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824171/

[6824172] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_dbench}
time:   00:37:39
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824172/

[6824173] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_latest_osdmap_on_map}
time:   00:14:27
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824173/

[6824174] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_parent_overlap}
time:   00:08:35
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824174/

[6824175] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client}
time:   00:18:45
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824175/

[6824176] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_namespaces}
time:   00:10:47
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824176/

[6824177] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_ffsb}
time:   00:55:31
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824177/

[6824179] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_udev_netlink_enobufs}
time:   00:14:35
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824179/

[6824180] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsstress}
time:   00:13:06
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824180/

[6824182] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_read_only}
time:   00:08:53
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824182/

[6824183] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client}
time:   00:17:39
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824183/

[6824184] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/pggrow thrashosds-health workloads/rbd_fio}
time:   00:44:47
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824184/

[6824185] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks}
time:   00:10:46
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824185/

[6824186] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4}
time:   00:10:15
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824186/

[6824188] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_huge_tickets}
time:   00:10:14
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824188/

[6824189] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx}
time:   00:20:11
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824189/

[6824191] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_whole_object_zeroout}
time:   00:09:14
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824191/

[6824192] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client}
time:   00:20:17
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824192/

[6824193] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_kernel}
time:   00:10:25
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824193/

[6824194] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_iozone}
time:   00:16:01
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824194/

[6824196] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap}
time:   00:14:46
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824196/

[6824197] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_trivial_sync}
time:   00:11:48
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824197/

[6824198] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_simple_big}
time:   00:24:46
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824198/

[6824199] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_deep_flatten}
time:   00:08:39
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824199/

[6824200] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client}
time:   00:21:13
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824200/

[6824201] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_fio}
time:   00:27:09
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824201/

[6824202] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_data_pool}
time:   00:18:55
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824202/

[6824203] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap}
time:   00:09:04
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824203/

[6824205] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_exclusive_option}
time:   00:11:55
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824205/

[6824207] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_fallocate}
time:   00:11:21
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824207/

[6824209] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_dbench}
time:   00:36:28
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824209/

[6824210] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_latest_osdmap_on_map}
time:   00:13:27
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824210/

[6824211] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_discard}
time:   00:09:20
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824211/

[6824212] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client}
time:   00:16:51
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824212/

[6824213] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb}
time:   01:01:31
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824213/

[6824214] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_namespaces}
time:   00:11:37
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824214/

[6824215] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_ffsb}
time:   01:03:49
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824215/

[6824216] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_udev_enumerate}
time:   00:38:18
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824216/

[6824218] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress}
time:   00:12:04
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824218/

[6824219] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_udev_netns}
time:   00:10:36
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824219/

[6824220] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_huge_image}
time:   00:08:32
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824220/

[6824221] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client}
time:   00:20:37
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824221/

[6824222] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_udev_symlinks}
time:   00:12:02
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824222/

[6824224] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent}
time:   00:14:52
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824224/

[6824226] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsx}
time:   00:20:03
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824226/

[6824227] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_image_read}
time:   00:11:32
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824227/

[6824228] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_modprobe}
time:   00:08:01
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824228/

[6824229] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client}
time:   00:21:02
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824229/

[6824231] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_iozone}
time:   00:18:23
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824231/

[6824232] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_map_snapshot_io}
time:   00:10:21
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824232/

[6824234] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_trivial_sync}
time:   00:11:33
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824234/

[6824236] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_msgr_segments}
time:   00:08:50
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824236/

[6824237] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client}
time:   00:22:23
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824237/

[6824238] krbd/ms_modeless/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/krbd_rxbounce}
time:   00:10:51
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824238/

[6824239] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_fio}
time:   00:28:02
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824239/

[6824242] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb}
time:   01:04:40
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824242/

[6824243] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_exclusive_option}
time:   00:10:52
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824243/

[6824245] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_fallocate}
time:   00:10:45
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824245/

[6824246] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_huge_osdmap}
time:   00:11:11
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824246/

[6824247] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_dbench}
time:   00:36:52
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824247/

[6824248] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_latest_osdmap_on_map}
time:   00:14:23
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824248/

[6824249] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_parent_overlap}
time:   00:08:20
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824249/

[6824250] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client}
time:   00:18:52
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824250/

[6824251] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_namespaces}
time:   00:10:36
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824251/

[6824252] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_ffsb}
time:   00:55:03
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824252/

[6824253] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_udev_enumerate}
time:   00:41:38
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824253/

[6824254] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_udev_netlink_enobufs}
time:   00:14:33
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824254/

[6824257] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only}
time:   00:09:00
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824257/

[6824259] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_udev_symlinks}
time:   00:10:43
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824259/

[6824260] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4}
time:   00:10:11
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824260/

[6824262] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_huge_tickets}
time:   00:10:14
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824262/

[6824265] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_whole_object_zeroout}
time:   00:09:00
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824265/

[6824266] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client}
time:   00:14:30
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824266/

[6824267] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio}
time:   00:36:20
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824267/

[6824268] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_kernel}
time:   00:09:56
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824268/

[6824269] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_iozone}
time:   00:15:29
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824269/

[6824271] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_map_unmap}
time:   00:14:36
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824271/

[6824272] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_trivial_sync}
time:   00:11:44
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824272/

[6824273] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_simple_big}
time:   00:23:36
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824273/

[6824274] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_deep_flatten}
time:   00:08:42
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824274/

[6824275] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client}
time:   00:24:35
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824275/

[6824276] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_fio}
time:   00:27:14
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824276/

[6824277] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_data_pool}
time:   00:18:43
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824277/

[6824278] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap}
time:   00:08:39
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824278/

[6824279] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets}
time:   00:20:22
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824279/

[6824282] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_fallocate}
time:   00:10:31
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824282/

[6824283] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_huge_osdmap}
time:   00:11:09
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824283/

[6824284] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_dbench}
time:   00:36:55
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824284/

[6824285] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_latest_osdmap_on_map}
time:   00:12:53
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824285/

[6824286] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard}
time:   00:08:59
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824286/

[6824287] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client}
time:   00:14:40
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824287/

[6824289] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_ffsb}
time:   01:04:40
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824289/

[6824290] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_enumerate}
time:   00:38:24
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824290/

[6824291] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_udev_netlink_enobufs}
time:   00:14:23
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824291/

[6824292] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsstress}
time:   00:11:27
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824292/

[6824293] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_udev_netns}
time:   00:10:35
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824293/

[6824294] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_huge_image}
time:   00:08:10
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824294/

[6824295] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client}
time:   00:20:01
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824295/

[6824296] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb}
time:   00:59:48
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824296/

[6824299] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_concurrent}
time:   00:15:06
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824299/

[6824301] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsx}
time:   00:18:48
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824301/

[6824302] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_image_read}
time:   00:10:09
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824302/

[6824303] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_modprobe}
time:   00:08:08
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824303/

[6824304] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client}
time:   00:19:01
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824304/

[6824305] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_kernel}
time:   00:10:16
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824305/

[6824306] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_iozone}
time:   00:16:48
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824306/

[6824307] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_map_snapshot_io}
time:   00:09:32
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824307/

[6824309] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_trivial_sync}
time:   00:11:15
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824309/

[6824310] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_simple_big}
time:   00:22:23
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824310/

[6824312] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_msgr_segments}
time:   00:08:30
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824312/

[6824314] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client}
time:   00:25:40
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824314/

[6824318] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_exclusive_option}
time:   00:10:41
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824318/

[6824319] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_kernel_untar_build}
time:   00:17:44
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824319/

[6824320] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_fallocate}
time:   00:11:18
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824320/

[6824321] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_huge_osdmap}
time:   00:11:10
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824321/

[6824322] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_dbench}
time:   00:37:48
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824322/

[6824323] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_latest_osdmap_on_map}
time:   00:14:40
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824323/

[6824324] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_parent_overlap}
time:   00:08:30
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824324/

[6824325] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client}
time:   00:16:09
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824325/

[6824326] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/rbd_fio}
time:   00:40:47
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824326/

[6824327] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_namespaces}
time:   00:10:37
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824327/

[6824328] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_ffsb}
time:   00:54:14
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824328/

[6824329] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_enumerate}
time:   00:42:01
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824329/

[6824330] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netlink_enobufs}
time:   00:14:40
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824330/

[6824331] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress}
time:   00:13:01
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824331/

[6824333] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_read_only}
time:   00:09:09
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824333/

[6824334] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc-rxbounce} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client}
time:   00:21:37
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824334/

[6824335] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_udev_symlinks}
time:   00:10:58
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824335/

[6824336] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4}
time:   00:10:02
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824336/

[6824337] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_concurrent}
time:   00:14:57
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824337/

[6824338] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_huge_tickets}
time:   00:10:06
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824338/

[6824339] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsx}
time:   00:20:25
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824339/

[6824340] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_image_read}
time:   00:10:29
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824340/

[6824341] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_whole_object_zeroout}
time:   00:09:15
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824341/

[6824342] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client}
time:   00:18:34
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824342/

[6824343] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_kernel}
time:   00:10:20
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824343/

[6824344] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_iozone}
time:   00:16:02
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824344/

[6824345] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_map_snapshot_io}
time:   00:10:04
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824345/

[6824346] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_map_unmap}
time:   00:15:28
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824346/

[6824347] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_trivial_sync}
time:   00:11:34
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824347/

[6824348] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_simple_big}
time:   00:27:19
info:   http://pulpito.ceph.com/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824348/