2022-05-15T21:53:04.943 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01
2022-05-15T21:53:04.944 INFO:teuthology.results:seed: '903'
2022-05-16T01:23:00.437 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01
2022-05-16T01:23:00.466 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-05-16T03:47:13.759 INFO:teuthology.results:Tests finished! gathering results...
2022-05-16T03:47:30.343 INFO:scrape:Found 221 jobs
2022-05-16T03:47:38.480 INFO:scrape:Found 5 distinct failure reasons
2022-05-16T03:47:38.481 INFO:scrape:Failure: "2022-05-15T22:36:41.952741+0000 mon.a (mon.0) 198 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log
2022-05-16T03:47:38.482 INFO:scrape:42 jobs
2022-05-16T03:47:38.482 INFO:scrape:suites intersection: ['conf']
2022-05-16T03:47:38.483 INFO:scrape:suites union: ['clusters/3-node', 'clusters/fixed-3', 'conf', 'features/no-object-map', 'install/ceph', 'krbd/fsx/{ceph/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'krbd/rbd/{bluestore-bitmap', 'krbd/singleton/{bluestore-bitmap', 'ms_mode$/{legacy}', 'ms_mode$/{secure}', 'ms_mode/crc$/{crc-rxbounce}', 'ms_mode/crc$/{crc}', 'ms_mode/legacy$/{legacy-rxbounce}', 'ms_mode/legacy$/{legacy}', 'ms_mode/secure', 'msgr-failures/few', 'msgr-failures/many', 'objectstore/bluestore-bitmap', 'randomized-striping-off}', 'striping/default/{msgr-failures/many', 'tasks/fsx-3-client}', 'tasks/krbd_exclusive_option}', 'tasks/krbd_fallocate}', 'tasks/krbd_huge_osdmap}', 'tasks/krbd_latest_osdmap_on_map}', 'tasks/krbd_namespaces}', 'tasks/krbd_udev_enumerate}', 'tasks/krbd_udev_netlink_enobufs}', 'tasks/krbd_udev_netns}', 'tasks/krbd_udev_symlinks}', 'tasks/rbd_concurrent}', 'tasks/rbd_fio}', 'tasks/rbd_huge_tickets}', 'tasks/rbd_image_read}', 'tasks/rbd_kernel}', 'tasks/rbd_map_snapshot_io}', 'tasks/rbd_map_unmap}', 'tasks/rbd_simple_big}', 'tasks/rbd_workunit_kernel_untar_build}', 'tasks/rbd_workunit_suites_dbench}', 'tasks/rbd_workunit_suites_ffsb}', 'tasks/rbd_workunit_suites_fsstress_ext4}', 'tasks/rbd_workunit_suites_fsstress}', 'tasks/rbd_workunit_suites_fsx}', 'tasks/rbd_workunit_suites_iozone}', 'tasks/rbd_xfstests}']
2022-05-16T03:47:38.483 INFO:scrape:
2022-05-16T03:47:38.484 INFO:scrape:Failure: Command failed on smithi097 with status 1: 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t'
2022-05-16T03:47:38.484 INFO:scrape:1 jobs: ['6835271']
2022-05-16T03:47:38.485 INFO:scrape:suites: ['clusters/separate-client', 'conf', 'filestore-xfs', 'kernels/single-major-on', 'krbd/unmap/{ceph/ceph', 'tasks/unmap}']
2022-05-16T03:47:38.485 INFO:scrape:
2022-05-16T03:47:38.486 INFO:scrape:Failure: {'smithi018.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False, 'cache_valid_time': 0, 'deb': None, 'default_release': None, 'dpkg_options': 'force-confdef,force-confold', 'force': False, 'force_apt_get': False, 'install_recommends': None, 'only_upgrade': False, 'package': None, 'policy_rc_d': None, 'purge': False, 'state': 'present', 'update_cache': True, 'update_cache_retries': 5, 'update_cache_retry_max_delay': 12, 'upgrade': None}}, 'msg': 'Failed to update apt cache: unknown reason'}}
2022-05-16T03:47:38.486 INFO:scrape:1 jobs: ['6835230']
2022-05-16T03:47:38.486 INFO:scrape:suites: ['clusters/3-node', 'conf', 'features/object-map', 'krbd/fsx/{ceph/ceph', 'ms_mode$/{legacy-rxbounce}', 'objectstore/bluestore-bitmap', 'randomized-striping-off}', 'striping/default/{msgr-failures/few', 'tasks/fsx-1-client}']
2022-05-16T03:47:38.487 INFO:scrape:
2022-05-16T03:47:38.487 INFO:scrape:Failure: "2022-05-16T03:19:43.019639+0000 osd.3 (osd.3) 3 : cluster [WRN] 2 slow requests (by type [ 'started' : 2 ] most affected pool [ 'rbd' : 2 ])" in cluster log
2022-05-16T03:47:38.488 INFO:scrape:2 jobs: ['6835327', '6835165']
2022-05-16T03:47:38.488 INFO:scrape:suites intersection: ['clusters/fixed-3', 'conf', 'msgr-failures/many']
2022-05-16T03:47:38.488 INFO:scrape:suites union: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'krbd/rbd/{bluestore-bitmap', 'ms_mode/legacy$/{legacy}', 'ms_mode/secure', 'msgr-failures/many', 'tasks/rbd_concurrent}', 'tasks/rbd_workunit_suites_dbench}']
2022-05-16T03:47:38.489 INFO:scrape:
2022-05-16T03:47:38.489 INFO:scrape:Failure: Command failed on smithi053 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludeab0ihoxk -r -- '-g auto -g blockdev -x clone'"
2022-05-16T03:47:38.490 INFO:scrape:1 jobs: ['6835123']
2022-05-16T03:47:38.490 INFO:scrape:suites: ['conf', 'krbd/singleton/{bluestore-bitmap', 'ms_mode$/{crc}', 'msgr-failures/few', 'tasks/rbd_xfstests}']
2022-05-16T03:47:38.491 INFO:scrape:
2022-05-16T03:47:38.498 INFO:teuthology.results:Sending results to idryomov@gmail.com: Test Run: dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi
=================================================================
info:    http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/
failed:  46
dead:    1
running: 0
waiting: 0
queued:  0
passed:  174


Fail
=================================================================
[6835123]  krbd/singleton/{bluestore-bitmap conf ms_mode$/{crc} msgr-failures/few tasks/rbd_xfstests}
-----------------------------------------------------------------
time:   04:36:29
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835123/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835123/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d36f4b57c9e64112aa39c8772afd4911

    Command failed on smithi053 with status 1: "/usr/bin/sudo
    TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage /bin/bash
    /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s
    /dev/rbd1 -x /tmp/excludeab0ihoxk -r -- '-g auto -g blockdev -x clone'"

[6835126]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_exclusive_option}
-----------------------------------------------------------------
time:   00:21:54
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835126/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835126/
sentry: https://sentry.ceph.com/organizations/ceph/?query=630e8ccbea6e496ba4262f7e1f64e47a

    "2022-05-15T22:22:56.761758+0000 mon.a (mon.0) 195 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6835137]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_udev_netlink_enobufs}
-----------------------------------------------------------------
time:   00:21:38
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835137/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835137/
sentry: https://sentry.ceph.com/organizations/ceph/?query=80946c3c75644c098216cccca5474f14

    "2022-05-15T22:44:26.008389+0000 mon.a (mon.0) 237 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835142]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_udev_symlinks}
-----------------------------------------------------------------
time:   00:22:32
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835142/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835142/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3aece20bc3a94f239d3d49fc18b6dcff

    "2022-05-15T22:36:41.952741+0000 mon.a (mon.0) 198 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6835152]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_iozone}
-----------------------------------------------------------------
time:   00:21:55
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835152/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835152/
sentry: https://sentry.ceph.com/organizations/ceph/?query=feb5e7b7db204c1abb879cbc1b0d5a29

    "2022-05-15T22:58:46.432283+0000 mon.a (mon.0) 270 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835154]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_map_unmap}
-----------------------------------------------------------------
time:   00:21:42
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835154/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835154/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2d3d6d925a444a2ca5fac3787693e1ec

    "2022-05-15T23:01:32.947896+0000 mon.a (mon.0) 247 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835163]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_fallocate}
-----------------------------------------------------------------
time:   00:21:47
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835163/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835163/
sentry: https://sentry.ceph.com/organizations/ceph/?query=97a8c574680c4aec959d746e3c0fa9c8

    "2022-05-15T22:59:52.320841+0000 mon.a (mon.0) 134 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6835165]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_dbench}
-----------------------------------------------------------------
time:   00:40:25
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835165/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835165/

    "2022-05-15T23:11:02.562480+0000 osd.3 (osd.3) 3 : cluster [WRN] 2 slow
    requests (by type [ 'waiting for sub ops' : 2 ] most affected pool [ 'rbd'
    : 2 ])" in cluster log

[6835174]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_udev_netns}
-----------------------------------------------------------------
time:   00:21:46
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835174/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835174/
sentry: https://sentry.ceph.com/organizations/ceph/?query=311fb9ce7b444577b27d82b8fbd11d9d

    "2022-05-15T23:21:54.381028+0000 mon.a (mon.0) 281 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835182]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx}
-----------------------------------------------------------------
time:   00:21:53
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835182/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835182/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cb01178ee0b84cb3a3b4ac3a67c84e65

    "2022-05-15T23:28:49.694872+0000 mon.a (mon.0) 282 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835188]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_map_snapshot_io}
-----------------------------------------------------------------
time:   00:21:48
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835188/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835188/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2590f8f0d26c4469b94984059418271d

    "2022-05-15T23:35:25.824797+0000 mon.a (mon.0) 218 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835191]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_simple_big}
-----------------------------------------------------------------
time:   00:21:58
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835191/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835191/
sentry: https://sentry.ceph.com/organizations/ceph/?query=937193ad2da94e41b7c6a8c2235699a2

    "2022-05-15T23:29:24.972246+0000 mon.a (mon.0) 141 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6835216]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4}
-----------------------------------------------------------------
time:   00:23:18
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835216/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835216/
sentry: https://sentry.ceph.com/organizations/ceph/?query=eb86367f035b48b3a40b882a63e4651c

    "2022-05-16T00:05:34.932500+0000 mon.a (mon.0) 234 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835218]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_huge_tickets}
-----------------------------------------------------------------
time:   00:23:03
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835218/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835218/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fb22258a951d4ab78274197117603e8c

    "2022-05-16T00:06:00.561866+0000 mon.a (mon.0) 297 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835223]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_kernel}
-----------------------------------------------------------------
time:   00:22:01
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835223/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835223/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e6001a99efa94d648fafb86b0b489e51

    "2022-05-16T00:06:43.569056+0000 mon.a (mon.0) 324 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835224]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_iozone}
-----------------------------------------------------------------
time:   00:22:14
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835224/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835224/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b4a1b4666e5246129affb7e18331fc88

    "2022-05-15T23:57:52.104427+0000 mon.a (mon.0) 159 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6835234]  krbd/singleton/{bluestore-bitmap conf ms_mode$/{legacy} msgr-failures/many tasks/rbd_xfstests}
-----------------------------------------------------------------
time:   00:21:16
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835234/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835234/
sentry: https://sentry.ceph.com/organizations/ceph/?query=de5ff925d010439c8ddf3b5b64fde2ca

    "2022-05-16T00:06:16.810985+0000 mon.a (mon.0) 97 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)"
    in cluster log

[6835239]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_huge_osdmap}
-----------------------------------------------------------------
time:   00:21:58
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835239/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835239/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a2583ab366984ebd83d8cd96f883ae90

    "2022-05-16T00:10:33.785414+0000 mon.a (mon.0) 192 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6835240]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_dbench}
-----------------------------------------------------------------
time:   00:21:47
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835240/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835240/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c071a55f96a049b0a6580329047cacd1

    "2022-05-16T00:12:32.393609+0000 mon.a (mon.0) 163 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)"
    in cluster log

[6835241]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_latest_osdmap_on_map}
-----------------------------------------------------------------
time:   00:21:57
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835241/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835241/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c335e7adfdbe4fe99d29ad697f944295

    "2022-05-16T00:24:09.107534+0000 mon.a (mon.0) 305 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835245]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_ffsb}
-----------------------------------------------------------------
time:   00:21:50
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835245/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835245/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ee4970c99df8438aa95c816948dc8de1

    "2022-05-16T00:24:39.699087+0000 mon.a (mon.0) 290 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835246]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_udev_enumerate}
-----------------------------------------------------------------
time:   00:21:43
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835246/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835246/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ca9ec8c4544049c19a95a450d05bb81c

    "2022-05-16T00:30:06.306103+0000 mon.a (mon.0) 261 : cluster [WRN] Health
    check failed: 2 osds down (OSD_DOWN)" in cluster log

[6835248]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:22:01
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835248/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835248/
sentry: https://sentry.ceph.com/organizations/ceph/?query=618deda2052a42ea87179068a0556335

    "2022-05-16T00:32:01.770507+0000 mon.a (mon.0) 226 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835253]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4}
-----------------------------------------------------------------
time:   00:22:16
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835253/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835253/
sentry: https://sentry.ceph.com/organizations/ceph/?query=88389fed73114fbea29975ac86095fa3

    "2022-05-16T00:37:39.450041+0000 mon.a (mon.0) 206 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835254]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_concurrent}
-----------------------------------------------------------------
time:   00:21:52
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835254/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835254/
sentry: https://sentry.ceph.com/organizations/ceph/?query=761887846bfa40ff9cdcc0db1cbe0f16

    "2022-05-16T00:40:17.718320+0000 mon.a (mon.0) 279 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835256]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_fsx}
-----------------------------------------------------------------
time:   00:22:19
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835256/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835256/
sentry: https://sentry.ceph.com/organizations/ceph/?query=07ca801cec4b43daa7b57600cc2823a8

    "2022-05-16T00:31:31.976121+0000 mon.a (mon.0) 120 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6835271]  krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap}
-----------------------------------------------------------------
time:   00:11:58
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835271/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835271/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e72b680abd3646a6842554bce05d07ea

    Command failed on smithi097 with status 1: 'CEPH_REF=master CEPH_ID="0"
    PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage
    /home/ubuntu/cephtest/virtualenv/bin/cram -v --
    /home/ubuntu/cephtest/archive/cram.client.0/*.t'

[6835273]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_exclusive_option}
-----------------------------------------------------------------
time:   00:21:59
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835273/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835273/
sentry: https://sentry.ceph.com/organizations/ceph/?query=08424ccea2a6469096380c263b978974

    "2022-05-16T00:53:09.611697+0000 mon.a (mon.0) 299 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835274]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_kernel_untar_build}
-----------------------------------------------------------------
time:   00:22:06
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835274/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835274/
sentry: https://sentry.ceph.com/organizations/ceph/?query=511beece4d334cc6b0ab975be88e9ab6

    "2022-05-16T00:54:17.348221+0000 mon.a (mon.0) 243 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835281]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_namespaces}
-----------------------------------------------------------------
time:   00:21:47
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835281/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835281/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c9b316da4d6241368e4aba16627c438a

    "2022-05-16T00:50:23.543760+0000 mon.a (mon.0) 144 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6835284]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_udev_netlink_enobufs}
-----------------------------------------------------------------
time:   00:21:55
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835284/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835284/
sentry: https://sentry.ceph.com/organizations/ceph/?query=56124e1af61642b3b37c9703d5bc24c2

    "2022-05-16T00:53:51.694971+0000 mon.a (mon.0) 120 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6835291]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4}
-----------------------------------------------------------------
time:   00:22:40
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835291/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835291/
sentry: https://sentry.ceph.com/organizations/ceph/?query=568f38923fc04b7886c9829e061a6305

    "2022-05-16T01:12:32.825508+0000 mon.a (mon.0) 324 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835293]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_huge_tickets}
-----------------------------------------------------------------
time:   00:22:46
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835293/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835293/
sentry: https://sentry.ceph.com/organizations/ceph/?query=795b009b56924e079847b77c4bd1bb5c

    "2022-05-16T01:12:47.429742+0000 mon.a (mon.0) 331 : cluster [WRN] Health
    check failed: 2 osds down (OSD_DOWN)" in cluster log

[6835295]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_image_read}
-----------------------------------------------------------------
time:   00:22:29
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835295/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835295/
sentry: https://sentry.ceph.com/organizations/ceph/?query=08ef7980090144669a7949b43a94dcdb

    "2022-05-16T01:12:42.853487+0000 mon.a (mon.0) 217 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835299]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_iozone}
-----------------------------------------------------------------
time:   00:22:26
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835299/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835299/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cb9e75fc835548e7823c5320beb9bebf

    "2022-05-16T01:05:03.960842+0000 mon.a (mon.0) 139 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6835303]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_simple_big}
-----------------------------------------------------------------
time:   00:21:51
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835303/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835303/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ce81399058b940f3a31b95f16dc82a18

    "2022-05-16T01:22:14.371597+0000 mon.a (mon.0) 281 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835306]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_fio}
-----------------------------------------------------------------
time:   00:21:52
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835306/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835306/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d9780d1e614444f2bebf67bdc39f1907

    "2022-05-16T01:25:49.254865+0000 mon.a (mon.0) 283 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835310]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_fallocate}
-----------------------------------------------------------------
time:   00:21:51
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835310/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835310/
sentry: https://sentry.ceph.com/organizations/ceph/?query=325a1452ad3f42389a0a4a8bcef5ae22

    "2022-05-16T01:29:15.478805+0000 mon.a (mon.0) 301 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835312]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_dbench}
-----------------------------------------------------------------
time:   00:21:56
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835312/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835312/
sentry: https://sentry.ceph.com/organizations/ceph/?query=023b61dde9634d318bdd44475af6e1e6

    "2022-05-16T01:29:21.609354+0000 mon.a (mon.0) 205 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835313]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_latest_osdmap_on_map}
-----------------------------------------------------------------
time:   00:22:12
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835313/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835313/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e6674b20885341458ebe0f3a5dd41727

    "2022-05-16T01:31:09.850494+0000 mon.a (mon.0) 274 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835321]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:21:46
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835321/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835321/
sentry: https://sentry.ceph.com/organizations/ceph/?query=217d570bcf1948a4a67654aed844839a

    "2022-05-16T01:26:24.544481+0000 mon.a (mon.0) 137 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6835327]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_concurrent}
-----------------------------------------------------------------
time:   02:22:55
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835327/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835327/

    "2022-05-16T03:19:43.019639+0000 osd.3 (osd.3) 3 : cluster [WRN] 2 slow
    requests (by type [ 'started' : 2 ] most affected pool [ 'rbd' : 2 ])" in
    cluster log

[6835329]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsx}
-----------------------------------------------------------------
time:   00:21:59
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835329/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835329/
sentry: https://sentry.ceph.com/organizations/ceph/?query=284b24b7896f46d0a757c0905d816052

    "2022-05-16T01:36:20.365290+0000 mon.a (mon.0) 172 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6835330]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_image_read}
-----------------------------------------------------------------
time:   00:22:29
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835330/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835330/
sentry: https://sentry.ceph.com/organizations/ceph/?query=38d9677a2678476ca32d8ea61c24942e

    "2022-05-16T01:37:39.113156+0000 mon.a (mon.0) 139 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6835332]  krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client}
-----------------------------------------------------------------
time:   00:21:59
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835332/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835332/
sentry: https://sentry.ceph.com/organizations/ceph/?query=226483916d9645f092bc2e1d779ce7ec

    "2022-05-16T01:47:12.450274+0000 mon.a (mon.0) 252 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6835335]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_map_snapshot_io}
-----------------------------------------------------------------
time:   00:22:16
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835335/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835335/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4396f22a1acc4a4daad06d554b4654f7

    "2022-05-16T01:48:35.591882+0000 mon.a (mon.0) 305 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log



Dead
=================================================================
[6835230]  krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client}
-----------------------------------------------------------------
time:   00:18:55
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835230/
log:    http://qa-proxy.ceph.com/teuthology/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835230/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d1e089dc3462443796b230808f6623a2

    {'smithi018.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts':
    24, 'changed': False, 'invocation': {'module_args':
    {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False,
    'cache_valid_time': 0, 'deb': None, 'default_release': None,
    'dpkg_options': 'force-confdef,force-confold', 'force': False,
    'force_apt_get': False, 'install_recommends': None, 'only_upgrade': False,
    'package': None, 'policy_rc_d': None, 'purge': False, 'state': 'present',
    'update_cache': True, 'update_cache_retries': 5,
    'update_cache_retry_max_delay': 12, 'upgrade': None}}, 'msg': 'Failed to
    update apt cache: unknown reason'}}



Pass
=================================================================
[6835118] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_deep_flatten}
time:   00:11:53
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835118/

[6835119] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client}
time:   00:22:55
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835119/

[6835120] krbd/ms_modeless/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/krbd_default_map_options}
time:   00:13:12
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835120/

[6835121] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_fio}
time:   00:30:50
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835121/

[6835122] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_data_pool}
time:   00:21:36
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835122/

[6835124] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/backoff thrashosds-health workloads/rbd_fio}
time:   00:42:05
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835124/

[6835125] krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes}
time:   00:11:39
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835125/

[6835127] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_kernel_untar_build}
time:   00:21:50
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835127/

[6835128] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_fallocate}
time:   00:14:06
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835128/

[6835129] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_huge_osdmap}
time:   00:14:35
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835129/

[6835130] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_dbench}
time:   00:39:53
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835130/

[6835131] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_latest_osdmap_on_map}
time:   00:17:08
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835131/

[6835132] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_discard}
time:   00:12:44
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835132/

[6835133] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client}
time:   00:20:39
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835133/

[6835134] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_namespaces}
time:   00:14:56
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835134/

[6835135] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_ffsb}
time:   01:09:46
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835135/

[6835136] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_udev_enumerate}
time:   00:44:03
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835136/

[6835138] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_fsstress}
time:   00:15:07
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835138/

[6835139] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netns}
time:   00:14:00
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835139/

[6835140] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_huge_image}
time:   00:11:54
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835140/

[6835141] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client}
time:   00:24:52
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835141/

[6835143] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4}
time:   00:14:10
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835143/

[6835144] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_concurrent}
time:   00:18:20
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835144/

[6835145] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_huge_tickets}
time:   00:13:27
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835145/

[6835146] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_fsx}
time:   00:22:12
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835146/

[6835147] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_image_read}
time:   00:13:37
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835147/

[6835148] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_modprobe}
time:   00:11:34
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835148/

[6835149] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client}
time:   00:19:07
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835149/

[6835150] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb}
time:   00:58:10
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835150/

[6835151] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_kernel}
time:   00:13:38
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835151/

[6835153] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io}
time:   00:12:57
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835153/

[6835155] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_trivial_sync}
time:   00:14:30
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835155/

[6835156] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_simple_big}
time:   00:25:31
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835156/

[6835157] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_msgr_segments}
time:   00:11:31
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835157/

[6835158] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client}
time:   00:25:02
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835158/

[6835159] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio}
time:   00:30:44
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835159/

[6835160] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_data_pool}
time:   00:26:55
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835160/

[6835161] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_exclusive_option}
time:   00:14:13
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835161/

[6835162] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_kernel_untar_build}
time:   00:21:33
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835162/

[6835164] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_huge_osdmap}
time:   00:14:00
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835164/

[6835166] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_latest_osdmap_on_map}
time:   00:17:47
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835166/

[6835167] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_parent_overlap}
time:   00:11:38
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835167/

[6835168] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client}
time:   00:20:20
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835168/

[6835169] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_namespaces}
time:   00:14:36
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835169/

[6835170] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_ffsb}
time:   00:57:11
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835170/

[6835171] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate}
time:   00:45:19
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835171/

[6835172] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_udev_netlink_enobufs}
time:   00:17:34
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835172/

[6835173] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsstress}
time:   00:15:03
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835173/

[6835175] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_read_only}
time:   00:12:04
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835175/

[6835176] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client}
time:   00:19:57
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835176/

[6835177] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/pggrow thrashosds-health workloads/rbd_fio}
time:   00:43:58
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835177/

[6835178] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks}
time:   00:14:23
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835178/

[6835179] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4}
time:   00:13:20
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835179/

[6835180] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_concurrent}
time:   00:18:34
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835180/

[6835181] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_huge_tickets}
time:   00:13:08
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835181/

[6835183] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read}
time:   00:13:43
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835183/

[6835184] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_whole_object_zeroout}
time:   00:11:50
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835184/

[6835185] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client}
time:   00:21:49
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835185/

[6835186] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_kernel}
time:   00:12:57
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835186/

[6835187] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_iozone}
time:   00:19:41
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835187/

[6835189] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap}
time:   00:18:03
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835189/

[6835190] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_trivial_sync}
time:   00:15:51
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835190/

[6835192] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_deep_flatten}
time:   00:12:22
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835192/

[6835193] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client}
time:   00:24:16
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835193/

[6835194] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_fio}
time:   00:31:04
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835194/

[6835195] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_data_pool}
time:   00:21:20
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835195/

[6835196] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap}
time:   00:11:33
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835196/

[6835197] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets}
time:   00:24:21
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835197/

[6835198] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_exclusive_option}
time:   00:14:33
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835198/

[6835199] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_kernel_untar_build}
time:   00:22:14
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835199/

[6835200] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_fallocate}
time:   00:13:47
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835200/

[6835201] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_huge_osdmap}
time:   00:14:36
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835201/

[6835202] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_dbench}
time:   00:39:55
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835202/

[6835203] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_latest_osdmap_on_map}
time:   00:16:32
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835203/

[6835204] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_discard}
time:   00:12:35
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835204/

[6835205] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client}
time:   00:19:42
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835205/

[6835206] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb}
time:   01:01:44
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835206/

[6835207] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_namespaces}
time:   00:14:53
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835207/

[6835208] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_ffsb}
time:   01:09:46
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835208/

[6835209] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_udev_enumerate}
time:   00:41:12
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835209/

[6835210] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netlink_enobufs}
time:   00:17:45
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835210/

[6835211] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress}
time:   00:14:35
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835211/

[6835212] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_udev_netns}
time:   00:13:47
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835212/

[6835213] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_huge_image}
time:   00:11:25
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835213/

[6835214] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client}
time:   00:25:23
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835214/

[6835215] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_symlinks}
time:   00:15:46
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835215/

[6835217] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent}
time:   00:19:31
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835217/

[6835219] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsx}
time:   00:23:47
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835219/

[6835220] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_image_read}
time:   00:14:37
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835220/

[6835221] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_modprobe}
time:   00:12:33
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835221/

[6835222] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client}
time:   00:23:19
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835222/

[6835225] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_map_snapshot_io}
time:   00:13:22
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835225/

[6835226] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_map_unmap}
time:   00:18:13
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835226/

[6835227] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_trivial_sync}
time:   00:14:08
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835227/

[6835228] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_simple_big}
time:   00:28:00
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835228/

[6835229] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_msgr_segments}
time:   00:11:33
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835229/

[6835231] krbd/ms_modeless/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/krbd_rxbounce}
time:   00:13:55
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835231/

[6835232] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_fio}
time:   00:30:56
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835232/

[6835233] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_data_pool}
time:   00:25:48
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835233/

[6835235] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb}
time:   01:05:10
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835235/

[6835236] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_exclusive_option}
time:   00:14:12
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835236/

[6835237] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_kernel_untar_build}
time:   00:20:56
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835237/

[6835238] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_fallocate}
time:   00:14:38
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835238/

[6835242] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_parent_overlap}
time:   00:12:05
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835242/

[6835243] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client}
time:   00:20:43
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835243/

[6835244] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_namespaces}
time:   00:14:46
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835244/

[6835247] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_udev_netlink_enobufs}
time:   00:17:32
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835247/

[6835249] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netns}
time:   00:14:22
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835249/

[6835250] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only}
time:   00:12:30
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835250/

[6835251] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client}
time:   00:29:46
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835251/

[6835252] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_udev_symlinks}
time:   00:14:12
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835252/

[6835255] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_huge_tickets}
time:   00:13:30
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835255/

[6835257] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_image_read}
time:   00:14:49
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835257/

[6835258] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_whole_object_zeroout}
time:   00:12:05
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835258/

[6835259] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client}
time:   00:18:43
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835259/

[6835260] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio}
time:   00:41:16
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835260/

[6835261] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_kernel}
time:   00:13:30
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835261/

[6835262] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_iozone}
time:   00:19:39
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835262/

[6835263] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_snapshot_io}
time:   00:13:04
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835263/

[6835264] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_map_unmap}
time:   00:17:54
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835264/

[6835265] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_trivial_sync}
time:   00:15:32
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835265/

[6835266] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_simple_big}
time:   00:27:47
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835266/

[6835267] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_deep_flatten}
time:   00:12:29
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835267/

[6835268] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client}
time:   00:27:16
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835268/

[6835269] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_fio}
time:   00:30:52
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835269/

[6835270] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_data_pool}
time:   00:22:06
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835270/

[6835272] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets}
time:   00:23:46
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835272/

[6835275] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_fallocate}
time:   00:14:10
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835275/

[6835276] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_huge_osdmap}
time:   00:14:29
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835276/

[6835277] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_dbench}
time:   00:40:01
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835277/

[6835278] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_latest_osdmap_on_map}
time:   00:16:42
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835278/

[6835279] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard}
time:   00:12:49
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835279/

[6835280] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client}
time:   00:18:06
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835280/

[6835282] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_ffsb}
time:   01:05:27
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835282/

[6835283] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_enumerate}
time:   00:41:42
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835283/

[6835285] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_fsstress}
time:   00:14:59
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835285/

[6835286] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_udev_netns}
time:   00:14:04
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835286/

[6835287] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_huge_image}
time:   00:11:27
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835287/

[6835288] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client}
time:   00:23:47
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835288/

[6835289] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb}
time:   01:06:15
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835289/

[6835290] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_symlinks}
time:   00:14:30
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835290/

[6835292] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_concurrent}
time:   00:19:06
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835292/

[6835294] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsx}
time:   00:23:23
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835294/

[6835296] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_modprobe}
time:   00:12:01
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835296/

[6835297] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client}
time:   00:21:16
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835297/

[6835298] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_kernel}
time:   00:13:52
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835298/

[6835300] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_map_snapshot_io}
time:   00:13:01
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835300/

[6835301] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_unmap}
time:   00:18:06
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835301/

[6835302] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_trivial_sync}
time:   00:14:32
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835302/

[6835304] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_msgr_segments}
time:   00:11:41
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835304/

[6835305] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client}
time:   00:26:49
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835305/

[6835307] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_data_pool}
time:   00:25:35
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835307/

[6835308] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_exclusive_option}
time:   00:14:09
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835308/

[6835309] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_kernel_untar_build}
time:   00:21:02
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835309/

[6835311] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_huge_osdmap}
time:   00:14:28
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835311/

[6835314] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_parent_overlap}
time:   00:11:50
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835314/

[6835315] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client}
time:   00:18:58
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835315/

[6835316] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/upmap thrashosds-health workloads/rbd_fio}
time:   00:41:59
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835316/

[6835317] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_namespaces}
time:   00:14:10
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835317/

[6835318] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_ffsb}
time:   00:59:24
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835318/

[6835319] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_enumerate}
time:   00:45:57
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835319/

[6835320] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netlink_enobufs}
time:   00:17:54
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835320/

[6835322] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_udev_netns}
time:   00:13:53
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835322/

[6835323] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_read_only}
time:   00:11:43
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835323/

[6835324] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client}
time:   00:24:00
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835324/

[6835325] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_udev_symlinks}
time:   00:15:04
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835325/

[6835326] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4}
time:   00:14:04
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835326/

[6835328] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_huge_tickets}
time:   00:13:30
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835328/

[6835331] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_whole_object_zeroout}
time:   00:12:20
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835331/

[6835333] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_kernel}
time:   00:13:31
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835333/

[6835334] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_iozone}
time:   00:19:22
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835334/

[6835336] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_map_unmap}
time:   00:18:05
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835336/

[6835337] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_trivial_sync}
time:   00:16:20
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835337/

[6835338] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_simple_big}
time:   00:29:30
info:   http://pulpito.ceph.com/dis-2022-05-15_21:50:43-krbd-quincy-wip-fix-linger-resend-default-smithi/6835338/