2021-10-08T19:38:25.609 INFO:root:teuthology version: 1.1.0-6f40c4ca
2021-10-08T19:38:25.611 INFO:teuthology.results:seed: '5921'
2021-10-09T07:01:36.922 INFO:root:teuthology version: 1.1.0-6f40c4ca
2021-10-09T07:01:36.949 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-10-09T09:14:46.984 INFO:teuthology.results:Tests finished! gathering results...
2021-10-09T09:15:00.559 INFO:scrape:Found 220 jobs
2021-10-09T09:15:00.560 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426741/teuthology.log
2021-10-09T09:15:10.183 INFO:scrape:Found 6 distinct failure reasons
2021-10-09T09:15:10.184 INFO:scrape:Dead: None
2021-10-09T09:15:10.184 INFO:scrape:67 jobs
2021-10-09T09:15:10.185 INFO:scrape:
2021-10-09T09:15:10.185 INFO:scrape:Failure: "2021-10-09T05:54:51.007722+0000 mon.a (mon.0) 144 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log
2021-10-09T09:15:10.186 INFO:scrape:31 jobs
2021-10-09T09:15:10.186 INFO:scrape:suites intersection: ['conf']
2021-10-09T09:15:10.187 INFO:scrape:suites union: ['ceph/ceph', 'clusters/3-node', 'clusters/fixed-3', 'conf', 'features/no-object-map', 'features/object-map', 'install/ceph', 'krbd/fsx/{ceph/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'krbd/rbd/{bluestore-bitmap', 'krbd/wac/wac/{bluestore-bitmap', 'ms_mode$/{crc}', 'ms_mode$/{legacy}', 'ms_mode$/{prefer-crc}', 'ms_mode/crc', 'ms_mode/legacy', 'ms_mode/secure', 'msgr-failures/many', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'randomized-striping-off}', 'randomized-striping-on}', 'striping/default/{msgr-failures/many', 'striping/fancy/{msgr-failures/few', 'tasks/fsx-1-client}', 'tasks/krbd_data_pool}', 'tasks/krbd_fallocate}', 'tasks/krbd_huge_osdmap}', 'tasks/krbd_latest_osdmap_on_map}', 'tasks/krbd_udev_enumerate}', 'tasks/krbd_udev_netlink_enobufs}', 'tasks/krbd_udev_netns}', 'tasks/rbd_concurrent}', 'tasks/rbd_fio}', 'tasks/rbd_huge_tickets}', 'tasks/rbd_image_read}', 'tasks/rbd_kernel}', 'tasks/rbd_simple_big}', 'tasks/rbd_workunit_kernel_untar_build}', 'tasks/rbd_workunit_suites_dbench}', 'tasks/rbd_workunit_suites_ffsb}', 'tasks/rbd_workunit_suites_fsstress_ext4}', 'tasks/rbd_workunit_suites_fsstress}', 'tasks/rbd_workunit_suites_fsx}', 'tasks/rbd_workunit_suites_iozone}', 'tasks/rbd_workunit_trivial_sync}', 'tasks/wac', 'verify/many-resets}']
2021-10-09T09:15:10.187 INFO:scrape:
2021-10-09T09:15:10.188 INFO:scrape:Failure: reached maximum tries (90) after waiting for 540 seconds
2021-10-09T09:15:10.188 INFO:scrape:2 jobs: ['6426620', '6426731']
2021-10-09T09:15:10.189 INFO:scrape:suites intersection: ['clusters/3-node', 'conf', 'krbd/fsx/{ceph/ceph', 'ms_mode$/{crc}', 'objectstore/filestore-xfs', 'randomized-striping-off}', 'striping/default/{msgr-failures/many', 'tasks/fsx-3-client}']
2021-10-09T09:15:10.189 INFO:scrape:suites union: ['clusters/3-node', 'conf', 'features/no-object-map', 'features/object-map', 'krbd/fsx/{ceph/ceph', 'ms_mode$/{crc}', 'objectstore/filestore-xfs', 'randomized-striping-off}', 'striping/default/{msgr-failures/many', 'tasks/fsx-3-client}']
2021-10-09T09:15:10.190 INFO:scrape:
2021-10-09T09:15:10.190 INFO:scrape:Failure: SSH connection to gibba036 was lost: 'sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0'
2021-10-09T09:15:10.190 INFO:scrape:1 jobs: ['6426781']
2021-10-09T09:15:10.191 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/secure', 'msgr-failures/many', 'tasks/rbd_concurrent}']
2021-10-09T09:15:10.191 INFO:scrape:
2021-10-09T09:15:10.192 INFO:scrape:Failure: "2021-10-08T22:06:57.335292+0000 osd.7 (osd.7) 3 : cluster [WRN] slow request osd_op(client.4419.0:246586 2.5 2:a27b4bc1:::rbd_data.1109ce52fac.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,write 876544~4096 in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e24) initiated 2021-10-08T22:06:27.305509+0000 currently waiting for sub ops" in cluster log
2021-10-09T09:15:10.192 INFO:scrape:1 jobs: ['6426611']
2021-10-09T09:15:10.192 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'krbd/rbd/{bluestore-bitmap', 'ms_mode/secure', 'msgr-failures/many', 'tasks/rbd_fio}']
2021-10-09T09:15:10.193 INFO:scrape:
2021-10-09T09:15:10.193 INFO:scrape:Failure: Command failed on gibba011 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/master'
2021-10-09T09:15:10.194 INFO:scrape:1 jobs: ['6426721']
2021-10-09T09:15:10.194 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/secure', 'msgr-failures/few', 'tasks/krbd_data_pool}']
2021-10-09T09:15:10.195 INFO:scrape:
2021-10-09T09:15:10.199 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba
=================================================================
info:    http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/
failed:  35
dead:    68
running: 0
waiting: 0
queued:  0
passed:  117


Fail
=================================================================
[6426579]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_kernel_untar_build}
-----------------------------------------------------------------
time:   00:17:36
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426579/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426579/
sentry: https://sentry.ceph.com/organizations/ceph/?query=908604104785409683692238a40e9fb4

    "2021-10-08T20:35:11.183045+0000 mon.a (mon.0) 320 : cluster [WRN] Health
    check failed: 2 osds down (OSD_DOWN)" in cluster log

[6426589]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netlink_enobufs}
-----------------------------------------------------------------
time:   00:17:49
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426589/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426589/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8ade6157b6d64b499bb501d4ca45996a

    "2021-10-08T21:15:15.180260+0000 mon.a (mon.0) 239 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6426593]  krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client}
-----------------------------------------------------------------
time:   00:17:46
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426593/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426593/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ad4e6e7936514cd5833ed0c2e875d12d

    "2021-10-08T21:17:56.243375+0000 mon.a (mon.0) 345 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6426604]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_iozone}
-----------------------------------------------------------------
time:   00:17:31
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426604/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426604/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0f773bde5d2a4d289426ffb72f60814a

    "2021-10-08T21:49:23.040290+0000 mon.a (mon.0) 270 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6426611]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio}
-----------------------------------------------------------------
time:   00:25:03
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426611/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426611/

    "2021-10-08T22:06:57.335292+0000 osd.7 (osd.7) 3 : cluster [WRN] slow
    request osd_op(client.4419.0:246586 2.5
    2:a27b4bc1:::rbd_data.1109ce52fac.0000000000000006:head [set-alloc-hint
    object_size 4194304 write_size 4194304,write 876544~4096 in=4096b] snapc
    0=[] RETRY=1 ondisk+retry+write+known_if_redirected e24) initiated
    2021-10-08T22:06:27.305509+0000 currently waiting for sub ops" in cluster
    log

[6426620]  krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client}
-----------------------------------------------------------------
time:   00:16:26
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426620/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426620/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6e41bab909bd48ceb15fcee140848687

    reached maximum tries (90) after waiting for 540 seconds

[6426623]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate}
-----------------------------------------------------------------
time:   00:17:07
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426623/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426623/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4d07c669f65e4006a1319d0c30582330

    "2021-10-08T22:31:50.845770+0000 mon.a (mon.0) 166 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6426645]  krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client}
-----------------------------------------------------------------
time:   00:16:24
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426645/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426645/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ca44e53701574b5291e6eef2adefd0d0

    "2021-10-08T23:41:49.568055+0000 mon.a (mon.0) 250 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6426649]  krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets}
-----------------------------------------------------------------
time:   00:17:19
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426649/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426649/
sentry: https://sentry.ceph.com/organizations/ceph/?query=71c421f9a4d141fead20103af0ee8ead

    "2021-10-08T23:49:43.685769+0000 mon.a (mon.0) 201 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6426653]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_huge_osdmap}
-----------------------------------------------------------------
time:   00:17:20
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426653/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426653/
sentry: https://sentry.ceph.com/organizations/ceph/?query=17ac8d39cd8f4196ae1b4481d7206605

    "2021-10-09T00:23:44.460942+0000 mon.a (mon.0) 323 : cluster [WRN] Health
    check failed: 2 osds down (OSD_DOWN)" in cluster log

[6426662]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netlink_enobufs}
-----------------------------------------------------------------
time:   00:17:32
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426662/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426662/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dd771692f19c4358a9c55e79aa1963c9

    "2021-10-09T00:49:17.146717+0000 mon.a (mon.0) 223 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6426666]  krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client}
-----------------------------------------------------------------
time:   00:21:13
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426666/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426666/

    "2021-10-09T00:46:15.694408+0000 mon.a (mon.0) 294 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6426670]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_huge_tickets}
-----------------------------------------------------------------
time:   00:17:31
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426670/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426670/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d6aeed3598074963bcb79b82bb8b8e77

    "2021-10-09T01:16:52.808718+0000 mon.a (mon.0) 259 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6426675]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_kernel}
-----------------------------------------------------------------
time:   00:17:23
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426675/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426675/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9cc0718d8f834ceb891198b8195f72f9

    "2021-10-09T01:19:12.369417+0000 mon.a (mon.0) 171 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6426676]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_iozone}
-----------------------------------------------------------------
time:   00:17:17
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426676/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426676/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d9887190b69d4587927b7444235e507c

    "2021-10-09T01:39:21.318230+0000 mon.a (mon.0) 268 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6426684]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_data_pool}
-----------------------------------------------------------------
time:   00:17:10
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426684/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426684/
sentry: https://sentry.ceph.com/organizations/ceph/?query=51c6628475df42d3aeb520ba10167fe1

    "2021-10-09T01:51:21.781301+0000 mon.a (mon.0) 126 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6426689]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_fallocate}
-----------------------------------------------------------------
time:   00:17:24
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426689/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426689/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3f6b5840d8a348e69f050a4b961a94e5

    "2021-10-09T02:26:39.504250+0000 mon.a (mon.0) 221 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6426691]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_dbench}
-----------------------------------------------------------------
time:   00:17:37
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426691/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426691/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6496e8cb98f84b1e98d8e4efedc10f00

    "2021-10-09T02:29:54.347763+0000 mon.a (mon.0) 187 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6426699]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:17:26
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426699/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426699/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f4d0900daad94d3b8d87a35f64200af7

    "2021-10-09T02:59:03.431849+0000 mon.a (mon.0) 360 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6426700]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netns}
-----------------------------------------------------------------
time:   00:17:22
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426700/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426700/
sentry: https://sentry.ceph.com/organizations/ceph/?query=66dca4acd6b94130bf26d3168f55ced9

    "2021-10-09T02:52:59.334891+0000 mon.a (mon.0) 114 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6426702]  krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client}
-----------------------------------------------------------------
time:   00:17:12
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426702/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426702/
sentry: https://sentry.ceph.com/organizations/ceph/?query=307027e380844e18b5a13b714d433c4d

    "2021-10-09T03:00:18.560845+0000 mon.a (mon.0) 142 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6426705]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_concurrent}
-----------------------------------------------------------------
time:   00:17:26
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426705/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426705/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0b1a22eff8f34f38b6f51cee89547977

    "2021-10-09T03:28:14.626930+0000 mon.a (mon.0) 334 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6426707]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsx}
-----------------------------------------------------------------
time:   00:17:21
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426707/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426707/
sentry: https://sentry.ceph.com/organizations/ceph/?query=94c1475f233249dbbf3facb23eb9ffd5

    "2021-10-09T03:32:24.625279+0000 mon.a (mon.0) 300 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6426716]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_trivial_sync}
-----------------------------------------------------------------
time:   00:17:30
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426716/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426716/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f773f9a33fbd4a9ca494546623d14e7e

    "2021-10-09T04:02:10.112024+0000 mon.a (mon.0) 308 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6426717]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_simple_big}
-----------------------------------------------------------------
time:   00:17:33
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426717/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426717/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f79c6d984cef4c5daa76999eff16f01b

    "2021-10-09T03:56:11.469196+0000 mon.a (mon.0) 111 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6426721]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_data_pool}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426721/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426721/
sentry: https://sentry.ceph.com/organizations/ceph/?query=71c53a62f32844e7ae39c122aebad3db

    Command failed on gibba011 with status 128: 'cd /lib/firmware/updates &&
    sudo git fetch origin && sudo git reset --hard origin/master'

[6426727]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_huge_osdmap}
-----------------------------------------------------------------
time:   00:17:24
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426727/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426727/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b79e4524f9ca4106ae40d31a39599b2d

    "2021-10-09T04:35:09.377737+0000 mon.a (mon.0) 232 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6426731]  krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client}
-----------------------------------------------------------------
time:   00:16:26
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426731/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426731/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fae665a2d3f743e0aa75dab9e91c1cce

    reached maximum tries (90) after waiting for 540 seconds

[6426733]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_ffsb}
-----------------------------------------------------------------
time:   00:17:16
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426733/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426733/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2b9ef0b526df46468a6c8e1596d7876e

    "2021-10-09T04:48:43.717398+0000 mon.a (mon.0) 108 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6426742]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4}
-----------------------------------------------------------------
time:   00:17:39
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426742/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426742/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3e4c3be37b3c43a4875ea1e8af410d3f

    "2021-10-09T05:17:46.360483+0000 mon.a (mon.0) 141 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6426756]  krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client}
-----------------------------------------------------------------
time:   00:16:18
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426756/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426756/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cff0abd0fab24e62915b089516c88233

    "2021-10-09T05:54:51.007722+0000 mon.a (mon.0) 144 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6426757]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_fio}
-----------------------------------------------------------------
time:   00:17:19
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426757/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426757/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1bf4f7a62776430cb50623bd7c74ad5e

    "2021-10-09T05:58:07.011066+0000 mon.a (mon.0) 131 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6426767]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_latest_osdmap_on_map}
-----------------------------------------------------------------
time:   00:17:16
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426767/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426767/
sentry: https://sentry.ceph.com/organizations/ceph/?query=11cbfe90cff04f71a8e9c4f9d13ec73b

    "2021-10-09T06:22:53.511525+0000 mon.a (mon.0) 175 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6426775]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:17:17
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426775/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426775/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7c5be965dbd746c684e56485d4b3c886

    "2021-10-09T06:46:23.432527+0000 mon.a (mon.0) 262 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6426784]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_image_read}
-----------------------------------------------------------------
time:   00:17:13
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426784/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426784/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dcb405c7da2744af98d2bc3baf34a569

    "2021-10-09T06:59:38.364162+0000 mon.a (mon.0) 176 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log



Dead
=================================================================
[6426572]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_fio}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426572/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426572/

    Error reimaging machines: Failed to power on gibba027

[6426574]  krbd/singleton/{bluestore-bitmap conf ms_mode$/{crc} msgr-failures/few tasks/rbd_xfstests}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426574/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426574/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426576]  krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426576/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426576/

    Error reimaging machines: Failed to power on gibba027

[6426580]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_fallocate}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426580/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426580/

    Error reimaging machines: Failed to power on gibba027

[6426581]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_huge_osdmap}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426581/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426581/

    Error reimaging machines: Failed to power on gibba027

[6426582]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_dbench}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426582/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426582/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426584]  krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_discard}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426584/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426584/

    Error reimaging machines: Failed to power on gibba027

[6426587]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_ffsb}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426587/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426587/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426591]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netns}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426591/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426591/

    Error reimaging machines: Failed to power on gibba027

[6426592]  krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_huge_image}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426592/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426592/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426595]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426595/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426595/

    Error reimaging machines: Failed to power on gibba027

[6426597]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_huge_tickets}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426597/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426597/

    Error reimaging machines: Failed to power on gibba027

[6426598]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsx}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426598/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426598/

    Error reimaging machines: Failed to power on gibba027

[6426602]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426602/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426602/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426606]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_unmap}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426606/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426606/

    Error reimaging machines: Failed to power on gibba027

[6426607]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_trivial_sync}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426607/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426607/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426612]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_data_pool}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426612/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426612/

    Error reimaging machines: Failed to power on gibba027

[6426613]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_exclusive_option}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426613/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426613/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426615]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_fallocate}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426615/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426615/

    Error reimaging machines: Failed to power on gibba027

[6426617]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_dbench}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426617/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426617/

    Error reimaging machines: Failed to power on gibba027

[6426618]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_latest_osdmap_on_map}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426618/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426618/

    Error reimaging machines: Failed to power on gibba027

[6426626]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netns}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426626/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426626/

    Error reimaging machines: Failed to power on gibba027

[6426627]  krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_read_only}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426627/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426627/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426630]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426630/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426630/

    Error reimaging machines: Failed to power on gibba027

[6426634]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426634/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426634/

    Error reimaging machines: Failed to power on gibba027

[6426635]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426635/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426635/

    Error reimaging machines: Failed to power on gibba027

[6426636]  krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_whole_object_zeroout}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426636/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426636/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426640]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_snapshot_io}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426640/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426640/

    Error reimaging machines: Failed to power on gibba027

[6426641]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426641/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426641/

    Error reimaging machines: Failed to power on gibba027

[6426642]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_trivial_sync}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426642/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426642/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426644]  krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_deep_flatten}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426644/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426644/

    Error reimaging machines: Failed to power on gibba027

[6426648]  krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426648/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426648/

    Error reimaging machines: Failed to power on gibba027

[6426650]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_exclusive_option}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426650/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426650/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426651]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_kernel_untar_build}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426651/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426651/

    Error reimaging machines: Failed to power on gibba027

[6426654]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_dbench}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426654/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426654/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426660]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_ffsb}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426660/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426660/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426664]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netns}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426664/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426664/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426668]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426668/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426668/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426674]  krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426674/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426674/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426681]  krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_msgr_segments}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426681/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426681/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426685]  krbd/singleton/{bluestore-bitmap conf ms_mode$/{prefer-crc} msgr-failures/many tasks/rbd_xfstests}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426685/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426685/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426693]  krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_parent_overlap}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426693/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426693/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426701]  krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426701/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426701/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426709]  krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_whole_object_zeroout}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426709/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426709/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426718]  krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_deep_flatten}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426718/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426718/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426722]  krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426722/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426722/

    Error reimaging machines: Failed to power on gibba027

[6426730]  krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426730/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426730/

    Error reimaging machines: Failed to power on gibba027

[6426732]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_namespaces}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426732/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426732/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426737]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netns}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426737/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426737/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426738]  krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_huge_image}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426738/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426738/

    Error reimaging machines: Failed to power on gibba027

[6426741]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_symlinks}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426741/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426741/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426747]  krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_modprobe}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426747/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426747/

    Error reimaging machines: Failed to power on gibba027

[6426748]  krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426748/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426748/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426753]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_trivial_sync}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426753/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426753/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426755]  krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_msgr_segments}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426755/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426755/

    Error reimaging machines: Failed to power on gibba027

[6426761]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_exclusive_option}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426761/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426761/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426765]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_huge_osdmap}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426765/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426765/

    Error reimaging machines: Failed to power on gibba027

[6426766]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_dbench}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426766/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426766/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426769]  krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426769/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426769/

    Error reimaging machines: Failed to power on gibba027

[6426772]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_ffsb}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426772/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426772/

    Error reimaging machines: Failed to power on gibba027

[6426776]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netns}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426776/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426776/

    Error reimaging machines: Failed to power on gibba027

[6426777]  krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_read_only}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426777/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426777/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426779]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_symlinks}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426779/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426779/

    Error reimaging machines: Failed to power on gibba027

[6426780]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426780/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426780/

    Error reimaging machines: Failed to power on gibba027

[6426781]  krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_concurrent}
-----------------------------------------------------------------
time:   02:30:56
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426781/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426781/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dbe0d7cd9c6246189b372d3cd8ed8173

    SSH connection to gibba036 was lost: 'sudo rm -rf --
    /home/ubuntu/cephtest/workunits.list.client.0
    /home/ubuntu/cephtest/clone.client.0'

[6426783]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsx}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426783/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426783/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds

[6426785]  krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_whole_object_zeroout}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426785/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426785/

    Error reimaging machines: Failed to power on gibba027

[6426788]  krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_iozone}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426788/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426788/

    Error reimaging machines: reached maximum tries (60) after waiting for 900
    seconds



Pass
=================================================================
[6426570] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_deep_flatten}
time:   00:07:48
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426570/

[6426571] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client}
time:   00:19:55
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426571/

[6426573] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_data_pool}
time:   00:15:52
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426573/

[6426575] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{prefer-crc} thrashers/backoff thrashosds-health workloads/rbd_fio}
time:   00:42:40
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426575/

[6426577] krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes}
time:   00:07:05
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426577/

[6426578] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_exclusive_option}
time:   00:09:51
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426578/

[6426583] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_latest_osdmap_on_map}
time:   00:14:20
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426583/

[6426585] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client}
time:   00:15:41
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426585/

[6426586] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_namespaces}
time:   00:10:23
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426586/

[6426588] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_enumerate}
time:   00:20:40
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426588/

[6426590] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress}
time:   00:11:33
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426590/

[6426594] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_symlinks}
time:   00:09:53
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426594/

[6426596] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_concurrent}
time:   00:13:10
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426596/

[6426599] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_image_read}
time:   00:08:51
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426599/

[6426600] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_modprobe}
time:   00:07:02
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426600/

[6426601] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client}
time:   00:15:34
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426601/

[6426603] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_kernel}
time:   00:08:44
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426603/

[6426605] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io}
time:   00:08:23
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426605/

[6426608] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_simple_big}
time:   00:25:55
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426608/

[6426609] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_msgr_segments}
time:   00:07:04
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426609/

[6426610] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client}
time:   00:23:19
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426610/

[6426614] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_kernel_untar_build}
time:   00:14:02
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426614/

[6426616] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_huge_osdmap}
time:   00:09:38
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426616/

[6426619] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_parent_overlap}
time:   00:06:57
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426619/

[6426621] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_namespaces}
time:   00:09:07
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426621/

[6426622] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_ffsb}
time:   00:58:38
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426622/

[6426624] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netlink_enobufs}
time:   00:14:42
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426624/

[6426625] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress}
time:   00:11:39
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426625/

[6426628] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client}
time:   00:18:04
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426628/

[6426629] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{prefer-crc} thrashers/pggrow thrashosds-health workloads/rbd_fio}
time:   00:43:57
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426629/

[6426631] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4}
time:   00:08:53
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426631/

[6426632] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_concurrent}
time:   01:01:43
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426632/

[6426633] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_huge_tickets}
time:   00:08:41
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426633/

[6426637] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client}
time:   00:17:16
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426637/

[6426638] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_kernel}
time:   00:08:43
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426638/

[6426639] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_iozone}
time:   00:15:37
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426639/

[6426643] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_simple_big}
time:   00:29:03
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426643/

[6426646] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_fio}
time:   00:24:52
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426646/

[6426647] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_data_pool}
time:   00:15:51
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426647/

[6426652] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_fallocate}
time:   00:09:10
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426652/

[6426655] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_latest_osdmap_on_map}
time:   00:11:55
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426655/

[6426656] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_discard}
time:   00:07:38
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426656/

[6426657] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client}
time:   00:16:17
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426657/

[6426658] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb}
time:   00:59:24
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426658/

[6426659] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_namespaces}
time:   00:10:02
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426659/

[6426661] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_enumerate}
time:   00:20:21
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426661/

[6426663] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress}
time:   00:10:44
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426663/

[6426665] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_huge_image}
time:   00:07:20
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426665/

[6426667] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_symlinks}
time:   00:09:45
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426667/

[6426669] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent}
time:   00:13:09
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426669/

[6426671] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsx}
time:   00:21:19
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426671/

[6426672] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_image_read}
time:   00:08:52
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426672/

[6426673] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_modprobe}
time:   00:07:03
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426673/

[6426677] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_snapshot_io}
time:   00:08:30
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426677/

[6426678] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_unmap}
time:   00:13:35
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426678/

[6426679] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_trivial_sync}
time:   00:10:52
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426679/

[6426680] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_simple_big}
time:   00:28:54
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426680/

[6426682] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client}
time:   00:25:14
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426682/

[6426683] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_fio}
time:   00:25:13
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426683/

[6426686] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb}
time:   00:58:40
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426686/

[6426687] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_exclusive_option}
time:   00:09:29
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426687/

[6426688] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_kernel_untar_build}
time:   00:14:30
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426688/

[6426690] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_huge_osdmap}
time:   00:09:28
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426690/

[6426692] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_latest_osdmap_on_map}
time:   00:11:51
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426692/

[6426694] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client}
time:   00:16:02
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426694/

[6426695] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_namespaces}
time:   00:08:56
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426695/

[6426696] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_ffsb}
time:   00:59:38
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426696/

[6426697] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_enumerate}
time:   00:22:40
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426697/

[6426698] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netlink_enobufs}
time:   00:14:33
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426698/

[6426703] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_symlinks}
time:   00:09:22
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426703/

[6426704] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4}
time:   00:08:21
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426704/

[6426706] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_huge_tickets}
time:   00:08:33
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426706/

[6426708] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_image_read}
time:   00:09:11
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426708/

[6426710] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client}
time:   00:13:38
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426710/

[6426711] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio}
time:   00:37:03
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426711/

[6426712] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_kernel}
time:   00:08:28
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426712/

[6426713] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_iozone}
time:   00:15:32
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426713/

[6426714] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_snapshot_io}
time:   00:08:23
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426714/

[6426715] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_unmap}
time:   00:13:39
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426715/

[6426719] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client}
time:   00:27:33
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426719/

[6426720] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_fio}
time:   00:25:09
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426720/

[6426723] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets}
time:   00:19:40
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426723/

[6426724] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_exclusive_option}
time:   00:09:30
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426724/

[6426725] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_kernel_untar_build}
time:   00:15:17
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426725/

[6426726] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_fallocate}
time:   00:09:22
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426726/

[6426728] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_dbench}
time:   00:35:51
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426728/

[6426729] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_latest_osdmap_on_map}
time:   00:11:38
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426729/

[6426734] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_enumerate}
time:   00:20:02
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426734/

[6426735] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netlink_enobufs}
time:   00:14:30
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426735/

[6426736] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress}
time:   00:10:36
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426736/

[6426739] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client}
time:   00:22:42
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426739/

[6426740] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb}
time:   00:58:15
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426740/

[6426743] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_concurrent}
time:   00:13:10
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426743/

[6426744] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_huge_tickets}
time:   00:08:50
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426744/

[6426745] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsx}
time:   00:21:29
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426745/

[6426746] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_image_read}
time:   00:08:46
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426746/

[6426749] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_kernel}
time:   00:08:26
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426749/

[6426750] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_iozone}
time:   00:17:10
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426750/

[6426751] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_snapshot_io}
time:   00:08:27
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426751/

[6426752] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_unmap}
time:   00:13:23
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426752/

[6426754] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_simple_big}
time:   00:25:42
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426754/

[6426759] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_data_pool}
time:   00:19:30
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426759/

[6426763] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_kernel_untar_build}
time:   00:14:09
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426763/

[6426764] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_fallocate}
time:   00:09:36
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426764/

[6426768] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_parent_overlap}
time:   00:07:08
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426768/

[6426770] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/upmap thrashosds-health workloads/rbd_fio}
time:   00:38:50
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426770/

[6426771] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_namespaces}
time:   00:09:41
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426771/

[6426773] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_enumerate}
time:   00:23:16
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426773/

[6426774] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netlink_enobufs}
time:   00:14:39
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426774/

[6426778] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client}
time:   00:24:32
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426778/

[6426782] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_huge_tickets}
time:   00:08:26
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426782/

[6426786] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client}
time:   00:15:59
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426786/

[6426787] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_kernel}
time:   00:08:27
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426787/

[6426789] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_snapshot_io}
time:   00:08:10
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426789/

[6426790] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_unmap}
time:   00:13:17
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426790/

[6426791] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_trivial_sync}
time:   00:11:56
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426791/

[6426792] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_simple_big}
time:   00:29:56
info:   http://pulpito.ceph.com/teuthology-2021-10-08_03:20:03-krbd-master-testing-basic-gibba/6426792/