2022-07-17T01:02:54.761 INFO:root:teuthology version: 1.1.1.dev383+g89d874d5 2022-07-17T01:02:54.763 INFO:teuthology.results:seed: '3843' 2022-07-17T09:36:27.501 INFO:root:teuthology version: 1.1.1.dev383+g89d874d5 2022-07-17T09:36:27.542 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-07-17T10:36:33.960 INFO:teuthology.results:Tests finished! gathering results... 2022-07-17T10:37:04.935 INFO:scrape:Found 222 jobs 2022-07-17T10:37:17.918 INFO:scrape:Found 5 distinct failure reasons 2022-07-17T10:37:17.920 INFO:scrape:Failure: "2022-07-17T10:09:10.022724+0000 mon.a (mon.0) 201 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log 2022-07-17T10:37:17.921 INFO:scrape:38 jobs 2022-07-17T10:37:17.931 INFO:scrape:suites intersection: ['conf'] 2022-07-17T10:37:17.932 INFO:scrape:suites union: ['clusters/3-node', 'clusters/fixed-3', 'conf', 'features/no-object-map', 'install/ceph', 'krbd/fsx/{ceph/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'krbd/rbd/{bluestore-bitmap', 'ms_mode$/{legacy}', 'ms_mode$/{secure}', 'ms_mode/crc$/{crc-rxbounce}', 'ms_mode/crc$/{crc}', 'ms_mode/legacy$/{legacy-rxbounce}', 'ms_mode/legacy$/{legacy}', 'ms_mode/secure', 'msgr-failures/few', 'msgr-failures/many', 'objectstore/bluestore-bitmap', 'randomized-striping-off}', 'striping/default/{msgr-failures/many', 'tasks/fsx-1-client}', 'tasks/fsx-3-client}', 'tasks/krbd_data_pool}', 'tasks/krbd_exclusive_option}', 'tasks/krbd_fallocate}', 'tasks/krbd_huge_osdmap}', 'tasks/krbd_latest_osdmap_on_map}', 'tasks/krbd_namespaces}', 'tasks/krbd_udev_enumerate}', 'tasks/krbd_udev_netlink_enobufs}', 'tasks/krbd_udev_netns}', 'tasks/krbd_udev_symlinks}', 'tasks/rbd_fio}', 'tasks/rbd_image_read}', 'tasks/rbd_kernel}', 'tasks/rbd_map_snapshot_io}', 'tasks/rbd_map_unmap}', 'tasks/rbd_simple_big}', 'tasks/rbd_workunit_kernel_untar_build}', 'tasks/rbd_workunit_suites_dbench}', 'tasks/rbd_workunit_suites_ffsb}', 'tasks/rbd_workunit_suites_fsstress}', 'tasks/rbd_workunit_suites_fsx}', 'tasks/rbd_workunit_trivial_sync}'] 2022-07-17T10:37:17.933 INFO:scrape: 2022-07-17T10:37:17.934 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nightly_pre-single-major 2022-07-17T10:37:17.935 INFO:scrape:1 jobs: ['6931229'] 2022-07-17T10:37:17.936 INFO:scrape:suites: ['clusters/separate-client', 'conf', 'filestore-xfs', 'kernels/pre-single-major', 'krbd/unmap/{ceph/ceph', 'tasks/unmap}'] 2022-07-17T10:37:17.937 INFO:scrape: 2022-07-17T10:37:17.938 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/concurrent.sh 2022-07-17T10:37:17.939 INFO:scrape:1 jobs: ['6931285'] 2022-07-17T10:37:17.940 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/crc$/{crc}', 'msgr-failures/many', 'tasks/rbd_concurrent}'] 2022-07-17T10:37:17.941 INFO:scrape: 2022-07-17T10:37:17.942 INFO:scrape:Failure: Command failed on smithi157 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/exclude6ukqtmym -r -- '-g auto -g blockdev -x clone'" 2022-07-17T10:37:17.950 INFO:scrape:2 jobs: ['6931227', '6931339'] 2022-07-17T10:37:17.951 INFO:scrape:suites intersection: ['conf', 'krbd/singleton/{bluestore-bitmap', 'tasks/rbd_xfstests}'] 2022-07-17T10:37:17.952 INFO:scrape:suites union: ['conf', 'krbd/singleton/{bluestore-bitmap', 'ms_mode$/{crc}', 'ms_mode$/{secure}', 'msgr-failures/few', 'msgr-failures/many', 'tasks/rbd_xfstests}'] 2022-07-17T10:37:17.953 INFO:scrape: 2022-07-17T10:37:17.958 INFO:scrape:Failure: Command failed on smithi183 with status 120: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 20000 -K -U pool_client.0 image_client.0' 2022-07-17T10:37:17.959 INFO:scrape:1 jobs: ['6931298'] 2022-07-17T10:37:17.960 INFO:scrape:suites: ['clusters/3-node', 'conf', 'features/no-object-map', 'krbd/fsx/{ceph/ceph', 'ms_mode$/{crc}', 'objectstore/filestore-xfs', 'randomized-striping-off}', 'striping/default/{msgr-failures/many', 'tasks/fsx-1-client}'] 2022-07-17T10:37:17.960 INFO:scrape: 2022-07-17T10:37:18.001 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/ failed: 43 dead: 0 running: 0 waiting: 0 queued: 0 passed: 179 Fail ================================================================= [6931227] krbd/singleton/{bluestore-bitmap conf ms_mode$/{crc} msgr-failures/few tasks/rbd_xfstests} ----------------------------------------------------------------- time: 04:43:12 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931227/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931227/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bb7bc104bfa1428fbaa3691d2064cc00 Command failed on smithi157 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/exclude6ukqtmym -r -- '-g auto -g blockdev -x clone'" [6931229] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931229/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931229/ sentry: https://sentry.ceph.com/organizations/ceph/?query=492a6c91174f4c568474196d0397a271 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&re f=nightly_pre-single-major [6931231] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_exclusive_option} ----------------------------------------------------------------- time: 00:22:20 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931231/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931231/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d017575e59be47d9bbbe6f1353ed62d3 "2022-07-17T01:45:45.659415+0000 mon.a (mon.0) 257 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931234] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_huge_osdmap} ----------------------------------------------------------------- time: 00:22:39 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931234/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931234/ sentry: https://sentry.ceph.com/organizations/ceph/?query=80353f7f18b14a84baceffdcd31fcceb "2022-07-17T01:46:55.796435+0000 mon.a (mon.0) 291 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931246] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} ----------------------------------------------------------------- time: 00:22:44 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931246/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931246/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c5601329c0f7408ea27ebe44dfd92981 "2022-07-17T02:01:18.114046+0000 mon.a (mon.0) 233 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931252] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_image_read} ----------------------------------------------------------------- time: 00:22:38 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931252/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931252/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c99b54a9b0114ff7a58733d6b66a9f1f "2022-07-17T02:13:29.031213+0000 mon.a (mon.0) 218 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log [6931256] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_kernel} ----------------------------------------------------------------- time: 00:22:40 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931256/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931256/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2290e164d0fb4052834f1dc50a2fccbc "2022-07-17T02:15:34.700837+0000 mon.a (mon.0) 225 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931259] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_map_unmap} ----------------------------------------------------------------- time: 00:23:17 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931259/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931259/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e2d4367a081f462c992c111d6b15951f "2022-07-17T02:09:46.490694+0000 mon.a (mon.0) 118 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6931264] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio} ----------------------------------------------------------------- time: 00:22:47 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931264/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931264/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f96b3decd2e541a7bea2de1a2b8961b1 "2022-07-17T02:23:58.006611+0000 mon.a (mon.0) 275 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log [6931267] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_kernel_untar_build} ----------------------------------------------------------------- time: 00:22:31 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931267/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931267/ sentry: https://sentry.ceph.com/organizations/ceph/?query=785eface5f0345e2a631d17f7924b9d7 "2022-07-17T02:24:41.593944+0000 mon.a (mon.0) 216 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931276] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate} ----------------------------------------------------------------- time: 00:22:10 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931276/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931276/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a7baf1687ea1424a95660b91d35a5ee2 "2022-07-17T02:33:24.635226+0000 mon.a (mon.0) 223 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931278] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsstress} ----------------------------------------------------------------- time: 00:22:29 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931278/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931278/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4a28fffb93054b2d8e2f95c3746a7e09 "2022-07-17T02:28:28.625642+0000 mon.a (mon.0) 133 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)" in cluster log [6931285] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_concurrent} ----------------------------------------------------------------- time: 03:42:19 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931285/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931285/ sentry: https://sentry.ceph.com/organizations/ceph/?query=711ff44cb5964959ba85ee0d108c0db6 Command failed (workunit test rbd/concurrent.sh) on smithi119 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=759f326524ac0cb9ad0709ead97b1d154ede5e27 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/concurrent.sh' [6931287] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx} ----------------------------------------------------------------- time: 00:22:21 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931287/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931287/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c4e606a21d1e4627bb3fd75a497dd873 "2022-07-17T02:42:46.561537+0000 mon.a (mon.0) 355 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931295] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_trivial_sync} ----------------------------------------------------------------- time: 00:22:27 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931295/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931295/ sentry: https://sentry.ceph.com/organizations/ceph/?query=256925e7f1714820bbb5efc66f507960 "2022-07-17T02:49:43.432781+0000 mon.a (mon.0) 323 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931298] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} ----------------------------------------------------------------- time: 00:17:03 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931298/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931298/ sentry: https://sentry.ceph.com/organizations/ceph/?query=20ae411e51794a249574bd7babf77ad5 Command failed on smithi183 with status 120: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 20000 -K -U pool_client.0 image_client.0' [6931299] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_fio} ----------------------------------------------------------------- time: 00:22:04 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931299/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931299/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b8a564b1ea54443aad20cf3d69636297 "2022-07-17T02:50:56.284769+0000 mon.a (mon.0) 200 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931304] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_kernel_untar_build} ----------------------------------------------------------------- time: 00:22:34 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931304/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931304/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d2f4587e19d942c98376c58ef021d6cc "2022-07-17T02:58:15.551889+0000 mon.a (mon.0) 281 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931313] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_ffsb} ----------------------------------------------------------------- time: 00:22:24 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931313/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931313/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a991cc2869354708b0edc623a59be001 "2022-07-17T02:56:33.067864+0000 mon.a (mon.0) 168 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6931331] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_map_unmap} ----------------------------------------------------------------- time: 00:22:30 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931331/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931331/ sentry: https://sentry.ceph.com/organizations/ceph/?query=204de6195b264608afddf723e02a7961 "2022-07-17T03:19:13.960697+0000 mon.a (mon.0) 318 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log [6931333] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_simple_big} ----------------------------------------------------------------- time: 00:22:26 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931333/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931333/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9997fceeb3df4a29a4e232f0054bdd23 "2022-07-17T03:09:37.196037+0000 mon.a (mon.0) 117 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6931339] krbd/singleton/{bluestore-bitmap conf ms_mode$/{secure} msgr-failures/many tasks/rbd_xfstests} ----------------------------------------------------------------- time: 04:57:02 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931339/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931339/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1b6b2cc3a7e34c55b04057ab86496994 Command failed on smithi125 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/exclude4_k1qgd6 -r -- '-g auto -g blockdev -x clone'" [6931343] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_fallocate} ----------------------------------------------------------------- time: 00:22:48 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931343/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931343/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b77d663d5d214a16bbb18c2a13ea5722 "2022-07-17T03:29:13.829203+0000 mon.a (mon.0) 238 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931346] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_latest_osdmap_on_map} ----------------------------------------------------------------- time: 00:22:40 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931346/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931346/ sentry: https://sentry.ceph.com/organizations/ceph/?query=79ac38da3a354bc0ab8e456d492b5c2c "2022-07-17T03:32:00.250994+0000 mon.a (mon.0) 245 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931361] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsx} ----------------------------------------------------------------- time: 00:25:50 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931361/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931361/ "2022-07-17T03:41:06.686599+0000 osd.7 (osd.7) 3 : cluster [WRN] 1 slow requests (by type [ 'waiting for sub ops' : 1 ] most affected pool [ 'rbd' : 1 ])" in cluster log [6931362] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_image_read} ----------------------------------------------------------------- time: 00:22:09 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931362/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931362/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4df8045a2a21470abdb38f171c102faa "2022-07-17T03:32:13.331512+0000 mon.a (mon.0) 114 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6931371] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_simple_big} ----------------------------------------------------------------- time: 00:22:22 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931371/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931371/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e0386779867949f2a2dfbf8d6f3f11a2 "2022-07-17T03:39:56.149118+0000 mon.a (mon.0) 170 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6931378] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_exclusive_option} ----------------------------------------------------------------- time: 00:23:10 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931378/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931378/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8bb11b23ac454be4999b76e75e94ef4c "2022-07-17T04:00:50.989720+0000 mon.a (mon.0) 293 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931381] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_huge_osdmap} ----------------------------------------------------------------- time: 00:23:35 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931381/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931381/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ab4379245fa4496287a795249e395d9b "2022-07-17T03:51:56.072960+0000 mon.a (mon.0) 183 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6931386] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_namespaces} ----------------------------------------------------------------- time: 00:23:39 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931386/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931386/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3f54a97804af4ab8813d05c2eba22d86 "2022-07-17T04:06:17.977748+0000 mon.a (mon.0) 229 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931389] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_udev_netlink_enobufs} ----------------------------------------------------------------- time: 00:22:54 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931389/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931389/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6784ea6136c243b08494b290f1b99382 "2022-07-17T08:45:44.300116+0000 mon.a (mon.0) 125 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6931395] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_symlinks} ----------------------------------------------------------------- time: 00:23:30 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931395/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931395/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8113983c471f42a99b4d425326c71a63 "2022-07-17T08:48:55.911985+0000 mon.a (mon.0) 161 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6931403] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_kernel} ----------------------------------------------------------------- time: 00:26:08 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931403/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931403/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ab62383ead43480cad7edd870e3521eb "2022-07-17T09:06:10.124313+0000 mon.a (mon.0) 225 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931412] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_data_pool} ----------------------------------------------------------------- time: 00:26:41 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931412/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931412/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b3ed931508fc408fac3ac457a7c7acd4 "2022-07-17T09:09:21.676331+0000 mon.a (mon.0) 230 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931417] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_dbench} ----------------------------------------------------------------- time: 00:24:52 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931417/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931417/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c3fa53d844154228867e25e8b8bca1a4 "2022-07-17T08:59:42.808525+0000 mon.a (mon.0) 112 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6931418] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_latest_osdmap_on_map} ----------------------------------------------------------------- time: 00:24:05 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931418/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931418/ sentry: https://sentry.ceph.com/organizations/ceph/?query=42bfb40645d64d109aca8a66b14b4d37 "2022-07-17T09:11:44.117033+0000 mon.a (mon.0) 227 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931424] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_udev_enumerate} ----------------------------------------------------------------- time: 00:24:01 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931424/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931424/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0bc3e94d748d48acab3705e2f2627f9e "2022-07-17T09:53:29.093556+0000 mon.a (mon.0) 238 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931426] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress} ----------------------------------------------------------------- time: 00:24:21 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931426/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931426/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ad2e33d471bf4049afe0a69096770bd6 "2022-07-17T09:56:20.244400+0000 mon.a (mon.0) 293 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log [6931427] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_udev_netns} ----------------------------------------------------------------- time: 00:24:00 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931427/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931427/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fd77b290f20f4ad6adc4765418b2c4fd "2022-07-17T09:56:31.514374+0000 mon.a (mon.0) 225 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931434] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsx} ----------------------------------------------------------------- time: 00:25:12 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931434/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931434/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e306c6a640684403bafdca8eb92769c3 "2022-07-17T10:03:59.162172+0000 mon.a (mon.0) 257 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931437] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} ----------------------------------------------------------------- time: 00:24:59 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931437/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931437/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9bebac124c3b404cbc30c0a8d98f9307 "2022-07-17T10:04:17.847293+0000 mon.a (mon.0) 290 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931440] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_map_snapshot_io} ----------------------------------------------------------------- time: 00:26:09 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931440/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931440/ sentry: https://sentry.ceph.com/organizations/ceph/?query=06c69050a2134da88b2c526cb28b3c9f "2022-07-17T10:09:10.022724+0000 mon.a (mon.0) 201 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6931442] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_trivial_sync} ----------------------------------------------------------------- time: 00:26:03 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931442/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931442/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b61d9fef51fe44aba9ebeb12ee738115 "2022-07-17T10:09:25.115008+0000 mon.a (mon.0) 227 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log Pass ================================================================= [6931222] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_deep_flatten} time: 00:13:39 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931222/ [6931223] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:23:24 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931223/ [6931224] krbd/ms_modeless/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/krbd_default_map_options} time: 00:13:34 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931224/ [6931225] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_fio} time: 00:31:01 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931225/ [6931226] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_data_pool} time: 00:22:36 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931226/ [6931228] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/backoff thrashosds-health workloads/rbd_fio} time: 00:44:35 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931228/ [6931230] krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes} time: 00:11:57 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931230/ [6931232] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_kernel_untar_build} time: 00:21:47 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931232/ [6931233] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_fallocate} time: 00:15:19 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931233/ [6931235] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_dbench} time: 00:40:17 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931235/ [6931236] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_latest_osdmap_on_map} time: 00:16:52 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931236/ [6931237] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_discard} time: 00:13:25 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931237/ [6931238] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc-rxbounce} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:20:35 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931238/ [6931239] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_namespaces} time: 00:15:42 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931239/ [6931240] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_ffsb} time: 01:12:13 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931240/ [6931241] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_udev_enumerate} time: 00:42:08 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931241/ [6931242] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_netlink_enobufs} time: 00:20:54 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931242/ [6931243] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsstress} time: 00:15:14 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931243/ [6931244] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netns} time: 00:14:26 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931244/ [6931245] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_huge_image} time: 00:12:23 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931245/ [6931247] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_udev_symlinks} time: 00:15:06 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931247/ [6931248] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} time: 00:14:03 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931248/ [6931249] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_concurrent} time: 00:18:43 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931249/ [6931250] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_huge_tickets} time: 00:14:22 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931250/ [6931251] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_fsx} time: 00:23:20 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931251/ [6931253] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_modprobe} time: 00:12:03 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931253/ [6931254] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:19:22 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931254/ [6931255] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:02:43 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931255/ [6931257] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_iozone} time: 00:20:34 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931257/ [6931258] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io} time: 00:13:43 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931258/ [6931260] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_trivial_sync} time: 00:15:44 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931260/ [6931261] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_simple_big} time: 00:29:16 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931261/ [6931262] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_msgr_segments} time: 00:12:20 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931262/ [6931263] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:29:57 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931263/ [6931265] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_data_pool} time: 00:27:36 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931265/ [6931266] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_exclusive_option} time: 00:15:32 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931266/ [6931268] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_fallocate} time: 00:15:22 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931268/ [6931269] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_huge_osdmap} time: 00:14:49 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931269/ [6931270] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_dbench} time: 00:41:04 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931270/ [6931271] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_latest_osdmap_on_map} time: 00:17:50 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931271/ [6931272] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_parent_overlap} time: 00:11:57 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931272/ [6931273] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:21:57 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931273/ [6931274] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_namespaces} time: 00:14:54 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931274/ [6931275] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_ffsb} time: 01:02:28 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931275/ [6931277] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_udev_netlink_enobufs} time: 00:20:41 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931277/ [6931279] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_netns} time: 00:14:25 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931279/ [6931280] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_read_only} time: 00:12:32 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931280/ [6931281] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:21:34 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931281/ [6931282] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/pggrow thrashosds-health workloads/rbd_fio} time: 00:41:35 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931282/ [6931283] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks} time: 00:14:41 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931283/ [6931284] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} time: 00:13:55 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931284/ [6931286] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_huge_tickets} time: 00:13:41 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931286/ [6931288] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read} time: 00:14:38 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931288/ [6931289] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_whole_object_zeroout} time: 00:12:45 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931289/ [6931290] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:22:18 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931290/ [6931291] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_kernel} time: 00:13:36 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931291/ [6931292] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_iozone} time: 00:19:40 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931292/ [6931293] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_map_snapshot_io} time: 00:13:38 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931293/ [6931294] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap} time: 00:18:52 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931294/ [6931296] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_simple_big} time: 00:32:25 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931296/ [6931297] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_deep_flatten} time: 00:12:26 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931297/ [6931300] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_data_pool} time: 00:22:16 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931300/ [6931301] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} time: 00:12:11 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931301/ [6931302] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} time: 00:23:59 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931302/ [6931303] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_exclusive_option} time: 00:14:54 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931303/ [6931305] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_fallocate} time: 00:14:12 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931305/ [6931306] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_huge_osdmap} time: 00:14:49 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931306/ [6931307] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_dbench} time: 00:40:06 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931307/ [6931308] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_latest_osdmap_on_map} time: 00:16:41 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931308/ [6931309] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_discard} time: 00:12:45 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931309/ [6931310] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:20:28 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931310/ [6931311] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:11:38 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931311/ [6931312] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_namespaces} time: 00:16:22 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931312/ [6931314] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_udev_enumerate} time: 00:43:01 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931314/ [6931315] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netlink_enobufs} time: 00:21:23 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931315/ [6931316] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress} time: 00:16:09 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931316/ [6931317] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_udev_netns} time: 00:15:14 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931317/ [6931318] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_huge_image} time: 00:12:29 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931318/ [6931319] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:24:27 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931319/ [6931320] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_symlinks} time: 00:15:32 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931320/ [6931321] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} time: 00:15:13 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931321/ [6931322] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent} time: 00:19:06 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931322/ [6931323] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_huge_tickets} time: 00:14:30 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931323/ [6931324] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_fsx} time: 00:22:51 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931324/ [6931325] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_image_read} time: 00:13:52 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931325/ [6931326] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_modprobe} time: 00:11:50 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931326/ [6931327] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:22:30 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931327/ [6931328] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_kernel} time: 00:16:10 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931328/ [6931329] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_iozone} time: 00:20:58 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931329/ [6931330] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_map_snapshot_io} time: 00:13:26 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931330/ [6931332] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_trivial_sync} time: 00:14:40 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931332/ [6931334] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_msgr_segments} time: 00:12:40 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931334/ [6931335] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:27:12 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931335/ [6931336] krbd/ms_modeless/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/krbd_rxbounce} time: 00:14:29 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931336/ [6931337] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_fio} time: 00:31:43 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931337/ [6931338] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_data_pool} time: 00:26:24 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931338/ [6931340] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:11:54 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931340/ [6931341] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_exclusive_option} time: 00:15:04 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931341/ [6931342] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_kernel_untar_build} time: 00:21:40 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931342/ [6931344] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_huge_osdmap} time: 00:14:45 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931344/ [6931345] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_dbench} time: 00:41:00 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931345/ [6931347] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_parent_overlap} time: 00:12:10 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931347/ [6931348] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:21:58 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931348/ [6931349] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_namespaces} time: 00:14:54 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931349/ [6931350] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_ffsb} time: 01:02:54 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931350/ [6931351] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_udev_enumerate} time: 00:45:38 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931351/ [6931352] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_udev_netlink_enobufs} time: 00:20:43 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931352/ [6931353] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsstress} time: 00:16:13 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931353/ [6931354] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netns} time: 00:14:54 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931354/ [6931355] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only} time: 00:12:22 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931355/ [6931356] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:31:43 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931356/ [6931357] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_udev_symlinks} time: 00:15:00 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931357/ [6931358] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} time: 00:14:18 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931358/ [6931359] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_concurrent} time: 00:18:51 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931359/ [6931360] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_huge_tickets} time: 00:13:55 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931360/ [6931363] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_whole_object_zeroout} time: 00:12:40 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931363/ [6931364] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:17:30 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931364/ [6931365] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} time: 00:42:34 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931365/ [6931366] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_kernel} time: 00:13:49 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931366/ [6931367] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_iozone} time: 00:20:12 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931367/ [6931368] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_snapshot_io} time: 00:14:15 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931368/ [6931369] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_map_unmap} time: 00:18:35 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931369/ [6931370] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_trivial_sync} time: 00:16:01 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931370/ [6931372] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_deep_flatten} time: 00:12:45 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931372/ [6931373] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:29:03 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931373/ [6931374] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_fio} time: 00:31:47 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931374/ [6931375] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_data_pool} time: 00:22:36 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931375/ [6931376] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} time: 00:12:02 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931376/ [6931377] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} time: 00:24:25 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931377/ [6931379] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_kernel_untar_build} time: 00:24:18 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931379/ [6931380] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_fallocate} time: 00:15:47 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931380/ [6931382] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_dbench} time: 00:42:06 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931382/ [6931383] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_latest_osdmap_on_map} time: 00:18:00 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931383/ [6931384] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard} time: 00:13:34 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931384/ [6931385] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:21:23 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931385/ [6931387] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_ffsb} time: 01:11:48 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931387/ [6931388] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_enumerate} time: 00:43:06 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931388/ [6931390] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_fsstress} time: 00:15:54 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931390/ [6931391] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_udev_netns} time: 00:14:41 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931391/ [6931392] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_huge_image} time: 00:11:59 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931392/ [6931393] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:26:26 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931393/ [6931394] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:17:43 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931394/ [6931396] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} time: 00:15:48 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931396/ [6931397] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_concurrent} time: 00:20:20 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931397/ [6931398] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_huge_tickets} time: 00:16:30 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931398/ [6931399] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsx} time: 00:26:35 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931399/ [6931400] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_image_read} time: 00:17:12 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931400/ [6931401] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_modprobe} time: 00:13:20 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931401/ [6931402] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:33:14 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931402/ [6931404] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_iozone} time: 00:24:59 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931404/ [6931405] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_map_snapshot_io} time: 00:17:25 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931405/ [6931406] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_unmap} time: 00:22:19 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931406/ [6931407] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_trivial_sync} time: 00:19:26 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931407/ [6931408] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_simple_big} time: 00:32:50 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931408/ [6931409] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_msgr_segments} time: 00:14:01 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931409/ [6931410] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:34:33 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931410/ [6931411] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_fio} time: 00:36:20 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931411/ [6931413] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_exclusive_option} time: 00:18:44 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931413/ [6931414] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_kernel_untar_build} time: 00:25:50 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931414/ [6931415] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_fallocate} time: 00:17:34 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931415/ [6931416] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_huge_osdmap} time: 00:17:09 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931416/ [6931419] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_parent_overlap} time: 00:13:34 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931419/ [6931420] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:21:50 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931420/ [6931421] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/rbd_fio} time: 00:49:15 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931421/ [6931422] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_namespaces} time: 00:15:05 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931422/ [6931423] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_ffsb} time: 01:05:32 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931423/ [6931425] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netlink_enobufs} time: 00:22:07 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931425/ [6931428] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_read_only} time: 00:13:14 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931428/ [6931429] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:27:31 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931429/ [6931430] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_udev_symlinks} time: 00:16:48 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931430/ [6931431] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} time: 00:16:24 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931431/ [6931432] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_concurrent} time: 00:20:59 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931432/ [6931433] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_huge_tickets} time: 00:16:43 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931433/ [6931435] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_image_read} time: 00:17:03 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931435/ [6931436] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_whole_object_zeroout} time: 00:13:45 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931436/ [6931438] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_kernel} time: 00:16:17 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931438/ [6931439] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_iozone} time: 00:22:49 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931439/ [6931441] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_map_unmap} time: 00:22:05 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931441/ [6931443] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_simple_big} time: 00:36:18 info: http://pulpito.ceph.com/teuthology-2022-07-15_03:20:04-krbd-quincy-testing-default-smithi/6931443/