2023-06-03T23:51:57.624 INFO:root:teuthology version: 0.0.1.dev116+g62814ab 2023-06-03T23:51:57.645 INFO:teuthology.results:seed: '3308' 2023-06-04T02:43:59.189 INFO:root:teuthology version: 0.0.1.dev116+g62814ab 2023-06-04T02:43:59.213 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-06-04T06:30:17.081 INFO:teuthology.results:Tests finished! gathering results... 2023-06-04T06:30:33.689 INFO:scrape:Found 210 jobs 2023-06-04T06:30:39.301 INFO:scrape:Found 8 distinct failure reasons 2023-06-04T06:30:39.302 INFO:scrape:Crash: Found coredumps on ubuntu@smithi040.front.sepia.ceph.com 2023-06-04T06:30:39.302 INFO:scrape:ceph version 18.0.0-4275-g4d3e9642 (4d3e9642f733c6e311d35e619922bd92ca033fbd) reef (dev) 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f87c9889420] 2: (tcmalloc::ThreadCache::ReleaseToCentralCache(tcmalloc::ThreadCache::FreeList*, unsigned int, int)+0xe3) [0x7f87c882ffd3] 3: (tcmalloc::ThreadCache::ListTooLong(tcmalloc::ThreadCache::FreeList*, unsigned int)+0x30) [0x7f87c8830350] 4: ceph-mon(+0xde88f3) [0x559180f368f3] 5: ceph-mon(+0xde88b6) [0x559180f368b6] 6: ceph-mon(+0xde88b6) [0x559180f368b6] 7: ceph-mon(+0xde88b6) [0x559180f368b6] 8: (MgrMonitor::update_from_paxos(bool*)+0x611) [0x559180f47df1] 9: (Monitor::refresh_from_paxos(bool*)+0x104) [0x559180cb9ad4] 10: (Paxos::do_refresh()+0x52) [0x559180e2f6a2] 11: (Paxos::commit_finish()+0x699) [0x559180e38b99] 12: (C_Committed::finish(int)+0x4a) [0x559180e3bfba] 13: (Context::complete(int)+0xd) [0x559180cf4e8d] 14: (Context::complete(int)+0xd) [0x559180cf4e8d] 15: (Finisher::finisher_thread_entry()+0x18d) [0x7f87c8dc4e9d] 16: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f87c987d609] 17: clone() 2023-06-04T06:30:39.302 INFO:scrape:1 jobs: ['7295893'] 2023-06-04T06:30:39.303 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/secure', 'msgr-failures/many', 'tasks/krbd_latest_osdmap_on_map}'] 2023-06-04T06:30:39.303 INFO:scrape: 2023-06-04T06:30:39.303 INFO:scrape:Failure: Command failed (workunit test rbd/krbd_udev_enumerate.sh) on smithi145 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=aef7f6787496f28a04d0c6511a3205e79d473fa8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_udev_enumerate.sh' 2023-06-04T06:30:39.304 INFO:scrape:5 jobs: ['7295829', '7295898', '7295794', '7295758', '7295864'] 2023-06-04T06:30:39.304 INFO:scrape:suites intersection: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'tasks/krbd_udev_enumerate}'] 2023-06-04T06:30:39.304 INFO:scrape:suites union: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/crc$/{crc-rxbounce}', 'ms_mode/legacy$/{legacy-rxbounce}', 'ms_mode/legacy$/{legacy}', 'ms_mode/secure', 'msgr-failures/few', 'msgr-failures/many', 'tasks/krbd_udev_enumerate}'] 2023-06-04T06:30:39.305 INFO:scrape: 2023-06-04T06:30:39.305 INFO:scrape:Failure: Command failed on smithi195 with status 91: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K -U pool_client.0 image_client.0' 2023-06-04T06:30:39.305 INFO:scrape:2 jobs: ['7295869', '7295834'] 2023-06-04T06:30:39.306 INFO:scrape:suites intersection: ['clusters/3-node', 'conf', 'features/no-object-map', 'krbd/fsx/{ceph/ceph', 'objectstore/bluestore-bitmap', 'tasks/fsx-3-client}'] 2023-06-04T06:30:39.306 INFO:scrape:suites union: ['clusters/3-node', 'conf', 'features/no-object-map', 'krbd/fsx/{ceph/ceph', 'ms_mode$/{crc}', 'ms_mode$/{legacy-rxbounce}', 'objectstore/bluestore-bitmap', 'randomized-striping-off}', 'randomized-striping-on}', 'striping/default/{msgr-failures/few', 'striping/fancy/{msgr-failures/few', 'tasks/fsx-3-client}'] 2023-06-04T06:30:39.306 INFO:scrape: 2023-06-04T06:30:39.306 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/concurrent.sh 2023-06-04T06:30:39.307 INFO:scrape:1 jobs: ['7295906'] 2023-06-04T06:30:39.307 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/secure', 'msgr-failures/many', 'tasks/rbd_concurrent}'] 2023-06-04T06:30:39.307 INFO:scrape: 2023-06-04T06:30:39.307 INFO:scrape:Failure: Command failed on smithi176 with status 91: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 1 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K -U pool_client.1 image_client.1' 2023-06-04T06:30:39.308 INFO:scrape:3 jobs: ['7295903', '7295730', '7295763'] 2023-06-04T06:30:39.308 INFO:scrape:suites intersection: ['clusters/3-node', 'conf', 'krbd/fsx/{ceph/ceph', 'objectstore/bluestore-bitmap', 'tasks/fsx-3-client}'] 2023-06-04T06:30:39.308 INFO:scrape:suites union: ['clusters/3-node', 'conf', 'features/no-object-map', 'features/object-map', 'krbd/fsx/{ceph/ceph', 'ms_mode$/{crc}', 'ms_mode$/{legacy-rxbounce}', 'ms_mode$/{secure}', 'objectstore/bluestore-bitmap', 'randomized-striping-off}', 'randomized-striping-on}', 'striping/default/{msgr-failures/few', 'striping/default/{msgr-failures/many', 'striping/fancy/{msgr-failures/few', 'tasks/fsx-3-client}'] 2023-06-04T06:30:39.309 INFO:scrape: 2023-06-04T06:30:39.309 INFO:scrape:Failure: Command failed on smithi203 with status 10: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/exclude25slk62z -r -- '-g auto -g blockdev -x clone'" 2023-06-04T06:30:39.309 INFO:scrape:2 jobs: ['7295712', '7295818'] 2023-06-04T06:30:39.310 INFO:scrape:suites intersection: ['conf', 'krbd/singleton/{bluestore-bitmap', 'tasks/rbd_xfstests}'] 2023-06-04T06:30:39.310 INFO:scrape:suites union: ['conf', 'krbd/singleton/{bluestore-bitmap', 'ms_mode$/{crc-rxbounce}', 'ms_mode$/{crc}', 'msgr-failures/few', 'msgr-failures/many', 'tasks/rbd_xfstests}'] 2023-06-04T06:30:39.310 INFO:scrape: 2023-06-04T06:30:39.310 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nightly_pre-single-major 2023-06-04T06:30:39.311 INFO:scrape:1 jobs: ['7295714'] 2023-06-04T06:30:39.311 INFO:scrape:suites: ['clusters/separate-client', 'conf', 'kernels/pre-single-major', 'krbd/unmap/{ceph/ceph', 'tasks/unmap}'] 2023-06-04T06:30:39.311 INFO:scrape: 2023-06-04T06:30:39.311 INFO:scrape:Failure: Command failed on smithi114 with status 2: 'sudo dpkg -i /tmp/linux-image.deb' 2023-06-04T06:30:39.312 INFO:scrape:1 jobs: ['7295804'] 2023-06-04T06:30:39.312 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'krbd/rbd/{bluestore-bitmap', 'ms_mode/legacy$/{legacy-rxbounce}', 'msgr-failures/few', 'tasks/rbd_workunit_suites_fsx}'] 2023-06-04T06:30:39.312 INFO:scrape: 2023-06-04T06:30:39.320 INFO:teuthology.results:Sending results to idryomov@gmail.com: Test Run: dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi ================================================================= info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/ failed: 16 dead: 0 running: 0 waiting: 0 queued: 0 passed: 194 Fail ================================================================= [7295712] krbd/singleton/{bluestore-bitmap conf ms_mode$/{crc-rxbounce} msgr-failures/few tasks/rbd_xfstests} ----------------------------------------------------------------- time: 03:35:13 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295712/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295712/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ee0159f016e0492b94ab65799dc44a07 Command failed on smithi203 with status 10: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/exclude25slk62z -r -- '-g auto -g blockdev -x clone'" [7295714] krbd/unmap/{ceph/ceph clusters/separate-client conf kernels/pre-single-major tasks/unmap} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295714/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295714/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0337cfcc912d40a5a91e6fcc17b2ca11 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&re f=nightly_pre-single-major [7295730] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} ----------------------------------------------------------------- time: 00:15:13 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295730/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295730/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e2779b02c94c4b1eb80a23e7298965a4 Command failed on smithi103 with status 91: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 2 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K pool_client.2 image_client.2' [7295758] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate} ----------------------------------------------------------------- time: 00:14:34 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295758/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295758/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3d172b8f65bb4f60b2cac3a497f1c0f0 Command failed (workunit test rbd/krbd_udev_enumerate.sh) on smithi142 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=aef7f6787496f28a04d0c6511a3205e79d473fa8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rbd/krbd_udev_enumerate.sh' [7295763] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} ----------------------------------------------------------------- time: 00:12:58 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295763/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295763/ sentry: https://sentry.ceph.com/organizations/ceph/?query=47f95521404845d184257786822b1473 Command failed on smithi072 with status 91: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K -U pool_client.0 image_client.0' [7295794] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_udev_enumerate} ----------------------------------------------------------------- time: 00:14:11 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295794/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295794/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f13fb3e39ca8463a9491272ef0eeb7fb Command failed (workunit test rbd/krbd_udev_enumerate.sh) on smithi145 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=aef7f6787496f28a04d0c6511a3205e79d473fa8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rbd/krbd_udev_enumerate.sh' [7295804] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsx} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295804/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295804/ sentry: https://sentry.ceph.com/organizations/ceph/?query=92b2b68121614199844e8383e046ec9f Command failed on smithi114 with status 2: 'sudo dpkg -i /tmp/linux- image.deb' [7295818] krbd/singleton/{bluestore-bitmap conf ms_mode$/{crc} msgr-failures/many tasks/rbd_xfstests} ----------------------------------------------------------------- time: 03:49:26 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295818/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295818/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a78411f03b95441a8de319fb79ad0d9d Command failed on smithi194 with status 10: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludenpwx8p16 -r -- '-g auto -g blockdev -x clone'" [7295829] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_udev_enumerate} ----------------------------------------------------------------- time: 00:15:28 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295829/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295829/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b549616fa96d4731975a46f9f31b5018 Command failed (workunit test rbd/krbd_udev_enumerate.sh) on smithi145 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=aef7f6787496f28a04d0c6511a3205e79d473fa8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rbd/krbd_udev_enumerate.sh' [7295834] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} ----------------------------------------------------------------- time: 00:13:34 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295834/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295834/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c0491003aa40411392ce6932b2535bcc Command failed on smithi179 with status 91: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 2 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K pool_client.2 image_client.2' [7295864] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_enumerate} ----------------------------------------------------------------- time: 00:13:51 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295864/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295864/ sentry: https://sentry.ceph.com/organizations/ceph/?query=58ba39e94cf84bcabaef41701f3dc7dd Command failed (workunit test rbd/krbd_udev_enumerate.sh) on smithi145 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=aef7f6787496f28a04d0c6511a3205e79d473fa8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rbd/krbd_udev_enumerate.sh' [7295869] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} ----------------------------------------------------------------- time: 00:14:20 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295869/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295869/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ca3b6fc893ed477baaf4589146be5a99 Command failed on smithi195 with status 91: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K -U pool_client.0 image_client.0' [7295893] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_latest_osdmap_on_map} ----------------------------------------------------------------- time: 00:18:01 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295893/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295893/ Found coredumps on ubuntu@smithi040.front.sepia.ceph.com [7295898] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_udev_enumerate} ----------------------------------------------------------------- time: 00:14:47 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295898/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295898/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2bd03d3f6c654b459a855e3bf8243692 Command failed (workunit test rbd/krbd_udev_enumerate.sh) on smithi186 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=aef7f6787496f28a04d0c6511a3205e79d473fa8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rbd/krbd_udev_enumerate.sh' [7295903] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} ----------------------------------------------------------------- time: 00:13:04 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295903/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295903/ sentry: https://sentry.ceph.com/organizations/ceph/?query=041d7fa0e2f04089af15f61036d245eb Command failed on smithi176 with status 91: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 1 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K -U pool_client.1 image_client.1' [7295906] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_concurrent} ----------------------------------------------------------------- time: 03:40:08 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295906/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295906/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ded9412f2a8e4bdeb31c4da0c7c2df2e Command failed (workunit test rbd/concurrent.sh) on smithi195 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=aef7f6787496f28a04d0c6511a3205e79d473fa8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/concurrent.sh' Pass ================================================================= [7295707] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_deep_flatten} time: 00:13:57 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295707/ [7295708] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:22:32 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295708/ [7295709] krbd/ms_modeless/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/krbd_default_map_options} time: 00:13:27 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295709/ [7295710] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_fio} time: 00:31:35 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295710/ [7295711] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_data_pool} time: 00:23:42 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295711/ [7295713] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/rbd_fio} time: 00:42:34 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295713/ [7295715] krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes} time: 00:13:12 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295715/ [7295716] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_exclusive_option} time: 00:17:48 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295716/ [7295717] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_kernel_untar_build} time: 00:21:03 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295717/ [7295718] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_fallocate} time: 00:15:12 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295718/ [7295719] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_huge_osdmap} time: 00:14:50 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295719/ [7295720] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_dbench} time: 00:39:22 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295720/ [7295721] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_latest_osdmap_on_map} time: 00:17:32 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295721/ [7295722] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_discard} time: 00:12:54 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295722/ [7295723] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_namespaces} time: 00:15:12 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295723/ [7295724] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_ffsb} time: 01:09:51 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295724/ [7295725] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_udev_enumerate} time: 00:36:27 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295725/ [7295726] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_udev_netlink_enobufs} time: 00:18:35 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295726/ [7295727] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsstress} time: 00:15:11 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295727/ [7295728] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netns} time: 00:14:56 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295728/ [7295729] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_huge_image} time: 00:12:25 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295729/ [7295731] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_udev_symlinks} time: 00:17:41 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295731/ [7295732] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} time: 00:14:10 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295732/ [7295733] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_concurrent} time: 00:19:22 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295733/ [7295734] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_huge_tickets} time: 00:14:32 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295734/ [7295735] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsx} time: 00:21:54 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295735/ [7295736] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_image_read} time: 00:14:16 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295736/ [7295737] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_modprobe} time: 00:12:52 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295737/ [7295738] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 00:59:27 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295738/ [7295739] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_kernel} time: 00:16:28 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295739/ [7295740] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_iozone} time: 00:19:52 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295740/ [7295741] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io} time: 00:13:34 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295741/ [7295742] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_map_unmap} time: 00:19:23 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295742/ [7295743] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_trivial_sync} time: 00:14:13 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295743/ [7295744] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_simple_big} time: 00:23:23 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295744/ [7295745] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_msgr_segments} time: 00:12:04 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295745/ [7295746] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:26:32 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295746/ [7295747] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio} time: 00:30:30 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295747/ [7295748] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_data_pool} time: 00:25:45 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295748/ [7295749] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_exclusive_option} time: 00:17:16 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295749/ [7295750] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_kernel_untar_build} time: 00:23:02 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295750/ [7295751] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_fallocate} time: 00:14:52 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295751/ [7295752] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_huge_osdmap} time: 00:15:05 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295752/ [7295753] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_dbench} time: 00:40:12 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295753/ [7295754] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_latest_osdmap_on_map} time: 00:17:28 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295754/ [7295755] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_parent_overlap} time: 00:12:00 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295755/ [7295756] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_namespaces} time: 00:14:04 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295756/ [7295757] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_ffsb} time: 00:55:57 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295757/ [7295759] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_udev_netlink_enobufs} time: 00:19:00 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295759/ [7295760] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_fsstress} time: 00:16:03 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295760/ [7295761] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_udev_netns} time: 00:14:44 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295761/ [7295762] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_read_only} time: 00:12:38 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295762/ [7295764] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/pggrow thrashosds-health workloads/rbd_fio} time: 00:40:18 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295764/ [7295765] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks} time: 00:15:35 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295765/ [7295766] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} time: 00:14:26 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295766/ [7295767] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_concurrent} time: 03:14:55 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295767/ [7295768] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_huge_tickets} time: 00:14:26 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295768/ [7295769] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx} time: 00:22:41 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295769/ [7295770] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read} time: 00:15:07 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295770/ [7295771] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_whole_object_zeroout} time: 00:13:52 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295771/ [7295772] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_kernel} time: 00:14:07 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295772/ [7295773] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_iozone} time: 00:18:37 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295773/ [7295774] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_map_snapshot_io} time: 00:13:55 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295774/ [7295775] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap} time: 00:18:56 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295775/ [7295776] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_trivial_sync} time: 00:15:22 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295776/ [7295777] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_simple_big} time: 00:26:23 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295777/ [7295778] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_deep_flatten} time: 00:12:59 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295778/ [7295779] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:25:09 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295779/ [7295780] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_fio} time: 00:29:41 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295780/ [7295781] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_data_pool} time: 00:21:46 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295781/ [7295782] krbd/unmap/{ceph/ceph clusters/separate-client conf kernels/single-major-off tasks/unmap} time: 00:13:31 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295782/ [7295783] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} time: 00:23:48 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295783/ [7295784] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_exclusive_option} time: 00:14:35 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295784/ [7295785] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_kernel_untar_build} time: 00:21:33 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295785/ [7295786] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_fallocate} time: 00:14:45 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295786/ [7295787] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_huge_osdmap} time: 00:15:12 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295787/ [7295788] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_dbench} time: 00:39:22 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295788/ [7295789] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_latest_osdmap_on_map} time: 00:16:55 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295789/ [7295790] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_discard} time: 00:13:16 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295790/ [7295791] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:00:45 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295791/ [7295792] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_namespaces} time: 00:14:37 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295792/ [7295793] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_ffsb} time: 01:03:53 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295793/ [7295795] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netlink_enobufs} time: 00:19:10 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295795/ [7295796] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress} time: 00:14:41 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295796/ [7295797] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_udev_netns} time: 00:14:22 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295797/ [7295798] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_huge_image} time: 00:12:24 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295798/ [7295799] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:21:26 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295799/ [7295800] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_udev_symlinks} time: 00:15:41 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295800/ [7295801] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} time: 00:14:22 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295801/ [7295802] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent} time: 00:17:58 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295802/ [7295803] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_huge_tickets} time: 00:14:13 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295803/ [7295805] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_image_read} time: 00:13:42 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295805/ [7295806] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_modprobe} time: 00:12:19 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295806/ [7295807] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_kernel} time: 00:14:27 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295807/ [7295808] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_iozone} time: 00:20:25 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295808/ [7295809] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_map_snapshot_io} time: 00:14:19 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295809/ [7295810] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_map_unmap} time: 00:19:38 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295810/ [7295811] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_trivial_sync} time: 00:14:33 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295811/ [7295812] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_simple_big} time: 00:24:26 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295812/ [7295813] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_msgr_segments} time: 00:12:52 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295813/ [7295814] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:24:16 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295814/ [7295815] krbd/ms_modeless/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/krbd_rxbounce} time: 00:14:42 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295815/ [7295816] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_fio} time: 00:30:06 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295816/ [7295817] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_data_pool} time: 00:25:33 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295817/ [7295819] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:00:52 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295819/ [7295820] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_exclusive_option} time: 00:14:49 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295820/ [7295821] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_kernel_untar_build} time: 00:20:49 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295821/ [7295822] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_fallocate} time: 00:14:23 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295822/ [7295823] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_huge_osdmap} time: 00:14:44 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295823/ [7295824] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_dbench} time: 00:39:29 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295824/ [7295825] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_latest_osdmap_on_map} time: 00:17:57 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295825/ [7295826] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_parent_overlap} time: 00:11:50 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295826/ [7295827] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_namespaces} time: 00:14:09 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295827/ [7295828] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_ffsb} time: 00:55:13 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295828/ [7295830] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_udev_netlink_enobufs} time: 00:18:44 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295830/ [7295831] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsstress} time: 00:15:54 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295831/ [7295832] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netns} time: 00:15:04 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295832/ [7295833] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only} time: 00:13:10 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295833/ [7295835] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_udev_symlinks} time: 00:14:41 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295835/ [7295836] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} time: 00:13:48 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295836/ [7295837] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_concurrent} time: 01:16:59 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295837/ [7295838] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_huge_tickets} time: 00:13:47 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295838/ [7295839] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_fsx} time: 00:22:36 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295839/ [7295840] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_image_read} time: 00:13:34 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295840/ [7295841] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_whole_object_zeroout} time: 00:12:30 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295841/ [7295842] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} time: 00:38:54 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295842/ [7295843] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_kernel} time: 00:13:26 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295843/ [7295844] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_iozone} time: 00:18:47 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295844/ [7295845] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_snapshot_io} time: 00:13:26 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295845/ [7295846] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_map_unmap} time: 00:18:27 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295846/ [7295847] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_trivial_sync} time: 00:16:13 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295847/ [7295848] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_simple_big} time: 00:24:45 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295848/ [7295849] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_deep_flatten} time: 00:12:25 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295849/ [7295850] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:30:03 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295850/ [7295851] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_fio} time: 00:30:59 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295851/ [7295852] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_data_pool} time: 00:23:31 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295852/ [7295853] krbd/unmap/{ceph/ceph clusters/separate-client conf kernels/single-major-on tasks/unmap} time: 00:13:11 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295853/ [7295854] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} time: 00:25:22 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295854/ [7295855] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_exclusive_option} time: 00:15:26 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295855/ [7295856] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_kernel_untar_build} time: 00:21:13 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295856/ [7295857] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_fallocate} time: 00:14:12 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295857/ [7295858] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_huge_osdmap} time: 00:15:49 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295858/ [7295859] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_dbench} time: 00:39:37 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295859/ [7295860] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_latest_osdmap_on_map} time: 00:16:47 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295860/ [7295861] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard} time: 00:12:34 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295861/ [7295862] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_namespaces} time: 00:14:59 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295862/ [7295863] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_ffsb} time: 01:03:32 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295863/ [7295865] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_udev_netlink_enobufs} time: 00:19:52 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295865/ [7295866] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsstress} time: 00:14:50 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295866/ [7295867] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_udev_netns} time: 00:14:19 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295867/ [7295868] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_huge_image} time: 00:12:31 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295868/ [7295870] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:01:16 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295870/ [7295871] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_symlinks} time: 00:15:53 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295871/ [7295872] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} time: 00:14:43 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295872/ [7295873] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_concurrent} time: 00:19:41 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295873/ [7295874] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_huge_tickets} time: 00:14:48 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295874/ [7295875] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsx} time: 00:21:42 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295875/ [7295876] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_image_read} time: 00:14:07 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295876/ [7295877] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_modprobe} time: 00:12:51 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295877/ [7295878] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_kernel} time: 00:14:37 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295878/ [7295879] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_iozone} time: 00:19:38 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295879/ [7295880] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_map_snapshot_io} time: 00:13:55 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295880/ [7295881] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_unmap} time: 00:19:22 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295881/ [7295882] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_trivial_sync} time: 00:14:44 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295882/ [7295883] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_simple_big} time: 00:22:58 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295883/ [7295884] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_msgr_segments} time: 00:13:25 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295884/ [7295885] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:25:33 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295885/ [7295886] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_fio} time: 00:32:14 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295886/ [7295887] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_data_pool} time: 00:25:48 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295887/ [7295888] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_exclusive_option} time: 00:14:31 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295888/ [7295889] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_kernel_untar_build} time: 00:20:36 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295889/ [7295890] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_fallocate} time: 00:14:31 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295890/ [7295891] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_huge_osdmap} time: 00:13:58 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295891/ [7295892] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_dbench} time: 00:40:23 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295892/ [7295894] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_parent_overlap} time: 00:12:15 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295894/ [7295895] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/rbd_fio} time: 00:39:25 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295895/ [7295896] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_namespaces} time: 00:14:16 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295896/ [7295897] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_ffsb} time: 00:57:00 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295897/ [7295899] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netlink_enobufs} time: 00:18:31 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295899/ [7295900] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress} time: 00:15:40 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295900/ [7295901] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_udev_netns} time: 00:14:30 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295901/ [7295902] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_read_only} time: 00:12:21 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295902/ [7295904] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_udev_symlinks} time: 00:14:23 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295904/ [7295905] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} time: 00:13:41 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295905/ [7295907] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_huge_tickets} time: 00:14:03 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295907/ [7295908] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_fsx} time: 00:21:55 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295908/ [7295909] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_image_read} time: 00:14:18 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295909/ [7295910] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_whole_object_zeroout} time: 00:12:55 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295910/ [7295911] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_kernel} time: 00:13:12 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295911/ [7295912] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_iozone} time: 00:18:20 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295912/ [7295913] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_map_snapshot_io} time: 00:13:30 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295913/ [7295914] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_map_unmap} time: 00:18:46 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295914/ [7295915] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_trivial_sync} time: 00:14:54 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295915/ [7295916] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_simple_big} time: 00:25:38 info: http://pulpito.ceph.com/dis-2023-06-03_23:51:22-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295916/