2024-04-14T02:20:45.802 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-04-14T02:20:45.802 INFO:teuthology.results:subset: '1/4' 2024-04-14T02:20:45.802 INFO:teuthology.results:seed: '2666' 2024-04-14T03:25:03.252 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-04-14T03:25:03.449 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-04-14T06:04:16.316 INFO:teuthology.results:Tests finished! gathering results... 2024-04-14T06:04:21.595 INFO:scrape:Found 73 jobs 2024-04-14T06:04:26.591 INFO:scrape:Found 5 distinct failure reasons 2024-04-14T06:04:26.592 INFO:scrape:Failure: Command failed (workunit test rbd/krbd_rxbounce.sh) on smithi191 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e3fb05d5e6da84b5c44db3f3051c4d242f9809c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_rxbounce.sh' 2024-04-14T06:04:26.592 INFO:scrape:1 jobs: ['7655480'] 2024-04-14T06:04:26.592 INFO:scrape:suites: ['ceph/ceph', 'clusters/fixed-3', 'conf', 'krbd/ms_modeless/{bluestore-bitmap', 'tasks/krbd_rxbounce}'] 2024-04-14T06:04:26.592 INFO:scrape: 2024-04-14T06:04:26.592 INFO:scrape:Failure: Command failed (workunit test rbd/diff_continuous.sh) on smithi178 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e3fb05d5e6da84b5c44db3f3051c4d242f9809c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' 2024-04-14T06:04:26.592 INFO:scrape:1 jobs: ['7655445'] 2024-04-14T06:04:26.592 INFO:scrape:suites: ['ceph/ceph', 'clusters/fixed-3', 'conf', 'krbd/thrash/{bluestore-bitmap', 'ms_mode$/{legacy}', 'thrashers/pggrow', 'thrashosds-health', 'workloads/krbd_diff_continuous}'] 2024-04-14T06:04:26.593 INFO:scrape: 2024-04-14T06:04:26.593 INFO:scrape:Failure: Command failed on smithi131 with status 1: 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t' 2024-04-14T06:04:26.593 INFO:scrape:2 jobs: ['7655439', '7655489'] 2024-04-14T06:04:26.593 INFO:scrape:suites intersection: ['ceph/ceph', 'clusters/fixed-1', 'conf', 'krbd/basic/{bluestore-bitmap', 'tasks/krbd_msgr_segments}'] 2024-04-14T06:04:26.593 INFO:scrape:suites union: ['ceph/ceph', 'clusters/fixed-1', 'conf', 'krbd/basic/{bluestore-bitmap', 'ms_mode/crc$/{crc}', 'ms_mode/secure', 'tasks/krbd_msgr_segments}'] 2024-04-14T06:04:26.593 INFO:scrape: 2024-04-14T06:04:26.593 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=nightly_pre-single-major 2024-04-14T06:04:26.593 INFO:scrape:1 jobs: ['7655446'] 2024-04-14T06:04:26.593 INFO:scrape:suites: ['clusters/separate-client', 'conf', 'kernels/pre-single-major', 'krbd/unmap/{ceph/ceph', 'tasks/unmap}'] 2024-04-14T06:04:26.593 INFO:scrape: 2024-04-14T06:04:26.593 INFO:scrape:Failure: Command failed on smithi136 with status 10: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludeqk3ngmtd -r -- '-g auto -g blockdev -x clone'" 2024-04-14T06:04:26.594 INFO:scrape:2 jobs: ['7655481', '7655444'] 2024-04-14T06:04:26.594 INFO:scrape:suites intersection: ['conf', 'krbd/singleton-msgr-failures/{bluestore-bitmap', 'ms_mode$/{legacy-rxbounce}', 'tasks/rbd_xfstests}'] 2024-04-14T06:04:26.594 INFO:scrape:suites union: ['conf', 'krbd/singleton-msgr-failures/{bluestore-bitmap', 'ms_mode$/{legacy-rxbounce}', 'msgr-failures/few', 'msgr-failures/many', 'tasks/rbd_xfstests}'] 2024-04-14T06:04:26.594 INFO:scrape: 2024-04-14T06:04:26.596 INFO:teuthology.results:Sending results to ceph-qa@ceph.com: Test Run: teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi ================================================================= info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/ failed: 7 dead: 0 running: 0 waiting: 0 queued: 0 passed: 66 Fail ================================================================= [7655439] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_msgr_segments} ----------------------------------------------------------------- time: 00:13:36 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655439/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655439/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d3904473d8014940b643006a070ae800 Command failed on smithi131 with status 1: 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t' [7655444] krbd/singleton-msgr-failures/{bluestore-bitmap conf ms_mode$/{legacy-rxbounce} msgr-failures/few tasks/rbd_xfstests} ----------------------------------------------------------------- time: 02:36:24 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655444/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655444/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b2c98e7afeb34790933e1312e61f6397 Command failed on smithi204 with status 10: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludel41io39r -r -- '-g auto -g blockdev -x clone'" [7655445] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:27:52 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655445/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655445/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c5a6941a3b644b74a00f6f7595a72a59 Command failed (workunit test rbd/diff_continuous.sh) on smithi178 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e3fb05d5e6da84b5c44db3f3051c4d242f9809c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7655446] krbd/unmap/{ceph/ceph clusters/separate-client conf kernels/pre-single-major tasks/unmap} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655446/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655446/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c927e58462df4a7895ee7346cbb3dda5 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=ni ghtly_pre-single-major [7655480] krbd/ms_modeless/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/krbd_rxbounce} ----------------------------------------------------------------- time: 00:14:29 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655480/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655480/ sentry: https://sentry.ceph.com/organizations/ceph/?query=90292667a13b41eab30141ea8b5a2cf3 Command failed (workunit test rbd/krbd_rxbounce.sh) on smithi191 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e3fb05d5e6da84b5c44db3f3051c4d242f9809c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_rxbounce.sh' [7655481] krbd/singleton-msgr-failures/{bluestore-bitmap conf ms_mode$/{legacy-rxbounce} msgr-failures/many tasks/rbd_xfstests} ----------------------------------------------------------------- time: 02:51:38 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655481/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655481/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ba369fa6dfa7471992dd2eb7117673c5 Command failed on smithi136 with status 10: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludeqk3ngmtd -r -- '-g auto -g blockdev -x clone'" [7655489] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_msgr_segments} ----------------------------------------------------------------- time: 00:13:36 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655489/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655489/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a558a126d94c4585b7a62cefe28f6d27 Command failed on smithi162 with status 1: 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t' Pass ================================================================= [7655438] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_udev_netns} time: 00:15:28 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655438/ [7655440] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:22:27 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655440/ [7655441] krbd/mirror/{bluestore-bitmap clusters/2-node conf install/ceph ms_mode$/{legacy-rxbounce} tasks/compare-mirror-image-alternate-primary} time: 02:58:15 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655441/ [7655442] krbd/ms_modeless/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/krbd_default_map_options} time: 00:14:27 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655442/ [7655443] krbd/singleton/{bluestore-bitmap conf ms_mode$/{crc} tasks/krbd_watch_errors} time: 01:29:04 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655443/ [7655447] krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes} time: 00:13:56 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655447/ [7655448] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks} time: 00:15:19 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655448/ [7655449] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} time: 00:14:53 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655449/ [7655450] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_concurrent} time: 00:19:35 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655450/ [7655451] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_parent_overlap} time: 00:14:02 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655451/ [7655452] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_huge_tickets} time: 00:14:51 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655452/ [7655453] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx} time: 00:18:44 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655453/ [7655454] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read} time: 00:14:53 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655454/ [7655455] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only} time: 00:14:14 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655455/ [7655456] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:22:29 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655456/ [7655457] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_kernel} time: 00:14:40 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655457/ [7655458] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_iozone} time: 00:17:51 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655458/ [7655459] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_map_snapshot_io} time: 00:15:06 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655459/ [7655460] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap} time: 00:19:32 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655460/ [7655461] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_trivial_sync} time: 00:15:22 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655461/ [7655462] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_simple_big} time: 00:24:42 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655462/ [7655463] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_deep_flatten} time: 00:13:59 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655463/ [7655464] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:26:33 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655464/ [7655465] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_fio} time: 00:32:32 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655465/ [7655466] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_data_pool} time: 00:19:49 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655466/ [7655467] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 00:46:32 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655467/ [7655468] krbd/unmap/{ceph/ceph clusters/separate-client conf kernels/single-major-off tasks/unmap} time: 00:14:27 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655468/ [7655469] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} time: 00:25:50 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655469/ [7655470] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_exclusive_option} time: 00:15:44 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655470/ [7655471] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_kernel_untar_build} time: 00:21:17 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655471/ [7655472] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_fallocate} time: 00:14:53 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655472/ [7655473] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard} time: 00:14:17 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655473/ [7655474] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_huge_osdmap} time: 00:15:24 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655474/ [7655475] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_dbench} time: 00:40:42 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655475/ [7655476] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_latest_osdmap_on_map} time: 00:18:00 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655476/ [7655477] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_huge_image} time: 00:13:23 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655477/ [7655478] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:18:14 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655478/ [7655479] krbd/mirror/{bluestore-bitmap clusters/2-node conf install/ceph ms_mode$/{crc-rxbounce} tasks/compare-mirror-images} time: 01:41:31 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655479/ [7655482] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_namespaces} time: 00:15:32 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655482/ [7655483] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_ffsb} time: 00:41:04 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655483/ [7655484] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_udev_enumerate} time: 00:38:57 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655484/ [7655485] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_modprobe} time: 00:13:56 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655485/ [7655486] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netlink_enobufs} time: 00:20:19 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655486/ [7655487] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress} time: 00:15:37 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655487/ [7655488] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_udev_netns} time: 00:15:30 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655488/ [7655490] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:23:25 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655490/ [7655491] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/pggrow thrashosds-health workloads/rbd_fio} time: 00:40:38 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655491/ [7655492] krbd/unmap/{ceph/ceph clusters/separate-client conf kernels/single-major-on tasks/unmap} time: 00:14:00 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655492/ [7655493] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} time: 00:25:40 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655493/ [7655494] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_udev_symlinks} time: 00:16:38 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655494/ [7655495] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} time: 00:15:59 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655495/ [7655496] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent} time: 00:19:57 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655496/ [7655497] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_parent_overlap} time: 00:13:57 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655497/ [7655498] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_huge_tickets} time: 00:15:32 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655498/ [7655499] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsx} time: 00:18:18 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655499/ [7655500] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_image_read} time: 00:14:40 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655500/ [7655501] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_read_only} time: 00:14:22 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655501/ [7655502] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:20:30 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655502/ [7655503] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 00:40:26 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655503/ [7655504] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_kernel} time: 00:14:34 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655504/ [7655505] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_iozone} time: 00:18:52 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655505/ [7655506] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_map_snapshot_io} time: 00:14:27 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655506/ [7655507] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_whole_object_zeroout} time: 00:13:56 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655507/ [7655508] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_map_unmap} time: 00:19:47 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655508/ [7655509] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_trivial_sync} time: 00:15:05 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655509/ [7655510] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_simple_big} time: 00:23:34 info: https://pulpito.ceph.com/teuthology-2024-04-13_22:48:02-krbd-reef-testing-default-smithi/7655510/