2022-03-28T04:51:54.182 INFO:root:teuthology version: 1.1.0-70390753 2022-03-28T04:51:54.184 INFO:teuthology.results:subset: '111/120000' 2022-03-28T04:51:54.184 INFO:teuthology.results:seed: '9566' 2022-03-28T05:42:51.094 INFO:root:teuthology version: 1.1.0-70390753 2022-03-28T05:42:51.110 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-03-28T11:06:14.951 INFO:teuthology.results:Tests finished! gathering results... 2022-03-28T11:06:20.661 INFO:scrape:Found 65 jobs 2022-03-28T11:06:23.637 INFO:scrape:Found 4 distinct failure reasons 2022-03-28T11:06:23.638 INFO:scrape:Failure: "2022-03-28T05:50:09.545739+0000 mon.a (mon.0) 332 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log 2022-03-28T11:06:23.638 INFO:scrape:9 jobs: ['6764423', '6764445', '6764402', '6764436', '6764408', '6764398', '6764403', '6764427', '6764389'] 2022-03-28T11:06:23.639 INFO:scrape:suites intersection: ['conf'] 2022-03-28T11:06:23.639 INFO:scrape:suites union: ['ceph/ceph', 'clusters/3-node', 'clusters/fixed-3', 'conf', 'features/object-map', 'install/ceph', 'krbd/fsx/{ceph/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'krbd/rbd/{bluestore-bitmap', 'krbd/wac/wac/{bluestore-bitmap', 'ms_mode$/{crc-rxbounce}', 'ms_mode$/{secure}', 'ms_mode/legacy$/{legacy-rxbounce}', 'ms_mode/legacy$/{legacy}', 'ms_mode/secure', 'msgr-failures/many', 'objectstore/bluestore-bitmap', 'randomized-striping-off}', 'striping/default/{msgr-failures/many', 'tasks/fsx-1-client}', 'tasks/fsx-3-client}', 'tasks/krbd_data_pool}', 'tasks/krbd_fallocate}', 'tasks/krbd_udev_enumerate}', 'tasks/krbd_udev_netns}', 'tasks/rbd_fio}', 'tasks/rbd_kernel}', 'tasks/wac', 'verify/many-resets}'] 2022-03-28T11:06:23.640 INFO:scrape: 2022-03-28T11:06:23.640 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/concurrent.sh 2022-03-28T11:06:23.640 INFO:scrape:1 jobs: ['6764433'] 2022-03-28T11:06:23.641 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/crc$/{crc-rxbounce}', 'msgr-failures/many', 'tasks/rbd_concurrent}'] 2022-03-28T11:06:23.641 INFO:scrape: 2022-03-28T11:06:23.642 INFO:scrape:Failure: Command failed on smithi174 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excluder7ayys89 -r -- '-g auto -g blockdev -x clone'" 2022-03-28T11:06:23.642 INFO:scrape:2 jobs: ['6764413', '6764447'] 2022-03-28T11:06:23.643 INFO:scrape:suites intersection: ['conf', 'krbd/singleton/{bluestore-bitmap', 'tasks/rbd_xfstests}'] 2022-03-28T11:06:23.643 INFO:scrape:suites union: ['conf', 'krbd/singleton/{bluestore-bitmap', 'ms_mode$/{crc}', 'ms_mode$/{legacy}', 'msgr-failures/few', 'msgr-failures/many', 'tasks/rbd_xfstests}'] 2022-03-28T11:06:23.644 INFO:scrape: 2022-03-28T11:06:23.644 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nightly_pre-single-major 2022-03-28T11:06:23.645 INFO:scrape:1 jobs: ['6764415'] 2022-03-28T11:06:23.645 INFO:scrape:suites: ['clusters/separate-client', 'conf', 'filestore-xfs', 'kernels/pre-single-major', 'krbd/unmap/{ceph/ceph', 'tasks/unmap}'] 2022-03-28T11:06:23.645 INFO:scrape: 2022-03-28T11:06:23.648 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/ failed: 13 dead: 0 running: 0 waiting: 0 queued: 0 passed: 52 Fail ================================================================= [6764389] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_kernel} ----------------------------------------------------------------- time: 00:19:57 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764389/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764389/ sentry: https://sentry.ceph.com/organizations/ceph/?query=811dad7aebc049e49d769f6f101352c6 "2022-03-28T05:12:02.218178+0000 mon.a (mon.0) 212 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6764398] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} ----------------------------------------------------------------- time: 00:19:50 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764398/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764398/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d7e8ec7d267649b397c8dacceae88310 "2022-03-28T05:26:49.146843+0000 mon.a (mon.0) 250 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6764402] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio} ----------------------------------------------------------------- time: 00:19:54 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764402/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764402/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ce2ba5bb1d5d4c45a6a9ac9a3aeb7690 "2022-03-28T05:31:44.371942+0000 mon.a (mon.0) 275 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6764403] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_data_pool} ----------------------------------------------------------------- time: 00:19:38 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764403/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764403/ sentry: https://sentry.ceph.com/organizations/ceph/?query=192ac11d1e324883a867a8a23d1d05e9 "2022-03-28T05:32:05.644592+0000 mon.a (mon.0) 243 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6764408] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_fallocate} ----------------------------------------------------------------- time: 00:19:43 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764408/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764408/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4d41b56bb03145d2b48ff33815587f23 "2022-03-28T05:35:03.637470+0000 mon.a (mon.0) 330 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6764413] krbd/singleton/{bluestore-bitmap conf ms_mode$/{crc} msgr-failures/few tasks/rbd_xfstests} ----------------------------------------------------------------- time: 04:36:54 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764413/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764413/ sentry: https://sentry.ceph.com/organizations/ceph/?query=734c246bbb4d4edba3f95a3502cafca3 Command failed on smithi174 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excluder7ayys89 -r -- '-g auto -g blockdev -x clone'" [6764415] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764415/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764415/ sentry: https://sentry.ceph.com/organizations/ceph/?query=057822b09af24400865f91fef1983f82 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&re f=nightly_pre-single-major [6764423] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate} ----------------------------------------------------------------- time: 00:20:03 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764423/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764423/ sentry: https://sentry.ceph.com/organizations/ceph/?query=30e5acc590be4bc08b57a123aabafd65 "2022-03-28T05:50:09.545739+0000 mon.a (mon.0) 332 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6764427] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_netns} ----------------------------------------------------------------- time: 00:19:29 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764427/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764427/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5db7fc96c9ca4cd9bf89430605433e45 "2022-03-28T05:40:39.943178+0000 mon.a (mon.0) 218 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6764433] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_concurrent} ----------------------------------------------------------------- time: 03:34:24 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764433/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764433/ sentry: https://sentry.ceph.com/organizations/ceph/?query=91207f24136745819382c886aa0b9ba9 Command failed (workunit test rbd/concurrent.sh) on smithi074 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=14f44febaa74e8f8931e156f1a921292708ad47a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/concurrent.sh' [6764436] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} ----------------------------------------------------------------- time: 00:20:01 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764436/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764436/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cead058059164909aaab5dc12539f633 "2022-03-28T06:00:26.686510+0000 mon.a (mon.0) 218 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [6764445] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} ----------------------------------------------------------------- time: 00:19:47 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764445/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764445/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7be9f49435914185b11a55e48807e3f9 "2022-03-28T05:52:52.482580+0000 mon.a (mon.0) 208 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6764447] krbd/singleton/{bluestore-bitmap conf ms_mode$/{legacy} msgr-failures/many tasks/rbd_xfstests} ----------------------------------------------------------------- time: 05:17:53 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764447/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764447/ sentry: https://sentry.ceph.com/organizations/ceph/?query=baf52ac7fbcb4703bb1ad8f3d488983c Command failed on smithi176 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludeoqyr7zps -r -- '-g auto -g blockdev -x clone'" Pass ================================================================= [6764387] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_image_read} time: 00:11:07 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764387/ [6764388] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} time: 00:37:21 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764388/ [6764390] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_iozone} time: 00:17:19 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764390/ [6764391] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_deep_flatten} time: 00:10:12 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764391/ [6764392] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} time: 00:09:26 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764392/ [6764393] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} time: 00:21:35 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764393/ [6764394] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io} time: 00:10:47 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764394/ [6764395] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_map_unmap} time: 00:15:45 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764395/ [6764396] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_trivial_sync} time: 00:11:47 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764396/ [6764397] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_discard} time: 00:09:48 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764397/ [6764399] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:21:50 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764399/ [6764400] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_simple_big} time: 00:23:47 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764400/ [6764401] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_huge_image} time: 00:09:27 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764401/ [6764404] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/upmap thrashosds-health workloads/rbd_fio} time: 00:43:15 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764404/ [6764405] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_exclusive_option} time: 00:12:21 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764405/ [6764406] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_modprobe} time: 00:09:11 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764406/ [6764407] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_kernel_untar_build} time: 00:19:02 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764407/ [6764409] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_huge_osdmap} time: 00:11:46 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764409/ [6764410] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_msgr_segments} time: 00:09:47 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764410/ [6764411] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:23:52 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764411/ [6764412] krbd/ms_modeless/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/krbd_default_map_options} time: 00:10:47 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764412/ [6764414] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/backoff thrashosds-health workloads/rbd_fio} time: 00:43:01 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764414/ [6764416] krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes} time: 00:09:30 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764416/ [6764417] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_dbench} time: 00:38:15 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764417/ [6764418] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_latest_osdmap_on_map} time: 00:14:50 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764418/ [6764419] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_namespaces} time: 00:11:27 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764419/ [6764420] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_parent_overlap} time: 00:09:44 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764420/ [6764421] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_ffsb} time: 01:15:09 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764421/ [6764422] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:15:59 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764422/ [6764424] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only} time: 00:09:51 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764424/ [6764425] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_udev_netlink_enobufs} time: 00:15:36 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764425/ [6764426] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_fsstress} time: 00:13:23 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764426/ [6764428] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_whole_object_zeroout} time: 00:09:53 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764428/ [6764429] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:18:50 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764429/ [6764430] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/pggrow thrashosds-health workloads/rbd_fio} time: 00:41:00 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764430/ [6764431] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks} time: 00:12:03 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764431/ [6764432] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} time: 00:11:01 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764432/ [6764434] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_deep_flatten} time: 00:09:47 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764434/ [6764435] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} time: 00:09:23 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764435/ [6764437] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_huge_tickets} time: 00:11:15 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764437/ [6764438] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:22:25 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764438/ [6764439] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx} time: 00:21:17 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764439/ [6764440] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard} time: 00:10:10 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764440/ [6764441] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read} time: 00:11:30 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764441/ [6764442] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_kernel} time: 00:11:08 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764442/ [6764443] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_iozone} time: 00:16:47 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764443/ [6764444] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_huge_image} time: 00:09:04 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764444/ [6764446] krbd/ms_modeless/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/krbd_rxbounce} time: 00:11:46 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764446/ [6764448] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:21:34 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764448/ [6764449] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_map_snapshot_io} time: 00:10:32 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764449/ [6764450] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap} time: 00:15:32 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764450/ [6764451] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_trivial_sync} time: 00:12:40 info: http://pulpito.ceph.com/yuriw-2022-03-27_21:57:18-krbd-quincy-testing-default-smithi/6764451/