2020-11-26T01:18:50.852 INFO:root:teuthology version: 1.0.0-e0aaa9bf 2020-11-26T01:18:50.853 INFO:teuthology.results:seed: '1384' 2020-11-26T02:33:00.212 INFO:root:teuthology version: 1.0.0-e0aaa9bf 2020-11-26T02:33:00.298 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-11-26T13:34:17.505 INFO:teuthology.results:Tests finished! gathering results... 2020-11-26T13:34:32.432 INFO:scrape:Found 97 jobs 2020-11-26T13:34:34.451 INFO:scrape:Found 3 distinct failure reasons 2020-11-26T13:34:34.453 INFO:scrape:Failure: Command failed on smithi073 with status 166: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 2 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K -U pool_client.2 image_client.2' 2020-11-26T13:34:34.454 INFO:scrape:2 jobs: ['5657482', '5657457'] 2020-11-26T13:34:34.454 INFO:scrape:suites intersection: ['clusters/3-node', 'conf', 'krbd/fsx/{ceph/ceph', 'randomized-striping-off}', 'striping/default/{msgr-failures/many', 'tasks/fsx-3-client}'] 2020-11-26T13:34:34.455 INFO:scrape:suites union: ['clusters/3-node', 'conf', 'features/no-object-map', 'features/object-map', 'krbd/fsx/{ceph/ceph', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'randomized-striping-off}', 'striping/default/{msgr-failures/many', 'tasks/fsx-3-client}'] 2020-11-26T13:34:34.457 INFO:scrape: 2020-11-26T13:34:34.459 INFO:scrape:Failure: "2020-11-26T02:25:07.021797+0000 mon.b (mon.0) 48 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log 2020-11-26T13:34:34.461 INFO:scrape:1 jobs: ['5657479'] 2020-11-26T13:34:34.462 INFO:scrape:suites: ['ceph/ceph', 'clusters/fixed-3', 'conf', 'krbd/wac/wac/{bluestore-bitmap', 'tasks/wac', 'verify/no-resets}'] 2020-11-26T13:34:34.462 INFO:scrape: 2020-11-26T13:34:34.463 INFO:scrape:Failure: Command failed on smithi025 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludesmdy5txk -r -- '-g auto -g blockdev -x clone'" 2020-11-26T13:34:34.464 INFO:scrape:2 jobs: ['5657414', '5657463'] 2020-11-26T13:34:34.465 INFO:scrape:suites intersection: ['conf', 'krbd/singleton/{bluestore-bitmap', 'tasks/rbd_xfstests}'] 2020-11-26T13:34:34.466 INFO:scrape:suites union: ['conf', 'krbd/singleton/{bluestore-bitmap', 'msgr-failures/few', 'msgr-failures/many', 'tasks/rbd_xfstests}'] 2020-11-26T13:34:34.467 INFO:scrape: 2020-11-26T13:34:34.473 INFO:teuthology.results:Sending results to idryomov@gmail.com: Test Run: dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/ failed: 5 dead: 0 running: 0 waiting: 0 queued: 0 passed: 92 Fail ================================================================= [5657414] krbd/singleton/{bluestore-bitmap conf msgr-failures/few tasks/rbd_xfstests} ----------------------------------------------------------------- time: 09:54:25 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657414/ log: http://qa-proxy.ceph.com/teuthology/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657414/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c78ec50e21454509928ee6a4e8e0bbfe Command failed on smithi025 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludesmdy5txk -r -- '-g auto -g blockdev -x clone'" [5657457] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} ----------------------------------------------------------------- time: 00:12:50 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657457/ log: http://qa-proxy.ceph.com/teuthology/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657457/ sentry: https://sentry.ceph.com/organizations/ceph/?query=930878d38a5e4433872bfa34cf6914bf Command failed on smithi029 with status 166: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 2 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K -U pool_client.2 image_client.2' [5657463] krbd/singleton/{bluestore-bitmap conf msgr-failures/many tasks/rbd_xfstests} ----------------------------------------------------------------- time: 11:19:00 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657463/ log: http://qa-proxy.ceph.com/teuthology/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657463/ sentry: https://sentry.ceph.com/organizations/ceph/?query=09b9c8476a644bae8ac3775a4021047e Command failed on smithi075 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excluden2s6dwik -r -- '-g auto -g blockdev -x clone'" [5657479] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} ----------------------------------------------------------------- time: 00:21:34 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657479/ log: http://qa-proxy.ceph.com/teuthology/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657479/ "2020-11-26T02:25:07.021797+0000 mon.b (mon.0) 48 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log [5657482] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} ----------------------------------------------------------------- time: 00:12:02 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657482/ log: http://qa-proxy.ceph.com/teuthology/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657482/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cc66ef7ba8724135a4db8fc1b6e30730 Command failed on smithi073 with status 166: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 2 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K -U pool_client.2 image_client.2' Pass ================================================================= [5657410] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_deep_flatten} time: 00:08:44 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657410/ [5657411] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:26:28 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657411/ [5657412] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_fio} time: 00:41:58 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657412/ [5657413] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_data_pool} time: 00:22:03 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657413/ [5657415] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/backoff thrashosds-health workloads/rbd_fio} time: 01:21:24 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657415/ [5657416] krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_pages_required} time: 00:07:14 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657416/ [5657417] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_exclusive_option} time: 00:11:02 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657417/ [5657418] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:26:27 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657418/ [5657419] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_kernel_untar_build} time: 00:16:17 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657419/ [5657420] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_fallocate} time: 00:10:14 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657420/ [5657421] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:30:37 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657421/ [5657422] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_huge_osdmap} time: 00:10:08 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657422/ [5657423] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_dbench} time: 00:47:38 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657423/ [5657424] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_latest_osdmap_on_map} time: 00:13:15 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657424/ [5657425] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_discard} time: 00:08:56 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657425/ [5657426] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:24:27 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657426/ [5657427] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:15:17 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657427/ [5657428] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_namespaces} time: 00:12:48 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657428/ [5657429] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:36:14 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657429/ [5657430] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_ffsb} time: 01:26:23 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657430/ [5657431] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_enumerate} time: 00:28:43 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657431/ [5657432] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_netlink_enobufs} time: 00:14:54 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657432/ [5657433] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:27:32 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657433/ [5657434] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsstress} time: 00:09:10 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657434/ [5657435] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_netns} time: 00:09:03 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657435/ [5657436] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_huge_image} time: 00:07:10 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657436/ [5657437] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:23:55 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657437/ [5657438] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/pggrow thrashosds-health workloads/rbd_fio} time: 01:09:48 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657438/ [5657439] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_symlinks} time: 00:10:33 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657439/ [5657440] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} time: 00:11:42 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657440/ [5657441] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:32:19 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657441/ [5657442] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_concurrent} time: 00:15:07 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657442/ [5657443] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_huge_tickets} time: 00:13:56 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657443/ [5657444] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:26:31 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657444/ [5657445] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsx} time: 00:17:05 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657445/ [5657446] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} time: 00:20:24 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657446/ [5657447] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_image_read} time: 00:08:57 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657447/ [5657448] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_modprobe} time: 00:07:07 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657448/ [5657449] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:24:06 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657449/ [5657450] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 02:13:44 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657450/ [5657451] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_kernel} time: 00:09:12 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657451/ [5657452] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_iozone} time: 00:12:05 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657452/ [5657453] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_map_snapshot_io} time: 00:08:08 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657453/ [5657454] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:28:57 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657454/ [5657455] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_map_unmap} time: 00:13:40 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657455/ [5657456] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_trivial_sync} time: 00:08:19 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657456/ [5657458] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_simple_big} time: 00:35:35 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657458/ [5657459] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_msgr_segments} time: 00:07:10 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657459/ [5657460] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:32:19 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657460/ [5657461] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_fio} time: 00:39:15 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657461/ [5657462] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_data_pool} time: 00:27:31 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657462/ [5657464] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 02:07:59 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657464/ [5657465] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_exclusive_option} time: 00:10:52 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657465/ [5657466] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:31:11 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657466/ [5657467] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_kernel_untar_build} time: 00:15:26 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657467/ [5657468] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_fallocate} time: 00:15:24 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657468/ [5657469] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:35:56 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657469/ [5657470] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_huge_osdmap} time: 00:11:22 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657470/ [5657471] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_dbench} time: 00:43:42 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657471/ [5657472] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_latest_osdmap_on_map} time: 00:13:02 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657472/ [5657473] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_parent_overlap} time: 00:06:56 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657473/ [5657474] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:23:19 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657474/ [5657475] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} time: 01:28:58 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657475/ [5657476] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_namespaces} time: 00:11:25 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657476/ [5657477] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:35:36 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657477/ [5657478] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_ffsb} time: 01:13:56 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657478/ [5657480] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_enumerate} time: 00:52:57 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657480/ [5657481] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_netlink_enobufs} time: 00:14:54 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657481/ [5657483] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsstress} time: 00:09:19 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657483/ [5657484] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_netns} time: 00:09:36 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657484/ [5657485] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_read_only} time: 00:07:52 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657485/ [5657486] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:27:11 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657486/ [5657487] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:46:22 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657487/ [5657488] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_symlinks} time: 00:09:46 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657488/ [5657489] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} time: 00:08:49 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657489/ [5657490] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:35:29 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657490/ [5657491] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_concurrent} time: 00:15:34 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657491/ [5657492] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_huge_tickets} time: 00:08:32 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657492/ [5657493] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:31:32 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657493/ [5657494] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsx} time: 00:18:15 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657494/ [5657495] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_image_read} time: 00:09:06 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657495/ [5657496] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_whole_object_zeroout} time: 00:07:36 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657496/ [5657497] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:26:10 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657497/ [5657498] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/upmap thrashosds-health workloads/rbd_fio} time: 01:22:38 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657498/ [5657499] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_kernel} time: 00:08:04 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657499/ [5657500] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_iozone} time: 00:11:58 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657500/ [5657501] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_map_snapshot_io} time: 00:08:20 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657501/ [5657502] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:30:36 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657502/ [5657503] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_map_unmap} time: 00:13:04 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657503/ [5657504] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_trivial_sync} time: 00:08:46 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657504/ [5657505] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:31:18 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657505/ [5657506] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_simple_big} time: 00:54:21 info: http://pulpito.ceph.com/dis-2020-11-26_01:13:19-krbd-master-distro-basic-smithi/5657506/