2020-11-29T14:55:17.958 INFO:root:teuthology version: 1.0.0-e0aaa9bf 2020-11-29T14:55:17.959 INFO:teuthology.results:seed: '6702' 2020-11-29T17:22:11.401 INFO:root:teuthology version: 1.0.0-e0aaa9bf 2020-11-29T17:22:11.442 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-11-29T21:46:16.863 INFO:teuthology.results:Tests finished! gathering results... 2020-11-29T21:46:25.993 INFO:scrape:Found 100 jobs 2020-11-29T21:46:28.551 INFO:scrape:Found 5 distinct failure reasons 2020-11-29T21:46:28.552 INFO:scrape:Failure: "2020-11-29T17:21:44.220216+0000 osd.5 (osd.5) 3 : cluster [WRN] slow request osd_op(client.4325.0:99476 3.1d 3:bb31e103:::rbd_data.10e5d5666843.0000000000000003:head [delete] snapc 4c=[] ondisk+write+known_if_redirected e254) initiated 2020-11-29T17:21:14.051433+0000 currently waiting for sub ops" in cluster log 2020-11-29T21:46:28.553 INFO:scrape:1 jobs: ['5659831'] 2020-11-29T21:46:28.554 INFO:scrape:suites: ['clusters/3-node', 'conf', 'features/no-object-map', 'krbd/fsx/{ceph/ceph', 'objectstore/filestore-xfs', 'randomized-striping-off}', 'striping/default/{msgr-failures/many', 'tasks/fsx-1-client}'] 2020-11-29T21:46:28.554 INFO:scrape: 2020-11-29T21:46:28.555 INFO:scrape:Failure: Command failed on smithi145 with status 151: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 2 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K -U pool_client.2 image_client.2' 2020-11-29T21:46:28.556 INFO:scrape:1 jobs: ['5659809'] 2020-11-29T21:46:28.557 INFO:scrape:suites: ['clusters/3-node', 'conf', 'features/object-map', 'krbd/fsx/{ceph/ceph', 'objectstore/filestore-xfs', 'randomized-striping-off}', 'striping/default/{msgr-failures/many', 'tasks/fsx-3-client}'] 2020-11-29T21:46:28.557 INFO:scrape: 2020-11-29T21:46:28.558 INFO:scrape:Failure: Command failed on smithi159 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludeupmnkvcf -r -- '-g auto -g blockdev -x clone'" 2020-11-29T21:46:28.558 INFO:scrape:2 jobs: ['5659851', '5659769'] 2020-11-29T21:46:28.559 INFO:scrape:suites intersection: ['conf', 'krbd/singleton/{bluestore-bitmap', 'tasks/rbd_xfstests}'] 2020-11-29T21:46:28.560 INFO:scrape:suites union: ['conf', 'krbd/singleton/{bluestore-bitmap', 'msgr-failures/few', 'msgr-failures/many', 'tasks/rbd_xfstests}'] 2020-11-29T21:46:28.560 INFO:scrape: 2020-11-29T21:46:28.561 INFO:scrape:Failure: "2020-11-29T15:55:31.311178+0000 mon.b (mon.0) 182 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log 2020-11-29T21:46:28.562 INFO:scrape:2 jobs: ['5659850', '5659800'] 2020-11-29T21:46:28.562 INFO:scrape:suites intersection: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'msgr-failures/many'] 2020-11-29T21:46:28.563 INFO:scrape:suites union: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'msgr-failures/many', 'tasks/krbd_data_pool}', 'tasks/krbd_namespaces}'] 2020-11-29T21:46:28.563 INFO:scrape: 2020-11-29T21:46:28.564 INFO:scrape:Failure: Command failed (workunit test rbd/krbd_stable_pages_required.sh) on smithi039 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3b1861acb8137d863184795ccadbd5d0cb026674 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_stable_pages_required.sh' 2020-11-29T21:46:28.565 INFO:scrape:1 jobs: ['5659775'] 2020-11-29T21:46:28.565 INFO:scrape:suites: ['ceph/ceph', 'clusters/fixed-1', 'conf', 'krbd/wac/sysfs/{bluestore-bitmap', 'tasks/stable_pages_required}'] 2020-11-29T21:46:28.566 INFO:scrape: 2020-11-29T21:46:28.570 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/ failed: 7 dead: 0 running: 0 waiting: 0 queued: 0 passed: 93 Fail ================================================================= [5659769] krbd/singleton/{bluestore-bitmap conf msgr-failures/few tasks/rbd_xfstests} ----------------------------------------------------------------- time: 04:02:13 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659769/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659769/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bce4e73a33ab46408f754d1cec1d3367 Command failed on smithi173 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/exclude6j9jg8si -r -- '-g auto -g blockdev -x clone'" [5659775] krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_pages_required} ----------------------------------------------------------------- time: 00:10:59 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659775/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659775/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4ccbd44418ef4889aeb8acf4a8e685c6 Command failed (workunit test rbd/krbd_stable_pages_required.sh) on smithi039 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3b1861acb8137d863184795ccadbd5d0cb026674 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rbd/krbd_stable_pages_required.sh' [5659800] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_namespaces} ----------------------------------------------------------------- time: 00:16:33 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659800/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659800/ "2020-11-29T15:37:45.736195+0000 mon.a (mon.0) 14 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log [5659809] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} ----------------------------------------------------------------- time: 00:16:12 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659809/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659809/ sentry: https://sentry.ceph.com/organizations/ceph/?query=04066fc29da941e98e519e64d962f35f Command failed on smithi145 with status 151: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 2 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K -U pool_client.2 image_client.2' [5659831] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} ----------------------------------------------------------------- time: 00:28:48 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659831/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659831/ "2020-11-29T17:21:44.220216+0000 osd.5 (osd.5) 3 : cluster [WRN] slow request osd_op(client.4325.0:99476 3.1d 3:bb31e103:::rbd_data.10e5d5666843.0000000000000003:head [delete] snapc 4c=[] ondisk+write+known_if_redirected e254) initiated 2020-11-29T17:21:14.051433+0000 currently waiting for sub ops" in cluster log [5659850] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_data_pool} ----------------------------------------------------------------- time: 00:30:43 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659850/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659850/ "2020-11-29T15:55:31.311178+0000 mon.b (mon.0) 182 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log [5659851] krbd/singleton/{bluestore-bitmap conf msgr-failures/many tasks/rbd_xfstests} ----------------------------------------------------------------- time: 04:43:07 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659851/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659851/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1e42e20d33f44263a5dd200cb69436cf Command failed on smithi159 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludeupmnkvcf -r -- '-g auto -g blockdev -x clone'" Pass ================================================================= [5659761] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_deep_flatten} time: 00:12:39 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659761/ [5659763] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:26:41 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659763/ [5659765] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_fio} time: 00:29:53 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659765/ [5659767] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_data_pool} time: 00:26:08 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659767/ [5659771] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/backoff thrashosds-health workloads/rbd_fio} time: 00:46:09 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659771/ [5659773] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} time: 00:10:56 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659773/ [5659777] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_exclusive_option} time: 00:14:45 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659777/ [5659779] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:26:49 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659779/ [5659781] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_kernel_untar_build} time: 00:23:57 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659781/ [5659783] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_fallocate} time: 00:13:44 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659783/ [5659786] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:30:49 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659786/ [5659787] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_huge_osdmap} time: 00:13:56 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659787/ [5659790] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_dbench} time: 00:44:06 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659790/ [5659792] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_latest_osdmap_on_map} time: 00:17:08 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659792/ [5659794] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_discard} time: 00:13:15 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659794/ [5659796] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:25:32 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659796/ [5659798] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:11:18 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659798/ [5659802] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:36:23 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659802/ [5659803] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_ffsb} time: 01:19:48 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659803/ [5659805] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_enumerate} time: 00:32:33 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659805/ [5659807] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_netlink_enobufs} time: 00:18:59 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659807/ [5659811] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsstress} time: 00:13:02 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659811/ [5659813] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_netns} time: 00:12:59 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659813/ [5659815] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_huge_image} time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659815/ [5659817] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:23:22 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659817/ [5659819] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/pggrow thrashosds-health workloads/rbd_fio} time: 00:53:12 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659819/ [5659821] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_symlinks} time: 00:15:32 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659821/ [5659823] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} time: 00:13:12 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659823/ [5659825] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:30:57 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659825/ [5659827] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_concurrent} time: 00:18:55 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659827/ [5659829] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_huge_tickets} time: 00:13:02 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659829/ [5659832] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsx} time: 00:20:10 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659832/ [5659833] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} time: 00:11:26 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659833/ [5659834] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} time: 00:24:34 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659834/ [5659835] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_image_read} time: 00:12:50 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659835/ [5659836] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_modprobe} time: 00:11:01 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659836/ [5659837] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:26:25 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659837/ [5659838] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:07:11 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659838/ [5659839] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_kernel} time: 00:12:36 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659839/ [5659840] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_iozone} time: 00:16:31 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659840/ [5659841] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_map_snapshot_io} time: 00:12:23 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659841/ [5659842] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:29:33 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659842/ [5659843] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_map_unmap} time: 00:22:43 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659843/ [5659844] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_trivial_sync} time: 00:13:08 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659844/ [5659845] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:28:22 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659845/ [5659846] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_simple_big} time: 00:38:16 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659846/ [5659847] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_msgr_segments} time: 00:11:11 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659847/ [5659848] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:31:39 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659848/ [5659849] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_fio} time: 00:30:49 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659849/ [5659852] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:08:56 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659852/ [5659853] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_exclusive_option} time: 00:14:43 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659853/ [5659854] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:34:18 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659854/ [5659855] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_kernel_untar_build} time: 00:18:54 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659855/ [5659856] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_fallocate} time: 00:19:06 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659856/ [5659857] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:35:46 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659857/ [5659858] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_huge_osdmap} time: 00:13:27 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659858/ [5659859] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_dbench} time: 00:43:20 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659859/ [5659860] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_latest_osdmap_on_map} time: 00:17:12 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659860/ [5659861] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_parent_overlap} time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659861/ [5659862] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:24:52 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659862/ [5659863] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} time: 00:48:24 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659863/ [5659864] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_namespaces} time: 00:15:42 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659864/ [5659865] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:31:24 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659865/ [5659866] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_ffsb} time: 01:10:17 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659866/ [5659867] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} time: 00:11:37 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659867/ [5659868] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} time: 00:24:38 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659868/ [5659869] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_enumerate} time: 03:22:24 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659869/ [5659870] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_netlink_enobufs} time: 00:19:16 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659870/ [5659871] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:27:27 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659871/ [5659872] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsstress} time: 00:13:03 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659872/ [5659873] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_netns} time: 00:13:19 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659873/ [5659874] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_read_only} time: 00:11:54 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659874/ [5659875] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:29:41 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659875/ [5659876] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:05:39 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659876/ [5659877] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_symlinks} time: 00:14:02 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659877/ [5659878] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} time: 00:12:49 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659878/ [5659879] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:34:47 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659879/ [5659880] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_concurrent} time: 04:17:23 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659880/ [5659881] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_huge_tickets} time: 00:13:06 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659881/ [5659882] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:36:15 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659882/ [5659883] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsx} time: 00:22:26 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659883/ [5659884] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_image_read} time: 00:12:56 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659884/ [5659885] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_whole_object_zeroout} time: 00:11:57 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659885/ [5659886] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:22:34 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659886/ [5659887] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/upmap thrashosds-health workloads/rbd_fio} time: 00:49:27 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659887/ [5659888] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_kernel} time: 00:12:36 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659888/ [5659889] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_iozone} time: 00:15:31 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659889/ [5659890] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_map_snapshot_io} time: 00:12:31 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659890/ [5659891] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:33:59 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659891/ [5659892] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_map_unmap} time: 00:18:07 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659892/ [5659893] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_trivial_sync} time: 00:13:18 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659893/ [5659894] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:24:52 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659894/ [5659895] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_simple_big} time: 00:39:08 info: http://pulpito.ceph.com/teuthology-2020-11-27_05:15:03-krbd-octopus-testing-basic-smithi/5659895/