2020-11-06T12:54:22.236 INFO:root:teuthology version: 1.0.0-41b569f 2020-11-06T12:54:22.238 INFO:teuthology.results:seed: '152' 2020-11-06T13:57:45.187 INFO:root:teuthology version: 1.0.0-41b569f 2020-11-06T13:57:45.266 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-11-07T00:25:59.084 INFO:teuthology.results:Tests finished! gathering results... 2020-11-07T00:27:07.531 INFO:scrape:Found 100 jobs 2020-11-07T00:27:35.979 INFO:scrape:Found 4 distinct failure reasons 2020-11-07T00:27:35.980 INFO:scrape:Failure: Command failed on smithi141 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludefdftfmmc -r -- '-g auto -g blockdev -x clone'" 2020-11-07T00:27:35.981 INFO:scrape:2 jobs: ['5581346', '5581295'] 2020-11-07T00:27:35.981 INFO:scrape:suites intersection: ['conf', 'krbd/singleton/{bluestore-bitmap', 'tasks/rbd_xfstests}'] 2020-11-07T00:27:35.981 INFO:scrape:suites union: ['conf', 'krbd/singleton/{bluestore-bitmap', 'msgr-failures/few', 'msgr-failures/many', 'tasks/rbd_xfstests}'] 2020-11-07T00:27:35.982 INFO:scrape: 2020-11-07T00:27:35.982 INFO:scrape:Failure: reached maximum tries (60) after waiting for 900 seconds 2020-11-07T00:27:35.982 INFO:scrape:1 jobs: ['5581387'] 2020-11-07T00:27:35.983 INFO:scrape: 2020-11-07T00:27:35.983 INFO:scrape:Failure: "2020-11-06T13:36:30.378554+0000 mon.a (mon.0) 70 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)" in cluster log 2020-11-07T00:27:35.983 INFO:scrape:1 jobs: ['5581335'] 2020-11-07T00:27:35.984 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'krbd/rbd/{bluestore-bitmap', 'msgr-failures/many', 'tasks/rbd_workunit_suites_iozone}'] 2020-11-07T00:27:35.984 INFO:scrape: 2020-11-07T00:27:35.984 INFO:scrape:Failure: "2020-11-06T15:06:27.594154+0000 osd.5 (osd.5) 3 : cluster [WRN] slow request osd_op(client.10635.0:3031596 2.3 2:c50de57f:::rbd_header.29adf422a6e0:head [watch reconnect cookie 18446462598732841026 gen 30144] snapc 0=[] ondisk+write+known_if_redirected e22) initiated 2020-11-06T15:05:57.525263+0000 currently started" in cluster log 2020-11-07T00:27:35.984 INFO:scrape:1 jobs: ['5581375'] 2020-11-07T00:27:35.985 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'msgr-failures/many', 'tasks/rbd_concurrent}'] 2020-11-07T00:27:35.985 INFO:scrape: 2020-11-07T00:27:35.989 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/ failed: 4 dead: 1 running: 0 waiting: 0 queued: 0 passed: 95 Fail ================================================================= [5581295] krbd/singleton/{bluestore-bitmap conf msgr-failures/few tasks/rbd_xfstests} ----------------------------------------------------------------- time: 10:11:18 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581295/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581295/ sentry: https://sentry.ceph.com/ceph/sepia/?query=631008852b554216a212ba7228520008 Command failed on smithi144 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excluder6m0gagk -r -- '-g auto -g blockdev -x clone'" [5581335] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_iozone} ----------------------------------------------------------------- time: 00:19:31 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581335/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581335/ "2020-11-06T13:36:30.378554+0000 mon.a (mon.0) 70 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)" in cluster log [5581346] krbd/singleton/{bluestore-bitmap conf msgr-failures/many tasks/rbd_xfstests} ----------------------------------------------------------------- time: 09:18:03 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581346/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581346/ sentry: https://sentry.ceph.com/ceph/sepia/?query=a7f24088d0004f25847adf16ac51ad64 Command failed on smithi141 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludefdftfmmc -r -- '-g auto -g blockdev -x clone'" [5581375] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_concurrent} ----------------------------------------------------------------- time: 00:57:17 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581375/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581375/ "2020-11-06T15:06:27.594154+0000 osd.5 (osd.5) 3 : cluster [WRN] slow request osd_op(client.10635.0:3031596 2.3 2:c50de57f:::rbd_header.29adf422a6e0:head [watch reconnect cookie 18446462598732841026 gen 30144] snapc 0=[] ondisk+write+known_if_redirected e22) initiated 2020-11-06T15:05:57.525263+0000 currently started" in cluster log Dead ================================================================= [5581387] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_map_unmap} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581387/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581387/ sentry: https://sentry.ceph.com/ceph/sepia/?query=e5e9b9ad8831410991ce02a9c29c7e34 reached maximum tries (60) after waiting for 900 seconds Pass ================================================================= [5581291] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_deep_flatten} time: 00:12:24 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581291/ [5581292] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:27:14 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581292/ [5581293] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_fio} time: 00:44:41 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581293/ [5581294] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_data_pool} time: 00:25:20 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581294/ [5581296] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/backoff thrashosds-health workloads/rbd_fio} time: 01:20:56 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581296/ [5581297] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} time: 00:11:05 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581297/ [5581298] krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_pages_required} time: 00:10:49 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581298/ [5581299] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_exclusive_option} time: 00:14:55 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581299/ [5581300] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:27:58 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581300/ [5581301] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_kernel_untar_build} time: 00:20:46 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581301/ [5581302] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_fallocate} time: 00:13:35 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581302/ [5581303] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:31:28 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581303/ [5581304] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_huge_osdmap} time: 00:14:11 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581304/ [5581305] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_dbench} time: 00:50:53 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581305/ [5581306] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_latest_osdmap_on_map} time: 00:16:41 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581306/ [5581307] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_discard} time: 00:12:41 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581307/ [5581308] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:25:34 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581308/ [5581309] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:21:22 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581309/ [5581310] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_namespaces} time: 00:23:03 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581310/ [5581311] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:33:11 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581311/ [5581312] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_ffsb} time: 01:35:12 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581312/ [5581313] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_enumerate} time: 00:33:49 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581313/ [5581314] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_netlink_enobufs} time: 00:22:06 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581314/ [5581315] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:28:27 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581315/ [5581316] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsstress} time: 00:12:47 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581316/ [5581317] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_netns} time: 00:15:14 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581317/ [5581318] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_huge_image} time: 00:11:46 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581318/ [5581319] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:26:04 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581319/ [5581320] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/pggrow thrashosds-health workloads/rbd_fio} time: 01:27:21 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581320/ [5581321] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_symlinks} time: 00:15:14 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581321/ [5581322] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581322/ [5581323] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:33:21 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581323/ [5581324] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_concurrent} time: 00:18:45 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581324/ [5581325] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_huge_tickets} time: 00:13:01 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581325/ [5581326] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:25:56 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581326/ [5581327] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsx} time: 00:21:18 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581327/ [5581328] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} time: 00:12:13 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581328/ [5581329] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} time: 00:26:09 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581329/ [5581330] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_image_read} time: 00:12:52 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581330/ [5581331] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_modprobe} time: 00:12:05 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581331/ [5581332] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:27:02 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581332/ [5581333] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 02:09:50 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581333/ [5581334] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_kernel} time: 00:12:48 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581334/ [5581336] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_map_snapshot_io} time: 00:12:14 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581336/ [5581337] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:29:48 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581337/ [5581338] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_map_unmap} time: 00:17:24 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581338/ [5581339] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_trivial_sync} time: 00:12:34 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581339/ [5581340] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:30:32 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581340/ [5581341] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_simple_big} time: 00:41:54 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581341/ [5581342] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_msgr_segments} time: 00:11:10 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581342/ [5581343] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:30:18 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581343/ [5581344] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_fio} time: 00:40:43 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581344/ [5581345] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_data_pool} time: 00:30:54 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581345/ [5581347] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:45:39 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581347/ [5581348] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_exclusive_option} time: 00:14:46 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581348/ [5581349] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:31:52 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581349/ [5581350] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_kernel_untar_build} time: 00:19:23 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581350/ [5581351] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_fallocate} time: 00:19:23 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581351/ [5581352] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:35:47 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581352/ [5581353] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_huge_osdmap} time: 00:13:48 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581353/ [5581354] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_dbench} time: 00:53:03 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581354/ [5581355] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_latest_osdmap_on_map} time: 00:17:04 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581355/ [5581356] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_parent_overlap} time: 00:10:57 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581356/ [5581357] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:26:18 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581357/ [5581358] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} time: 01:32:30 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581358/ [5581359] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_namespaces} time: 00:15:59 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581359/ [5581360] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:34:13 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581360/ [5581361] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_ffsb} time: 01:15:23 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581361/ [5581362] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} time: 00:11:40 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581362/ [5581363] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} time: 00:25:18 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581363/ [5581364] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_enumerate} time: 02:32:16 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581364/ [5581365] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_netlink_enobufs} time: 00:18:53 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581365/ [5581366] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:25:47 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581366/ [5581367] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsstress} time: 00:13:14 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581367/ [5581368] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_netns} time: 00:13:31 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581368/ [5581369] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_read_only} time: 00:12:34 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581369/ [5581370] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:27:59 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581370/ [5581371] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:42:04 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581371/ [5581372] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_symlinks} time: 00:13:34 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581372/ [5581373] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} time: 00:13:00 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581373/ [5581374] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:34:54 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581374/ [5581376] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_huge_tickets} time: 00:12:52 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581376/ [5581377] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:32:48 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581377/ [5581378] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsx} time: 00:24:26 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581378/ [5581379] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_image_read} time: 00:16:37 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581379/ [5581380] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_whole_object_zeroout} time: 00:11:48 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581380/ [5581381] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:26:18 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581381/ [5581382] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/upmap thrashosds-health workloads/rbd_fio} time: 01:21:49 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581382/ [5581383] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_kernel} time: 00:12:27 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581383/ [5581384] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_iozone} time: 00:15:19 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581384/ [5581385] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_map_snapshot_io} time: 00:12:50 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581385/ [5581386] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:30:33 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581386/ [5581388] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_trivial_sync} time: 00:12:45 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581388/ [5581389] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:29:18 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581389/ [5581390] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_simple_big} time: 00:49:53 info: http://pulpito.ceph.com/teuthology-2020-11-02_03:20:02-krbd-master-testing-basic-smithi/5581390/