2020-10-03T20:40:41.821 INFO:root:teuthology version: 1.0.0-75888fc 2020-10-03T20:40:41.822 INFO:teuthology.results:seed: '4810' 2020-10-03T21:34:37.960 INFO:root:teuthology version: 1.0.0-75888fc 2020-10-03T21:34:38.000 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-10-04T08:27:51.863 INFO:teuthology.results:Tests finished! gathering results... 2020-10-04T08:28:02.503 INFO:scrape:Found 100 jobs 2020-10-04T08:28:07.014 INFO:scrape:Found 3 distinct failure reasons 2020-10-04T08:28:07.015 INFO:scrape:Failure: Command failed on smithi087 with status 4: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludep3dn6_qe -r -- '-g auto -g blockdev -x clone'" 2020-10-04T08:28:07.015 INFO:scrape:2 jobs: ['5474938', '5474887'] 2020-10-04T08:28:07.016 INFO:scrape:suites intersection: ['conf', 'krbd/singleton/{bluestore-bitmap', 'tasks/rbd_xfstests}'] 2020-10-04T08:28:07.016 INFO:scrape:suites union: ['conf', 'krbd/singleton/{bluestore-bitmap', 'msgr-failures/few', 'msgr-failures/many', 'tasks/rbd_xfstests}'] 2020-10-04T08:28:07.016 INFO:scrape: 2020-10-04T08:28:07.016 INFO:scrape:Failure: "2020-10-03T21:48:11.426812+0000 mon.a (mon.0) 37 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)" in cluster log 2020-10-04T08:28:07.017 INFO:scrape:7 jobs: ['5474960', '5474980', '5474906', '5474977', '5474913', '5474947', '5474959'] 2020-10-04T08:28:07.017 INFO:scrape:suites intersection: ['clusters/fixed-3', 'conf', 'msgr-failures/many'] 2020-10-04T08:28:07.017 INFO:scrape:suites union: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'krbd/rbd/{bluestore-bitmap', 'msgr-failures/many', 'tasks/krbd_latest_osdmap_on_map}', 'tasks/krbd_udev_netlink_enobufs}', 'tasks/krbd_udev_netns}', 'tasks/krbd_udev_symlinks}', 'tasks/rbd_map_snapshot_io}', 'tasks/rbd_workunit_suites_fsstress}', 'tasks/rbd_workunit_trivial_sync}'] 2020-10-04T08:28:07.018 INFO:scrape: 2020-10-04T08:28:07.018 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/concurrent.sh 2020-10-04T08:28:07.018 INFO:scrape:1 jobs: ['5474967'] 2020-10-04T08:28:07.019 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'msgr-failures/many', 'tasks/rbd_concurrent}'] 2020-10-04T08:28:07.019 INFO:scrape: 2020-10-04T08:28:07.023 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/ failed: 10 dead: 0 running: 0 waiting: 0 queued: 0 passed: 90 Fail ================================================================= [5474887] krbd/singleton/{bluestore-bitmap conf msgr-failures/few tasks/rbd_xfstests} ----------------------------------------------------------------- time: 08:24:27 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474887/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474887/ sentry: https://sentry.ceph.com/sentry/sepia/?query=531cedd6e131492fafa2a2642895d5b1 Command failed on smithi082 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludelsbyyc8f -r -- '-g auto -g blockdev -x clone'" [5474906] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_netlink_enobufs} ----------------------------------------------------------------- time: 00:22:12 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474906/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474906/ "2020-10-03T21:21:24.610470+0000 mon.a (mon.0) 31 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)" in cluster log [5474913] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_symlinks} ----------------------------------------------------------------- time: 00:17:14 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474913/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474913/ "2020-10-03T21:11:19.785959+0000 mon.a (mon.0) 37 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)" in cluster log [5474938] krbd/singleton/{bluestore-bitmap conf msgr-failures/many tasks/rbd_xfstests} ----------------------------------------------------------------- time: 10:23:44 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474938/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474938/ sentry: https://sentry.ceph.com/sentry/sepia/?query=4c3de0d09a0b468694ec519864f0a0c0 Command failed on smithi087 with status 4: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludep3dn6_qe -r -- '-g auto -g blockdev -x clone'" [5474947] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_latest_osdmap_on_map} ----------------------------------------------------------------- time: 00:18:03 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474947/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474947/ "2020-10-03T21:31:24.572042+0000 mon.a (mon.0) 32 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)" in cluster log [5474959] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsstress} ----------------------------------------------------------------- time: 00:16:26 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474959/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474959/ "2020-10-03T21:34:22.630045+0000 mon.b (mon.0) 37 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)" in cluster log [5474960] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_netns} ----------------------------------------------------------------- time: 00:16:49 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474960/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474960/ "2020-10-03T21:48:11.426812+0000 mon.a (mon.0) 37 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)" in cluster log [5474967] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_concurrent} ----------------------------------------------------------------- time: 04:51:29 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474967/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474967/ sentry: https://sentry.ceph.com/sentry/sepia/?query=0a2f6f8e3c2a4b8c9d4f1759ff43075a Command failed (workunit test rbd/concurrent.sh) on smithi191 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5e473ecc44e531dc7a08cfc1d72baf4a80f8ec71 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/concurrent.sh' [5474977] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_map_snapshot_io} ----------------------------------------------------------------- time: 00:15:42 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474977/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474977/ "2020-10-03T21:50:37.961761+0000 mon.a (mon.0) 37 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)" in cluster log [5474980] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_trivial_sync} ----------------------------------------------------------------- time: 00:15:49 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474980/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474980/ "2020-10-03T21:58:58.986175+0000 mon.a (mon.0) 39 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)" in cluster log Pass ================================================================= [5474883] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_deep_flatten} time: 00:10:30 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474883/ [5474884] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:27:40 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474884/ [5474885] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_fio} time: 00:43:02 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474885/ [5474886] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_data_pool} time: 00:22:43 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474886/ [5474888] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/backoff thrashosds-health workloads/rbd_fio} time: 01:20:37 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474888/ [5474889] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} time: 00:09:27 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474889/ [5474890] krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_pages_required} time: 00:09:33 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474890/ [5474891] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_exclusive_option} time: 00:12:57 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474891/ [5474892] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:30:24 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474892/ [5474893] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_kernel_untar_build} time: 00:18:24 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474893/ [5474894] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_fallocate} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474894/ [5474895] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:28:25 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474895/ [5474896] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_huge_osdmap} time: 00:11:58 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474896/ [5474897] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_dbench} time: 00:52:50 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474897/ [5474898] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_latest_osdmap_on_map} time: 00:15:13 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474898/ [5474899] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_discard} time: 00:11:25 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474899/ [5474900] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:25:58 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474900/ [5474901] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:17:55 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474901/ [5474902] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_namespaces} time: 00:14:18 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474902/ [5474903] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:31:47 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474903/ [5474904] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_ffsb} time: 01:25:39 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474904/ [5474905] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_enumerate} time: 00:30:58 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474905/ [5474907] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:26:23 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474907/ [5474908] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsstress} time: 00:10:57 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474908/ [5474909] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_netns} time: 00:11:53 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474909/ [5474910] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_huge_image} time: 00:09:35 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474910/ [5474911] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:26:38 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474911/ [5474912] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/pggrow thrashosds-health workloads/rbd_fio} time: 01:23:37 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474912/ [5474914] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} time: 00:11:13 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474914/ [5474915] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:29:39 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474915/ [5474916] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_concurrent} time: 00:17:37 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474916/ [5474917] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_huge_tickets} time: 00:11:21 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474917/ [5474918] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:26:44 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474918/ [5474919] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsx} time: 00:19:18 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474919/ [5474920] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} time: 00:09:40 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474920/ [5474921] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} time: 00:23:24 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474921/ [5474922] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_image_read} time: 00:11:36 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474922/ [5474923] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_modprobe} time: 00:09:07 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474923/ [5474924] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:28:36 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474924/ [5474925] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 02:00:37 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474925/ [5474926] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_kernel} time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474926/ [5474927] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_iozone} time: 00:14:00 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474927/ [5474928] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_map_snapshot_io} time: 00:10:17 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474928/ [5474929] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:26:23 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474929/ [5474930] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_map_unmap} time: 00:15:42 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474930/ [5474931] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_trivial_sync} time: 00:10:43 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474931/ [5474932] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:30:57 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474932/ [5474933] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_simple_big} time: 00:40:01 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474933/ [5474934] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_msgr_segments} time: 00:09:49 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474934/ [5474935] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:33:05 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474935/ [5474936] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_fio} time: 00:38:30 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474936/ [5474937] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_data_pool} time: 00:27:57 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474937/ [5474939] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 02:31:03 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474939/ [5474940] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_exclusive_option} time: 00:13:21 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474940/ [5474941] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:35:39 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474941/ [5474942] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_kernel_untar_build} time: 00:17:53 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474942/ [5474943] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_fallocate} time: 00:12:34 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474943/ [5474944] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:35:56 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474944/ [5474945] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_huge_osdmap} time: 00:12:20 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474945/ [5474946] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_dbench} time: 00:46:37 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474946/ [5474948] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_parent_overlap} time: 00:09:24 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474948/ [5474949] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:25:31 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474949/ [5474950] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} time: 01:29:33 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474950/ [5474951] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_namespaces} time: 00:14:09 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474951/ [5474952] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:31:22 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474952/ [5474953] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_ffsb} time: 01:18:39 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474953/ [5474954] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} time: 00:09:31 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474954/ [5474955] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} time: 00:24:15 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474955/ [5474956] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_enumerate} time: 03:08:48 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474956/ [5474957] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_netlink_enobufs} time: 00:16:59 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474957/ [5474958] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:24:31 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474958/ [5474961] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_read_only} time: 00:10:07 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474961/ [5474962] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:31:42 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474962/ [5474963] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:37:47 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474963/ [5474964] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_symlinks} time: 00:12:26 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474964/ [5474965] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} time: 00:11:16 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474965/ [5474966] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:37:28 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474966/ [5474968] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_huge_tickets} time: 00:11:01 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474968/ [5474969] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:33:49 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474969/ [5474970] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsx} time: 00:20:21 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474970/ [5474971] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_image_read} time: 00:11:06 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474971/ [5474972] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_whole_object_zeroout} time: 00:10:08 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474972/ [5474973] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:27:00 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474973/ [5474974] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/upmap thrashosds-health workloads/rbd_fio} time: 01:22:03 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474974/ [5474975] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_kernel} time: 00:11:07 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474975/ [5474976] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_iozone} time: 00:14:33 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474976/ [5474978] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:34:50 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474978/ [5474979] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_map_unmap} time: 00:15:43 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474979/ [5474981] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:25:59 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474981/ [5474982] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_simple_big} time: 00:40:17 info: http://pulpito.ceph.com/teuthology-2020-09-28_03:20:02-krbd-master-testing-basic-smithi/5474982/