2020-03-05T09:37:53.069 INFO:root:teuthology version: 1.0.0-1def34b 2020-03-05T09:37:53.070 INFO:teuthology.results:subset: '259/9999' 2020-03-05T09:37:53.070 INFO:teuthology.results:seed: '5980' 2020-03-05T09:54:43.562 INFO:root:teuthology version: 1.0.0-1def34b 2020-03-05T09:54:43.582 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-03-05T11:11:45.831 INFO:teuthology.results:Tests finished! gathering results... 2020-03-05T11:11:45.907 INFO:teuthology.results:Sending results to dupadhya@redhat.com: Test Run: ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/ failed: 1 dead: 0 running: 0 waiting: 0 queued: 0 passed: 35 Fail ================================================================= [4824715] rados:singleton/{all/osd-backfill.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} ----------------------------------------------------------------- time: 00:14:59 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824715/ log: http://qa-proxy.ceph.com/teuthology/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824715/ "2020-03-05T09:57:51.491953+0000 mon.a (mon.0) 30 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log Pass ================================================================= [4824707] rados:singleton/{all/lost-unfound.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:31:55 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824707/ [4824708] rados:singleton/{all/max-pg-per-osd.from-mon.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:10:10 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824708/ [4824709] rados:singleton/{all/max-pg-per-osd.from-primary.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:11:52 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824709/ [4824728] rados:singleton/{all/thrash-backfill-full.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 01:10:41 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824728/ [4824729] rados:singleton/{all/thrash-eio.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:33:05 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824729/ [4824720] rados:singleton/{all/pg-removal-interruption.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:08:25 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824720/ [4824721] rados:singleton/{all/radostool.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:13:10 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824721/ [4824722] rados:singleton/{all/random-eio.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:21:54 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824722/ [4824723] rados:singleton/{all/rebuild-mondb.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:13:09 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824723/ [4824724] rados:singleton/{all/recovery-preemption.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:16:39 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824724/ [4824725] rados:singleton/{all/resolve_stuck_peering.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:12:20 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824725/ [4824726] rados:singleton/{all/test-crash.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:09:22 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824726/ [4824727] rados:singleton/{all/test_envlibrados_for_rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:21:29 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824727/ [4824741] rados:singleton/{all/lost-unfound.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:28:58 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824741/ [4824714] rados:singleton/{all/mon-config.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:08:52 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824714/ [4824717] rados:singleton/{all/osd-recovery.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:18:31 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824717/ [4824716] rados:singleton/{all/osd-recovery-incomplete.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:21:46 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824716/ [4824711] rados:singleton/{all/mon-auth-caps.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:14:07 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824711/ [4824710] rados:singleton/{all/max-pg-per-osd.from-replica.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:12:21 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824710/ [4824713] rados:singleton/{all/mon-config-keys.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:19:25 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824713/ [4824712] rados:singleton/{all/mon-config-key-caps.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:09:38 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824712/ [4824742] rados:singleton/{all/max-pg-per-osd.from-mon.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:13:26 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824742/ [4824719] rados:singleton/{all/pg-autoscaler.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:09:47 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824719/ [4824718] rados:singleton/{all/peer.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:08:08 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824718/ [4824739] rados:singleton/{all/erasure-code-nonregression.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:07:08 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824739/ [4824738] rados:singleton/{all/ec-lost-unfound.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:36:40 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824738/ [4824740] rados:singleton/{all/lost-unfound-delete.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:25:35 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824740/ [4824733] rados:singleton/{all/admin-socket.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:13:25 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824733/ [4824732] rados:singleton/{all/watch-notify-same-primary.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:08:07 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824732/ [4824731] rados:singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:26:15 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824731/ [4824730] rados:singleton/{all/thrash-rados/{thrash-rados.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:24:40 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824730/ [4824737] rados:singleton/{all/dump-stuck.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:10:17 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824737/ [4824736] rados:singleton/{all/divergent_priors2.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:09:12 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824736/ [4824735] rados:singleton/{all/divergent_priors.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:14:37 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824735/ [4824734] rados:singleton/{all/deduptool.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:08:15 info: http://pulpito.ceph.com/ideepika-2020-03-04_11:04:46-rados:singleton-wip-deepika-feature-testing-02-03-2020-distro-basic-smithi/4824734/ 2020-03-05T11:11:46.094 INFO:teuthology.results:starting coverage generation