2021-04-17T12:18:13.986 INFO:root:teuthology version: 1.1.0-2713a3cd 2021-04-17T12:18:13.989 INFO:teuthology.results:subset: '9922/9999' 2021-04-17T12:18:13.990 INFO:teuthology.results:seed: '7428' 2021-04-17T12:40:24.719 INFO:root:teuthology version: 1.1.0-2713a3cd 2021-04-17T12:40:24.725 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-04-17T15:14:38.270 INFO:teuthology.results:Tests finished! gathering results... 2021-04-17T15:14:39.398 INFO:scrape:Found 15 jobs 2021-04-17T15:14:39.401 INFO:scrape:Found 1 distinct failure reasons 2021-04-17T15:14:39.402 INFO:scrape:Failure: "2021-04-17T14:06:09.235482+0000 osd.2 (osd.2) 9 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running" in cluster log 2021-04-17T15:14:39.402 INFO:scrape:1 jobs: ['6053241'] 2021-04-17T15:14:39.402 INFO:scrape:suites: ['objectstore/bluestore-comp-snappy', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'tasks/radosbench', 'thrashosds-health', 'whitelist_health}'] 2021-04-17T15:14:39.403 INFO:scrape: 2021-04-17T15:14:39.404 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-04-17_12:17:03-powercycle-pacific-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2021-04-17_12:17:03-powercycle-pacific-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-04-17_12:17:03-powercycle-pacific-distro-basic-smithi/ failed: 1 dead: 0 running: 0 waiting: 0 queued: 0 passed: 14 Fail ================================================================= [6053241] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/centos_8 tasks/radosbench thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 02:23:26 info: http://pulpito.ceph.com/teuthology-2021-04-17_12:17:03-powercycle-pacific-distro-basic-smithi/6053241/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-04-17_12:17:03-powercycle-pacific-distro-basic-smithi/6053241/ "2021-04-17T14:06:09.235482+0000 osd.2 (osd.2) 9 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running" in cluster log Pass ================================================================= [6053227] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/rhel_8 tasks/radosbench thrashosds-health whitelist_health} time: 01:30:43 info: http://pulpito.ceph.com/teuthology-2021-04-17_12:17:03-powercycle-pacific-distro-basic-smithi/6053227/ [6053228] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/ubuntu_latest tasks/readwrite thrashosds-health whitelist_health} time: 00:13:51 info: http://pulpito.ceph.com/teuthology-2021-04-17_12:17:03-powercycle-pacific-distro-basic-smithi/6053228/ [6053229] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/centos_8 tasks/snaps-few-objects thrashosds-health whitelist_health} time: 00:26:08 info: http://pulpito.ceph.com/teuthology-2021-04-17_12:17:03-powercycle-pacific-distro-basic-smithi/6053229/ [6053230] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/rhel_8 tasks/snaps-many-objects thrashosds-health whitelist_health} time: 00:28:43 info: http://pulpito.ceph.com/teuthology-2021-04-17_12:17:03-powercycle-pacific-distro-basic-smithi/6053230/ [6053231] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/ubuntu_latest tasks/admin_socket_objecter_requests thrashosds-health whitelist_health} time: 00:12:13 info: http://pulpito.ceph.com/teuthology-2021-04-17_12:17:03-powercycle-pacific-distro-basic-smithi/6053231/ [6053232] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_kernel_untar_build thrashosds-health whitelist_health} time: 00:34:40 info: http://pulpito.ceph.com/teuthology-2021-04-17_12:17:03-powercycle-pacific-distro-basic-smithi/6053232/ [6053233] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_misc thrashosds-health whitelist_health} time: 00:26:24 info: http://pulpito.ceph.com/teuthology-2021-04-17_12:17:03-powercycle-pacific-distro-basic-smithi/6053233/ [6053234] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_ffsb thrashosds-health whitelist_health} time: 00:27:14 info: http://pulpito.ceph.com/teuthology-2021-04-17_12:17:03-powercycle-pacific-distro-basic-smithi/6053234/ [6053235] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsstress thrashosds-health whitelist_health} time: 00:11:50 info: http://pulpito.ceph.com/teuthology-2021-04-17_12:17:03-powercycle-pacific-distro-basic-smithi/6053235/ [6053236] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsx thrashosds-health whitelist_health} time: 00:21:46 info: http://pulpito.ceph.com/teuthology-2021-04-17_12:17:03-powercycle-pacific-distro-basic-smithi/6053236/ [6053237] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsync thrashosds-health whitelist_health} time: 00:10:39 info: http://pulpito.ceph.com/teuthology-2021-04-17_12:17:03-powercycle-pacific-distro-basic-smithi/6053237/ [6053238] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_pjd thrashosds-health whitelist_health} time: 00:13:27 info: http://pulpito.ceph.com/teuthology-2021-04-17_12:17:03-powercycle-pacific-distro-basic-smithi/6053238/ [6053239] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_truncate_delay thrashosds-health whitelist_health} time: 00:14:59 info: http://pulpito.ceph.com/teuthology-2021-04-17_12:17:03-powercycle-pacific-distro-basic-smithi/6053239/ [6053240] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/ubuntu_latest tasks/rados_api_tests thrashosds-health whitelist_health} time: 00:33:22 info: http://pulpito.ceph.com/teuthology-2021-04-17_12:17:03-powercycle-pacific-distro-basic-smithi/6053240/