2021-04-07T17:05:33.784 INFO:root:teuthology version: 1.1.0-85d61eae 2021-04-07T17:05:33.786 INFO:teuthology.results:subset: '3/4' 2021-04-07T17:05:33.786 INFO:teuthology.results:seed: '4744' 2021-04-07T17:06:20.563 INFO:root:teuthology version: 1.1.0-85d61eae 2021-04-07T17:06:20.566 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-04-07T18:00:47.038 INFO:teuthology.results:Tests finished! gathering results... 2021-04-07T18:00:47.368 INFO:scrape:Found 3 jobs 2021-04-07T18:00:47.384 INFO:scrape:Found 1 distinct failure reasons 2021-04-07T18:00:47.385 INFO:scrape:Failure: "2021-04-07T17:19:48.016122+0000 mon.a (mon.0) 66 : cluster [WRN] Health check failed: Degraded data redundancy: 21/42 objects degraded (50.000%), 6 pgs degraded (PG_DEGRADED)" in cluster log 2021-04-07T18:00:47.386 INFO:scrape:3 jobs: ['6027284', '6027283', '6027282'] 2021-04-07T18:00:47.387 INFO:scrape:suites intersection: ['clusters/1-node-1-mds-1-osd', 'conf/{client', 'distro/{centos_8}', 'fs/one-role/{begin', 'mds', 'mon', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/mgr-osd-full}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-04-07T18:00:47.387 INFO:scrape:suites union: ['clusters/1-node-1-mds-1-osd', 'conf/{client', 'distro/{centos_8}', 'fs/one-role/{begin', 'mds', 'mon', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/mgr-osd-full}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-04-07T18:00:47.388 INFO:scrape: 2021-04-07T18:00:47.389 INFO:teuthology.results:Sending results to khiremat@redhat.com: Test Run: khiremat-2021-04-07_17:05:17-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-5-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/khiremat-2021-04-07_17:05:17-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-5-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/khiremat-2021-04-07_17:05:17-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-5-distro-basic-smithi/ failed: 3 dead: 0 running: 0 waiting: 0 queued: 0 passed: 0 Fail ================================================================= [6027282] fs/one-role/{begin clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mgr-osd-full} ----------------------------------------------------------------- time: 00:46:16 info: http://pulpito.ceph.com/khiremat-2021-04-07_17:05:17-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-5-distro-basic-smithi/6027282/ log: http://qa-proxy.ceph.com/teuthology/khiremat-2021-04-07_17:05:17-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-5-distro-basic-smithi/6027282/ sentry: https://sentry.ceph.com/organizations/ceph/?query=30557d2f76644baa96a3e8b9123ed6b2 "2021-04-07T17:19:48.001874+0000 mon.a (mon.0) 84 : cluster [WRN] Health check failed: Degraded data redundancy: 21/42 objects degraded (50.000%), 6 pgs degraded (PG_DEGRADED)" in cluster log [6027283] fs/one-role/{begin clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mgr-osd-full} ----------------------------------------------------------------- time: 00:46:39 info: http://pulpito.ceph.com/khiremat-2021-04-07_17:05:17-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-5-distro-basic-smithi/6027283/ log: http://qa-proxy.ceph.com/teuthology/khiremat-2021-04-07_17:05:17-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-5-distro-basic-smithi/6027283/ sentry: https://sentry.ceph.com/organizations/ceph/?query=199da2f3620a4be59dd832abb658c951 "2021-04-07T17:19:53.094803+0000 mon.a (mon.0) 75 : cluster [WRN] Health check failed: Degraded data redundancy: 21/42 objects degraded (50.000%), 6 pgs degraded (PG_DEGRADED)" in cluster log [6027284] fs/one-role/{begin clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mgr-osd-full} ----------------------------------------------------------------- time: 00:46:32 info: http://pulpito.ceph.com/khiremat-2021-04-07_17:05:17-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-5-distro-basic-smithi/6027284/ log: http://qa-proxy.ceph.com/teuthology/khiremat-2021-04-07_17:05:17-fs-wip-khiremat-39910-mgr-hang-osd-full-testing-5-distro-basic-smithi/6027284/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9330aed7df6d4115a6155ffd5458016c "2021-04-07T17:19:48.016122+0000 mon.a (mon.0) 66 : cluster [WRN] Health check failed: Degraded data redundancy: 21/42 objects degraded (50.000%), 6 pgs degraded (PG_DEGRADED)" in cluster log