2022-05-04T09:22:45.088 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166 2022-05-04T09:22:45.089 INFO:teuthology.results:seed: '609' 2022-05-04T09:25:37.619 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166 2022-05-04T09:25:37.624 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-05-04T10:27:42.173 INFO:teuthology.results:Tests finished! gathering results... 2022-05-04T10:27:42.487 INFO:scrape:Found 6 jobs 2022-05-04T10:27:43.405 INFO:scrape:Found 1 distinct failure reasons 2022-05-04T10:27:43.406 INFO:scrape:Failure: "2022-05-04T09:42:35.062938+0000 mon.a (mon.0) 353 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log 2022-05-04T10:27:43.407 INFO:scrape:5 jobs: ['6820380', '6820383', '6820379', '6820384', '6820381'] 2022-05-04T10:27:43.407 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/functional/{begin/{0-install', 'mds', 'mon', 'osd}', 'overrides/{no_client_pidfile', 'tasks/snap-schedule}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-05-04T10:27:43.408 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{no_client_pidfile', 'rhel_8}', 'tasks/snap-schedule}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-05-04T10:27:43.408 INFO:scrape: 2022-05-04T10:27:43.409 INFO:teuthology.results:Sending results to mchangir@redhat.com: Test Run: mchangir-2022-05-04_09:22:05-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/mchangir-2022-05-04_09:22:05-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/mchangir-2022-05-04_09:22:05-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/ failed: 5 dead: 0 running: 0 waiting: 0 queued: 0 passed: 1 Fail ================================================================= [6820379] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule} ----------------------------------------------------------------- time: 00:43:02 info: http://pulpito.ceph.com/mchangir-2022-05-04_09:22:05-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820379/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2022-05-04_09:22:05-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820379/ "2022-05-04T09:37:44.656112+0000 mon.a (mon.0) 372 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY)" in cluster log [6820380] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule} ----------------------------------------------------------------- time: 00:46:48 info: http://pulpito.ceph.com/mchangir-2022-05-04_09:22:05-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820380/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2022-05-04_09:22:05-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820380/ "2022-05-04T09:42:35.062938+0000 mon.a (mon.0) 353 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log [6820381] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule} ----------------------------------------------------------------- time: 00:54:09 info: http://pulpito.ceph.com/mchangir-2022-05-04_09:22:05-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820381/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2022-05-04_09:22:05-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820381/ "2022-05-04T10:07:35.199794+0000 mon.a (mon.0) 1234 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log [6820383] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule} ----------------------------------------------------------------- time: 00:45:49 info: http://pulpito.ceph.com/mchangir-2022-05-04_09:22:05-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820383/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2022-05-04_09:22:05-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820383/ "2022-05-04T09:54:17.606039+0000 mon.a (mon.0) 609 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log [6820384] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule} ----------------------------------------------------------------- time: 00:48:30 info: http://pulpito.ceph.com/mchangir-2022-05-04_09:22:05-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820384/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2022-05-04_09:22:05-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820384/ "2022-05-04T10:00:25.751677+0000 mon.a (mon.0) 502 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log Pass ================================================================= [6820382] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule} time: 00:43:09 info: http://pulpito.ceph.com/mchangir-2022-05-04_09:22:05-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820382/