2022-03-01T04:18:34.791 INFO:root:teuthology version: 1.1.0-cb5b1a75 2022-03-01T04:18:34.793 INFO:teuthology.results:seed: '6977' 2022-03-01T04:23:31.606 INFO:root:teuthology version: 1.1.0-cb5b1a75 2022-03-01T04:23:31.611 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-03-01T05:23:36.028 INFO:teuthology.results:Tests finished! gathering results... 2022-03-01T05:23:36.286 INFO:scrape:Found 5 jobs 2022-03-01T05:23:37.006 INFO:scrape:Found 1 distinct failure reasons 2022-03-01T05:23:37.007 INFO:scrape:Failure: "2022-03-01T05:03:26.521668+0000 mon.a (mon.0) 1305 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log 2022-03-01T05:23:37.008 INFO:scrape:1 jobs: ['6713324'] 2022-03-01T05:23:37.009 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs/functional/{begin/{0-install', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{no_client_pidfile', 'tasks/snap-schedule}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-03-01T05:23:37.010 INFO:scrape: 2022-03-01T05:23:37.011 INFO:teuthology.results:Sending results to mchangir@redhat.com: Test Run: mchangir-2022-03-01_04:16:35-fs-wip-mchangir-mgr-snap_schedule-restart-old-schedules-on-startup-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/mchangir-2022-03-01_04:16:35-fs-wip-mchangir-mgr-snap_schedule-restart-old-schedules-on-startup-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/mchangir-2022-03-01_04:16:35-fs-wip-mchangir-mgr-snap_schedule-restart-old-schedules-on-startup-distro-default-smithi/ failed: 1 dead: 0 running: 0 waiting: 0 queued: 0 passed: 4 Fail ================================================================= [6713324] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule} ----------------------------------------------------------------- time: 00:49:31 info: http://pulpito.ceph.com/mchangir-2022-03-01_04:16:35-fs-wip-mchangir-mgr-snap_schedule-restart-old-schedules-on-startup-distro-default-smithi/6713324/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2022-03-01_04:16:35-fs-wip-mchangir-mgr-snap_schedule-restart-old-schedules-on-startup-distro-default-smithi/6713324/ "2022-03-01T05:03:26.521668+0000 mon.a (mon.0) 1305 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log Pass ================================================================= [6713322] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule} time: 00:43:25 info: http://pulpito.ceph.com/mchangir-2022-03-01_04:16:35-fs-wip-mchangir-mgr-snap_schedule-restart-old-schedules-on-startup-distro-default-smithi/6713322/ [6713323] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule} time: 00:48:12 info: http://pulpito.ceph.com/mchangir-2022-03-01_04:16:35-fs-wip-mchangir-mgr-snap_schedule-restart-old-schedules-on-startup-distro-default-smithi/6713323/ [6713325] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule} time: 00:42:53 info: http://pulpito.ceph.com/mchangir-2022-03-01_04:16:35-fs-wip-mchangir-mgr-snap_schedule-restart-old-schedules-on-startup-distro-default-smithi/6713325/ [6713326] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule} time: 00:48:17 info: http://pulpito.ceph.com/mchangir-2022-03-01_04:16:35-fs-wip-mchangir-mgr-snap_schedule-restart-old-schedules-on-startup-distro-default-smithi/6713326/