2023-10-13T13:40:56.910 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-13T13:40:56.911 INFO:teuthology.results:seed: '3264' 2023-10-13T13:41:42.091 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-13T13:41:42.094 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-10-13T15:44:50.479 INFO:teuthology.results:Tests finished! gathering results... 2023-10-13T15:44:50.747 INFO:scrape:Found 6 jobs 2023-10-13T15:44:52.387 INFO:scrape:Found 1 distinct failure reasons 2023-10-13T15:44:52.387 INFO:scrape:Failure: "2023-10-13T14:06:09.202313+0000 mon.a (mon.0) 406 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log 2023-10-13T15:44:52.388 INFO:scrape:4 jobs: ['7424225', '7424224', '7424228', '7424227'] 2023-10-13T15:44:52.388 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'osd}', 'overrides/{ignorelist_health', 'tasks/snap-schedule}'] 2023-10-13T15:44:52.389 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/snap-schedule}'] 2023-10-13T15:44:52.389 INFO:scrape: 2023-10-13T15:44:52.390 INFO:teuthology.results:Sending results to mchangir@redhat.com: Test Run: mchangir-2023-10-13_13:39:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/mchangir-2023-10-13_13:39:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/mchangir-2023-10-13_13:39:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/ failed: 4 dead: 0 running: 0 waiting: 0 queued: 0 passed: 2 Fail ================================================================= [7424224] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} ----------------------------------------------------------------- time: 01:47:00 info: http://pulpito.ceph.com/mchangir-2023-10-13_13:39:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7424224/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2023-10-13_13:39:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7424224/ "2023-10-13T14:00:17.065981+0000 mon.a (mon.0) 531 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log [7424225] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} ----------------------------------------------------------------- time: 01:52:47 info: http://pulpito.ceph.com/mchangir-2023-10-13_13:39:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7424225/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2023-10-13_13:39:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7424225/ "2023-10-13T14:06:09.202313+0000 mon.a (mon.0) 406 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log [7424227] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} ----------------------------------------------------------------- time: 01:46:56 info: http://pulpito.ceph.com/mchangir-2023-10-13_13:39:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7424227/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2023-10-13_13:39:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7424227/ "2023-10-13T14:14:13.293630+0000 mon.a (mon.0) 670 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log [7424228] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} ----------------------------------------------------------------- time: 01:51:50 info: http://pulpito.ceph.com/mchangir-2023-10-13_13:39:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7424228/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2023-10-13_13:39:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7424228/ "2023-10-13T14:18:30.265323+0000 mon.a (mon.0) 506 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log Pass ================================================================= [7424226] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} time: 01:51:20 info: http://pulpito.ceph.com/mchangir-2023-10-13_13:39:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7424226/ [7424229] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} time: 01:50:33 info: http://pulpito.ceph.com/mchangir-2023-10-13_13:39:46-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7424229/