2023-11-07T11:14:32.807 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-07T11:14:32.808 INFO:teuthology.results:seed: '1083'
2023-11-07T11:23:32.825 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-07T11:23:32.828 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-11-07T13:22:41.848 INFO:teuthology.results:Tests finished! gathering results...
2023-11-07T13:22:42.214 INFO:scrape:Found 6 jobs
2023-11-07T13:22:46.725 INFO:scrape:Found 2 distinct failure reasons
2023-11-07T13:22:46.726 INFO:scrape:Failure: "1699357004.9440105 mon.a (mon.0) 363 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
2023-11-07T13:22:46.726 INFO:scrape:2 jobs: ['7450710', '7450712']
2023-11-07T13:22:46.727 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'tasks/snap-schedule}']
2023-11-07T13:22:46.727 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'rhel_8}', 'tasks/snap-schedule}']
2023-11-07T13:22:46.728 INFO:scrape:
2023-11-07T13:22:46.728 INFO:scrape:Failure: Test failure: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir)
2023-11-07T13:22:46.728 INFO:scrape:4 jobs: ['7450708', '7450709', '7450713', '7450711']
2023-11-07T13:22:46.729 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'osd}', 'overrides/{ignorelist_health', 'tasks/snap-schedule}']
2023-11-07T13:22:46.729 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'rhel_8}', 'tasks/snap-schedule}']
2023-11-07T13:22:46.730 INFO:scrape:
2023-11-07T13:22:46.730 INFO:teuthology.results:Sending results to mchangir@redhat.com: Test Run: mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi
=================================================================
info:    https://pulpito.ceph.com/mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi/
failed:  6
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[7450708]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}
-----------------------------------------------------------------
time:   01:47:59
info:   https://pulpito.ceph.com/mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi/7450708/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi/7450708/
sentry: https://sentry.ceph.com/organizations/ceph/?query=17d0ae3f5a474135aedcb50dce8ac427

    Test failure: test_snap_dir_name
    (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir)

[7450709]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}
-----------------------------------------------------------------
time:   01:52:36
info:   https://pulpito.ceph.com/mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi/7450709/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi/7450709/
sentry: https://sentry.ceph.com/organizations/ceph/?query=25d29d7af80b4075bd575ff07873d4a7

    Test failure: test_snap_dir_name
    (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir)

[7450710]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}
-----------------------------------------------------------------
time:   01:48:40
info:   https://pulpito.ceph.com/mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi/7450710/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi/7450710/

    "1699357004.9440105 mon.a (mon.0) 363 : cluster [WRN] Health check failed:
    Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

[7450711]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}
-----------------------------------------------------------------
time:   01:47:54
info:   https://pulpito.ceph.com/mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi/7450711/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi/7450711/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d3b606d87f694200be82c37226b1939e

    Test failure: test_snap_dir_name
    (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir)

[7450712]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}
-----------------------------------------------------------------
time:   01:50:37
info:   https://pulpito.ceph.com/mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi/7450712/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi/7450712/

    "1699358509.6266558 mon.a (mon.0) 1155 : cluster [WRN] Health check failed:
    Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log

[7450713]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}
-----------------------------------------------------------------
time:   01:48:21
info:   https://pulpito.ceph.com/mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi/7450713/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi/7450713/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7409e42b64e9461db4e59a004528aca0

    Test failure: test_snap_dir_name
    (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir)