2022-06-21T15:46:46.860 INFO:root:teuthology version: 1.1.1.dev374+g31a356e0
2022-06-21T15:46:46.862 INFO:teuthology.results:seed: '4063'
2022-06-21T15:47:30.208 INFO:root:teuthology version: 1.1.1.dev374+g31a356e0
2022-06-21T15:47:30.273 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-06-21T16:49:36.049 INFO:teuthology.results:Tests finished! gathering results...
2022-06-21T16:49:36.778 INFO:scrape:Found 8 jobs
2022-06-21T16:49:40.746 INFO:scrape:Found 1 distinct failure reasons
2022-06-21T16:49:40.747 INFO:scrape:Failure: Test failure: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules)
2022-06-21T16:49:40.747 INFO:scrape:8 jobs: ['6889432', '6889430', '6889429', '6889434', '6889431', '6889428', '6889435', '6889433']
2022-06-21T16:49:40.748 INFO:scrape:suites intersection: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/functional/{begin', 'mds', 'mon', 'osd}', 'overrides/{no_client_pidfile', 'tasks/snap-schedule}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-06-21T16:49:40.749 INFO:scrape:suites union: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'fs/functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/fuse', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{no_client_pidfile', 'rhel_8}', 'tasks/snap-schedule}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-06-21T16:49:40.749 INFO:scrape:
2022-06-21T16:49:40.750 INFO:teuthology.results:Sending results to mchangir@redhat.com: Test Run: mchangir-2022-06-21_15:46:36-fs-wip-mchangir-mgr-snap_schedule-persist-all-changes-to-rados-pacific-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/mchangir-2022-06-21_15:46:36-fs-wip-mchangir-mgr-snap_schedule-persist-all-changes-to-rados-pacific-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/mchangir-2022-06-21_15:46:36-fs-wip-mchangir-mgr-snap_schedule-persist-all-changes-to-rados-pacific-distro-default-smithi/
failed:  8
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[6889428]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:48:53
info:   http://pulpito.ceph.com/mchangir-2022-06-21_15:46:36-fs-wip-mchangir-mgr-snap_schedule-persist-all-changes-to-rados-pacific-distro-default-smithi/6889428/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2022-06-21_15:46:36-fs-wip-mchangir-mgr-snap_schedule-persist-all-changes-to-rados-pacific-distro-default-smithi/6889428/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ced3129021c745b5a3d396f96a518a7d

    Test failure: test_snap_schedule_with_mgr_restart
    (tasks.cephfs.test_snap_schedules.TestSnapSchedules)

[6889429]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:44:15
info:   http://pulpito.ceph.com/mchangir-2022-06-21_15:46:36-fs-wip-mchangir-mgr-snap_schedule-persist-all-changes-to-rados-pacific-distro-default-smithi/6889429/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2022-06-21_15:46:36-fs-wip-mchangir-mgr-snap_schedule-persist-all-changes-to-rados-pacific-distro-default-smithi/6889429/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ae4b7386ee2c4edf96bd1a44360c63c0

    Test failure: test_snap_schedule_with_mgr_restart
    (tasks.cephfs.test_snap_schedules.TestSnapSchedules)

[6889430]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:50:14
info:   http://pulpito.ceph.com/mchangir-2022-06-21_15:46:36-fs-wip-mchangir-mgr-snap_schedule-persist-all-changes-to-rados-pacific-distro-default-smithi/6889430/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2022-06-21_15:46:36-fs-wip-mchangir-mgr-snap_schedule-persist-all-changes-to-rados-pacific-distro-default-smithi/6889430/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a2cf3c8efed84dd097abd86ade5b0374

    Test failure: test_snap_schedule_with_mgr_restart
    (tasks.cephfs.test_snap_schedules.TestSnapSchedules)

[6889431]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:41:10
info:   http://pulpito.ceph.com/mchangir-2022-06-21_15:46:36-fs-wip-mchangir-mgr-snap_schedule-persist-all-changes-to-rados-pacific-distro-default-smithi/6889431/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2022-06-21_15:46:36-fs-wip-mchangir-mgr-snap_schedule-persist-all-changes-to-rados-pacific-distro-default-smithi/6889431/
sentry: https://sentry.ceph.com/organizations/ceph/?query=70155699050b4261b07867270ef57d7a

    Test failure: test_snap_schedule_with_mgr_restart
    (tasks.cephfs.test_snap_schedules.TestSnapSchedules)

[6889432]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:48:23
info:   http://pulpito.ceph.com/mchangir-2022-06-21_15:46:36-fs-wip-mchangir-mgr-snap_schedule-persist-all-changes-to-rados-pacific-distro-default-smithi/6889432/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2022-06-21_15:46:36-fs-wip-mchangir-mgr-snap_schedule-persist-all-changes-to-rados-pacific-distro-default-smithi/6889432/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dfb229b428b34750965eef095b8f0b5c

    Test failure: test_snap_schedule_with_mgr_restart
    (tasks.cephfs.test_snap_schedules.TestSnapSchedules)

[6889433]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:43:21
info:   http://pulpito.ceph.com/mchangir-2022-06-21_15:46:36-fs-wip-mchangir-mgr-snap_schedule-persist-all-changes-to-rados-pacific-distro-default-smithi/6889433/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2022-06-21_15:46:36-fs-wip-mchangir-mgr-snap_schedule-persist-all-changes-to-rados-pacific-distro-default-smithi/6889433/
sentry: https://sentry.ceph.com/organizations/ceph/?query=59f8a97de9a1415e9ee9ca729ddc03f4

    Test failure: test_snap_schedule_with_mgr_restart
    (tasks.cephfs.test_snap_schedules.TestSnapSchedules)

[6889434]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:49:14
info:   http://pulpito.ceph.com/mchangir-2022-06-21_15:46:36-fs-wip-mchangir-mgr-snap_schedule-persist-all-changes-to-rados-pacific-distro-default-smithi/6889434/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2022-06-21_15:46:36-fs-wip-mchangir-mgr-snap_schedule-persist-all-changes-to-rados-pacific-distro-default-smithi/6889434/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b2faf837f1f5416ebbdbf00462f01c6f

    Test failure: test_snap_schedule_with_mgr_restart
    (tasks.cephfs.test_snap_schedules.TestSnapSchedules)

[6889435]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:40:45
info:   http://pulpito.ceph.com/mchangir-2022-06-21_15:46:36-fs-wip-mchangir-mgr-snap_schedule-persist-all-changes-to-rados-pacific-distro-default-smithi/6889435/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2022-06-21_15:46:36-fs-wip-mchangir-mgr-snap_schedule-persist-all-changes-to-rados-pacific-distro-default-smithi/6889435/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a08d08b6ebde4681915d6691cfdc5bfc

    Test failure: test_snap_schedule_with_mgr_restart
    (tasks.cephfs.test_snap_schedules.TestSnapSchedules)