2022-05-04T02:59:01.502 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166
2022-05-04T02:59:01.504 INFO:teuthology.results:seed: '2936'
2022-05-04T03:04:54.402 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166
2022-05-04T03:04:54.405 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-05-04T03:40:56.892 INFO:teuthology.results:Tests finished! gathering results...
2022-05-04T03:40:57.357 INFO:scrape:Found 6 jobs
2022-05-04T03:40:58.744 INFO:scrape:Found 1 distinct failure reasons
2022-05-04T03:40:58.745 INFO:scrape:Failure: Test failure: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules)
2022-05-04T03:40:58.746 INFO:scrape:6 jobs: ['6820355', '6820358', '6820360', '6820356', '6820357', '6820359']
2022-05-04T03:40:58.746 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/functional/{begin/{0-install', 'mds', 'mon', 'osd}', 'overrides/{no_client_pidfile', 'tasks/snap-schedule}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-05-04T03:40:58.747 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{no_client_pidfile', 'rhel_8}', 'tasks/snap-schedule}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-05-04T03:40:58.747 INFO:scrape:
2022-05-04T03:40:58.748 INFO:teuthology.results:Sending results to mchangir@redhat.com: Test Run: mchangir-2022-05-04_02:58:14-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/mchangir-2022-05-04_02:58:14-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/mchangir-2022-05-04_02:58:14-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/
failed:  6
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[6820355]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:23:29
info:   http://pulpito.ceph.com/mchangir-2022-05-04_02:58:14-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820355/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2022-05-04_02:58:14-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820355/
sentry: https://sentry.ceph.com/organizations/ceph/?query=56a7a47a83a84c468ad9aa2ecfc9cec4

    Test failure: test_concurrent_snap_creates
    (tasks.cephfs.test_snap_schedules.TestSnapSchedules)

[6820356]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:23:01
info:   http://pulpito.ceph.com/mchangir-2022-05-04_02:58:14-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820356/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2022-05-04_02:58:14-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820356/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2a1619da749242458ddba17752c15be6

    Test failure: test_concurrent_snap_creates
    (tasks.cephfs.test_snap_schedules.TestSnapSchedules)

[6820357]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:28:46
info:   http://pulpito.ceph.com/mchangir-2022-05-04_02:58:14-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820357/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2022-05-04_02:58:14-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820357/
sentry: https://sentry.ceph.com/organizations/ceph/?query=da30bf9bb4144b1ebc16083f96efc94b

    Test failure: test_concurrent_snap_creates
    (tasks.cephfs.test_snap_schedules.TestSnapSchedules)

[6820358]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:18:29
info:   http://pulpito.ceph.com/mchangir-2022-05-04_02:58:14-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820358/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2022-05-04_02:58:14-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820358/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e5a12c7c94f5459f997d6e32725f9015

    Test failure: test_concurrent_snap_creates
    (tasks.cephfs.test_snap_schedules.TestSnapSchedules)

[6820359]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:23:12
info:   http://pulpito.ceph.com/mchangir-2022-05-04_02:58:14-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820359/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2022-05-04_02:58:14-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820359/
sentry: https://sentry.ceph.com/organizations/ceph/?query=21e29fd0d3e640ae82f8b902cf10dc8f

    Test failure: test_concurrent_snap_creates
    (tasks.cephfs.test_snap_schedules.TestSnapSchedules)

[6820360]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:28:10
info:   http://pulpito.ceph.com/mchangir-2022-05-04_02:58:14-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820360/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2022-05-04_02:58:14-fs-wip-mchangir-TESTING-mgr-snap_schedule-distro-default-smithi/6820360/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c102131663bf4e9e86fd02f83ca451ae

    Test failure: test_concurrent_snap_creates
    (tasks.cephfs.test_snap_schedules.TestSnapSchedules)