2024-03-03T01:46:24.621 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-03-03T01:46:24.622 INFO:teuthology.results:seed: '7600'
2024-03-03T01:54:48.814 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-03-03T01:54:48.832 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2024-03-03T02:33:51.850 INFO:teuthology.results:Tests finished! gathering results...
2024-03-03T02:33:52.436 INFO:scrape:Found 12 jobs
2024-03-03T02:33:55.245 INFO:scrape:Found 1 distinct failure reasons
2024-03-03T02:33:55.245 INFO:scrape:Failure: Test failure: test_quiesce_path_release (tasks.cephfs.test_quiesce.TestQuiesce)
2024-03-03T02:33:55.245 INFO:scrape:12 jobs: ['7580308', '7580312', '7580310', '7580305', '7580314', '7580311', '7580304', '7580315', '7580313', '7580306', '7580309', '7580307']
2024-03-03T02:33:55.246 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'osd}', 'overrides/{ignorelist_health', 'tasks/quiesce}']
2024-03-03T02:33:55.246 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'distro/{ubuntu_latest}', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'k-stock}', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{centos_9.stream', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'subvol_versions/create_subvol_version_v1', 'subvol_versions/create_subvol_version_v2', 'tasks/quiesce}']
2024-03-03T02:33:55.246 INFO:scrape:
2024-03-03T02:33:55.247 INFO:teuthology.results:Sending results to pdonnell@redhat.com: Test Run: pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi
=================================================================
info:    https://pulpito.ceph.com/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/
failed:  12
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[7580304]  fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/quiesce}
-----------------------------------------------------------------
time:   00:26:04
info:   https://pulpito.ceph.com/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580304/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580304/
sentry: https://sentry.ceph.com/organizations/ceph/?query=453daae48e744e1cbf4f38164bb0312b

    Test failure: test_quiesce_path_release
    (tasks.cephfs.test_quiesce.TestQuiesce)

[7580305]  fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/quiesce}
-----------------------------------------------------------------
time:   00:23:51
info:   https://pulpito.ceph.com/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580305/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580305/
sentry: https://sentry.ceph.com/organizations/ceph/?query=75a71483950a4d5b8b3fb0bddac8f9b0

    Test failure: test_quiesce_path_release
    (tasks.cephfs.test_quiesce.TestQuiesce)

[7580306]  fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/quiesce}
-----------------------------------------------------------------
time:   00:21:15
info:   https://pulpito.ceph.com/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580306/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580306/
sentry: https://sentry.ceph.com/organizations/ceph/?query=febe166407c9430183aa6572396663c0

    Test failure: test_quiesce_path_release
    (tasks.cephfs.test_quiesce.TestQuiesce)

[7580307]  fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/quiesce}
-----------------------------------------------------------------
time:   00:26:45
info:   https://pulpito.ceph.com/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580307/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580307/
sentry: https://sentry.ceph.com/organizations/ceph/?query=702cba6f0cb547ec9bfa8b2e1ea853e6

    Test failure: test_quiesce_path_release
    (tasks.cephfs.test_quiesce.TestQuiesce)

[7580308]  fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/quiesce}
-----------------------------------------------------------------
time:   00:24:19
info:   https://pulpito.ceph.com/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580308/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580308/
sentry: https://sentry.ceph.com/organizations/ceph/?query=030dbeab07454df6a28238b90309827b

    Test failure: test_quiesce_path_release
    (tasks.cephfs.test_quiesce.TestQuiesce)

[7580309]  fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/quiesce}
-----------------------------------------------------------------
time:   00:20:27
info:   https://pulpito.ceph.com/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580309/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580309/
sentry: https://sentry.ceph.com/organizations/ceph/?query=58347bfaf362450b8b05bc9b3ff3b4ab

    Test failure: test_quiesce_path_release
    (tasks.cephfs.test_quiesce.TestQuiesce)

[7580310]  fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/quiesce}
-----------------------------------------------------------------
time:   00:26:07
info:   https://pulpito.ceph.com/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580310/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580310/
sentry: https://sentry.ceph.com/organizations/ceph/?query=36116fbe694c484ebb17fce27aa63ec9

    Test failure: test_quiesce_path_release
    (tasks.cephfs.test_quiesce.TestQuiesce)

[7580311]  fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/quiesce}
-----------------------------------------------------------------
time:   00:28:07
info:   https://pulpito.ceph.com/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580311/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580311/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5c3e3a39dd4e43eb990900e9406bfcec

    Test failure: test_quiesce_path_release
    (tasks.cephfs.test_quiesce.TestQuiesce)

[7580312]  fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/quiesce}
-----------------------------------------------------------------
time:   00:20:14
info:   https://pulpito.ceph.com/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580312/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580312/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3983954dff454997b0377aff9dba24bb

    Test failure: test_quiesce_path_release
    (tasks.cephfs.test_quiesce.TestQuiesce)

[7580313]  fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/quiesce}
-----------------------------------------------------------------
time:   00:25:59
info:   https://pulpito.ceph.com/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580313/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580313/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4974bbe96b37441fb950039f4f0b1401

    Test failure: test_quiesce_path_release
    (tasks.cephfs.test_quiesce.TestQuiesce)

[7580314]  fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/quiesce}
-----------------------------------------------------------------
time:   00:28:01
info:   https://pulpito.ceph.com/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580314/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580314/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d237ed446a52470cb8fd691836cb7c83

    Test failure: test_quiesce_path_release
    (tasks.cephfs.test_quiesce.TestQuiesce)

[7580315]  fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/quiesce}
-----------------------------------------------------------------
time:   00:21:17
info:   https://pulpito.ceph.com/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580315/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2024-03-03_01:44:34-fs:functional-wip-batrick-testing-20240302.183851-distro-default-smithi/7580315/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c680bc3addb7486192c166e6b5e7422b

    Test failure: test_quiesce_path_release
    (tasks.cephfs.test_quiesce.TestQuiesce)