2024-02-08T14:28:17.853 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-02-08T14:28:17.853 INFO:teuthology.results:seed: '5527'
2024-02-08T14:38:58.458 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-02-08T14:38:58.483 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2024-02-08T16:37:08.125 INFO:teuthology.results:Tests finished! gathering results...
2024-02-08T16:37:09.396 INFO:scrape:Found 15 jobs
2024-02-08T16:37:14.264 INFO:scrape:Found 2 distinct failure reasons
2024-02-08T16:37:14.265 INFO:scrape:Failure: local variable 'version' referenced before assignment
2024-02-08T16:37:14.265 INFO:scrape:3 jobs: ['7551942', '7551951', '7551945']
2024-02-08T16:37:14.265 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'fs:volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/volumes/{overrides']
2024-02-08T16:37:14.265 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'fs:volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/volumes/{overrides', 'test/basic}}', 'test/misc}}', 'test/snapshot}}']
2024-02-08T16:37:14.266 INFO:scrape:
2024-02-08T16:37:14.266 INFO:scrape:Failure: Test failure: test_subvolume_snapshot_clone_with_no_wait_enabled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones)
2024-02-08T16:37:14.266 INFO:scrape:3 jobs: ['7551948', '7551943', '7551938']
2024-02-08T16:37:14.266 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs:volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/volumes/{overrides', 'test/clone}}']
2024-02-08T16:37:14.266 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'distro/{ubuntu_latest}', 'fs:volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'k-stock}', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{centos_9.stream', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/volumes/{overrides', 'test/clone}}']
2024-02-08T16:37:14.267 INFO:scrape:
2024-02-08T16:37:14.268 INFO:teuthology.results:Sending results to neesingh@redhat.com: Test Run: neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi
=================================================================
info:    https://pulpito.ceph.com/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/
failed:  6
dead:    0
running: 0
waiting: 0
queued:  0
passed:  9


Fail
=================================================================
[7551938]  fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}}
-----------------------------------------------------------------
time:   00:43:12
info:   https://pulpito.ceph.com/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551938/
log:    http://qa-proxy.ceph.com/teuthology/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551938/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e39faa911ca6401bbddf81ea10d98f5f

    Test failure: test_subvolume_snapshot_clone_with_no_wait_enabled
    (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones)

[7551942]  fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551942/
log:    http://qa-proxy.ceph.com/teuthology/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551942/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a2af4f5583f84f3ca6e49a24f3cbab5c

    local variable 'version' referenced before assignment

[7551943]  fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}}
-----------------------------------------------------------------
time:   00:44:07
info:   https://pulpito.ceph.com/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551943/
log:    http://qa-proxy.ceph.com/teuthology/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551943/
sentry: https://sentry.ceph.com/organizations/ceph/?query=446160e95b1749bc84c33c87bbf8cf06

    Test failure: test_subvolume_snapshot_clone_with_no_wait_enabled
    (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones)

[7551945]  fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551945/
log:    http://qa-proxy.ceph.com/teuthology/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551945/
sentry: https://sentry.ceph.com/organizations/ceph/?query=af1fda21bde2415286e1a94d17f56f6f

    local variable 'version' referenced before assignment

[7551948]  fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}}
-----------------------------------------------------------------
time:   00:49:28
info:   https://pulpito.ceph.com/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551948/
log:    http://qa-proxy.ceph.com/teuthology/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551948/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0aca871c93b444ca91bc689d49685a35

    Test failure: test_subvolume_snapshot_clone_with_no_wait_enabled
    (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones)

[7551951]  fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551951/
log:    http://qa-proxy.ceph.com/teuthology/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551951/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c8697f013aa047d295348d7870cb202a

    local variable 'version' referenced before assignment



Pass
=================================================================
[7551937] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}
time:   01:56:48
info:   https://pulpito.ceph.com/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551937/

[7551939] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}}
time:   00:13:22
info:   https://pulpito.ceph.com/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551939/

[7551940] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}
time:   00:16:53
info:   https://pulpito.ceph.com/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551940/

[7551941] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}}
time:   00:28:39
info:   https://pulpito.ceph.com/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551941/

[7551944] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}}
time:   00:09:34
info:   https://pulpito.ceph.com/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551944/

[7551946] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}}
time:   00:29:56
info:   https://pulpito.ceph.com/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551946/

[7551947] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}
time:   01:36:52
info:   https://pulpito.ceph.com/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551947/

[7551949] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}}
time:   00:13:24
info:   https://pulpito.ceph.com/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551949/

[7551950] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}
time:   00:16:51
info:   https://pulpito.ceph.com/neesingh-2024-02-08_14:27:40-fs:volumes-wip-neesingh-testing-8022024-distro-default-smithi/7551950/