2023-09-05T15:00:34.811 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556
2023-09-05T15:00:34.812 INFO:teuthology.results:subset: '66/1024'
2023-09-05T15:00:34.812 INFO:teuthology.results:seed: '5474'
2023-09-05T15:04:49.355 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556
2023-09-05T15:04:49.362 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-09-05T16:08:54.373 INFO:teuthology.results:Tests finished! gathering results...
2023-09-05T16:08:54.898 INFO:scrape:Found 7 jobs
2023-09-05T16:08:56.444 INFO:scrape:Found 2 distinct failure reasons
2023-09-05T16:08:56.444 INFO:scrape:Failure: "2023-09-05T15:27:52.999557+0000 mon.a (mon.0) 303 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log
2023-09-05T16:08:56.445 INFO:scrape:3 jobs: ['7388365', '7388362', '7388366']
2023-09-05T16:08:56.445 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs:volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/volumes/{overrides']
2023-09-05T16:08:56.446 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'distro/{ubuntu_latest}', 'fs:volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/volumes/{overrides', 'test/finisher_per_module}}', 'test/misc}}', 'test/snapshot}}']
2023-09-05T16:08:56.446 INFO:scrape:
2023-09-05T16:08:56.447 INFO:scrape:Failure: Host key for server 'smithi096.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIH33/6ZEwqoXoRva2YZ3+Wq9ZOBjeGVPl9dsMlqSl1qS', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDRYmdEd+Ny8sWLxhKrPhH7rFnkl1u7LZqswBCx3x7Gk2os9he3FwboyJBwxa9sBr/trYlMtmDD23iqaJMUyuqMKlXWTg/utB1ld4kPwAcvLVy42UiHNDuQKBe82uDCi3L2mZqOjWhVE48ntkUzYPt+CFuMgOnyMA0r3HMVsorzTMPFFsb/hycEV5b3IdpgH36XCmMuZi+LxfoTokb5lLqLIYqzbGi5eo8J2c6ub6LAoLFj46DrFQuWSxRE38sD3VM9k7VK9ynCqRRebK3rhiZOFfzXz+vNCCuFqaPsZHSJmKoQmPk+rJbbXC8nJDgdcXV8oTciVAdQ++BWlKvk5VIOOs0M1IS3FwJCE7J5nveaSucU2znZTaVtyfjjFIyg0RQXp8en2WOzX9WpvlURbNdXrvoRn3sjI64qflgNeQVnX8HZ8bSIrchbUO5APf4XtJN+SyEv2kJQdqom5WLp86smy0/C7l40CArzA3r+cVj0TK4VC6d6kACB2XMTNqDRAqM='
2023-09-05T16:08:56.447 INFO:scrape:1 jobs: ['7388363']
2023-09-05T16:08:56.447 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs:volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/volumes/{overrides', 'test/basic}}']
2023-09-05T16:08:56.448 INFO:scrape:
2023-09-05T16:08:56.449 INFO:teuthology.results:Sending results to mchangir@redhat.com: Test Run: mchangir-2023-09-05_10:57:03-fs:volumes-wip-mchangir-testing-20230905.131537-testing-default-smithi
=================================================================
info:    http://pulpito.ceph.com/mchangir-2023-09-05_10:57:03-fs:volumes-wip-mchangir-testing-20230905.131537-testing-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/mchangir-2023-09-05_10:57:03-fs:volumes-wip-mchangir-testing-20230905.131537-testing-default-smithi/
failed:  4
dead:    0
running: 0
waiting: 0
queued:  0
passed:  3


Fail
=================================================================
[7388362]  fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}}
-----------------------------------------------------------------
time:   00:34:32
info:   http://pulpito.ceph.com/mchangir-2023-09-05_10:57:03-fs:volumes-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388362/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2023-09-05_10:57:03-fs:volumes-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388362/

    "2023-09-05T15:16:30.525335+0000 mon.a (mon.0) 216 : cluster [WRN] Health
    check failed: 1 pool(s) do not have an application enabled
    (POOL_APP_NOT_ENABLED)" in cluster log

[7388363]  fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/mchangir-2023-09-05_10:57:03-fs:volumes-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388363/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2023-09-05_10:57:03-fs:volumes-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388363/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bb1fb17c67e7420a8a78c279509990dc

    Host key for server 'smithi096.front.sepia.ceph.com' does not match: got
    'AAAAC3NzaC1lZDI1NTE5AAAAIH33/6ZEwqoXoRva2YZ3+Wq9ZOBjeGVPl9dsMlqSl1qS',
    expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDRYmdEd+Ny8sWLxhKrPhH7rFnkl1u7LZqsw
    BCx3x7Gk2os9he3FwboyJBwxa9sBr/trYlMtmDD23iqaJMUyuqMKlXWTg/utB1ld4kPwAcvLVy4
    2UiHNDuQKBe82uDCi3L2mZqOjWhVE48ntkUzYPt+CFuMgOnyMA0r3HMVsorzTMPFFsb/hycEV5b
    3IdpgH36XCmMuZi+LxfoTokb5lLqLIYqzbGi5eo8J2c6ub6LAoLFj46DrFQuWSxRE38sD3VM9k7
    VK9ynCqRRebK3rhiZOFfzXz+vNCCuFqaPsZHSJmKoQmPk+rJbbXC8nJDgdcXV8oTciVAdQ++BWl
    Kvk5VIOOs0M1IS3FwJCE7J5nveaSucU2znZTaVtyfjjFIyg0RQXp8en2WOzX9WpvlURbNdXrvoR
    n3sjI64qflgNeQVnX8HZ8bSIrchbUO5APf4XtJN+SyEv2kJQdqom5WLp86smy0/C7l40CArzA3r
    +cVj0TK4VC6d6kACB2XMTNqDRAqM='

[7388365]  fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}}
-----------------------------------------------------------------
time:   00:15:03
info:   http://pulpito.ceph.com/mchangir-2023-09-05_10:57:03-fs:volumes-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388365/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2023-09-05_10:57:03-fs:volumes-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388365/

    "2023-09-05T15:27:52.999557+0000 mon.a (mon.0) 303 : cluster [WRN] Health
    check failed: 2 pool(s) do not have an application enabled
    (POOL_APP_NOT_ENABLED)" in cluster log

[7388366]  fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}
-----------------------------------------------------------------
time:   00:19:47
info:   http://pulpito.ceph.com/mchangir-2023-09-05_10:57:03-fs:volumes-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388366/
log:    http://qa-proxy.ceph.com/teuthology/mchangir-2023-09-05_10:57:03-fs:volumes-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388366/

    "2023-09-05T15:19:56.211817+0000 mon.a (mon.0) 212 : cluster [WRN] Health
    check failed: 1 pool(s) do not have an application enabled
    (POOL_APP_NOT_ENABLED)" in cluster log



Pass
=================================================================
[7388360] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}}
time:   00:16:04
info:   http://pulpito.ceph.com/mchangir-2023-09-05_10:57:03-fs:volumes-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388360/

[7388361] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}
time:   00:22:01
info:   http://pulpito.ceph.com/mchangir-2023-09-05_10:57:03-fs:volumes-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388361/

[7388364] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}}
time:   00:59:31
info:   http://pulpito.ceph.com/mchangir-2023-09-05_10:57:03-fs:volumes-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388364/