2022-07-05T02:18:41.826 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3
2022-07-05T02:18:41.828 INFO:teuthology.results:subset: '3/4'
2022-07-05T02:18:41.828 INFO:teuthology.results:seed: '2839'
2022-07-05T03:03:30.049 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3
2022-07-05T03:03:30.053 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-07-05T04:26:36.265 INFO:teuthology.results:Tests finished! gathering results...
2022-07-05T04:26:37.637 INFO:scrape:Found 18 jobs
2022-07-05T04:26:39.140 INFO:scrape:Found 1 distinct failure reasons
2022-07-05T04:26:39.141 INFO:scrape:Failure: "2022-07-05T03:17:23.561533+0000 mon.a (mon.0) 120 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log
2022-07-05T04:26:39.141 INFO:scrape:2 jobs: ['6912817', '6912809']
2022-07-05T04:26:39.142 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs:volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/volumes/{overrides']
2022-07-05T04:26:39.142 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs:volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/volumes/{overrides', 'test/basic}}', 'test/snapshot}}']
2022-07-05T04:26:39.143 INFO:scrape:
2022-07-05T04:26:39.144 INFO:teuthology.results:Sending results to nshelke@redhat.com: Test Run: nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/
failed:  2
dead:    0
running: 0
waiting: 0
queued:  0
passed:  16


Fail
=================================================================
[6912809]  fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}
-----------------------------------------------------------------
time:   01:33:21
info:   http://pulpito.ceph.com/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912809/
log:    http://qa-proxy.ceph.com/teuthology/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912809/

    "2022-07-05T03:19:15.779187+0000 mon.a (mon.0) 3157 : cluster [WRN] Health
    check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in
    cluster log

[6912817]  fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}}
-----------------------------------------------------------------
time:   00:31:10
info:   http://pulpito.ceph.com/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912817/
log:    http://qa-proxy.ceph.com/teuthology/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912817/

    "2022-07-05T03:17:23.561533+0000 mon.a (mon.0) 120 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log



Pass
=================================================================
[6912802] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}
time:   00:18:01
info:   http://pulpito.ceph.com/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912802/

[6912803] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}
time:   00:17:38
info:   http://pulpito.ceph.com/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912803/

[6912804] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}
time:   00:18:15
info:   http://pulpito.ceph.com/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912804/

[6912805] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}}
time:   00:28:45
info:   http://pulpito.ceph.com/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912805/

[6912806] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}}
time:   00:29:47
info:   http://pulpito.ceph.com/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912806/

[6912807] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}}
time:   00:29:03
info:   http://pulpito.ceph.com/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912807/

[6912808] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}
time:   01:29:38
info:   http://pulpito.ceph.com/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912808/

[6912810] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}
time:   01:28:56
info:   http://pulpito.ceph.com/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912810/

[6912811] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}}
time:   00:42:49
info:   http://pulpito.ceph.com/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912811/

[6912812] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}}
time:   00:43:02
info:   http://pulpito.ceph.com/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912812/

[6912813] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}}
time:   00:43:17
info:   http://pulpito.ceph.com/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912813/

[6912814] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}
time:   00:17:29
info:   http://pulpito.ceph.com/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912814/

[6912815] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}
time:   00:17:01
info:   http://pulpito.ceph.com/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912815/

[6912816] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}
time:   00:16:57
info:   http://pulpito.ceph.com/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912816/

[6912818] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}}
time:   00:31:23
info:   http://pulpito.ceph.com/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912818/

[6912819] fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}}
time:   00:31:11
info:   http://pulpito.ceph.com/nshelke-2022-07-05_02:17:14-fs:volumes-wip-nshelke-filter-internal-dirs-04-07-2022-distro-default-smithi/6912819/