2022-12-06T04:43:46.158 INFO:root:teuthology version: 0.0.1.dev3+g4da97cf
2022-12-06T04:43:46.160 INFO:teuthology.results:seed: '701'
2022-12-06T04:44:29.290 INFO:root:teuthology version: 0.0.1.dev3+g4da97cf
2022-12-06T04:44:29.293 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-12-06T05:11:31.058 INFO:teuthology.results:Tests finished! gathering results...
2022-12-06T05:11:31.404 INFO:scrape:Found 6 jobs
2022-12-06T05:11:32.859 INFO:scrape:Found 2 distinct failure reasons
2022-12-06T05:11:32.860 INFO:scrape:Failure: Test failure: test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub)
2022-12-06T05:11:32.861 INFO:scrape:4 jobs: ['7103823', '7103820', '7103821', '7103824']
2022-12-06T05:11:32.861 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'osd}', 'overrides/{ignorelist_health', 'tasks/forward-scrub}']
2022-12-06T05:11:32.862 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{ignorelist_health', 'rhel_8}', 'tasks/forward-scrub}']
2022-12-06T05:11:32.862 INFO:scrape:
2022-12-06T05:11:32.863 INFO:scrape:Failure: Test failure: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub)
2022-12-06T05:11:32.863 INFO:scrape:2 jobs: ['7103822', '7103825']
2022-12-06T05:11:32.863 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/forward-scrub}']
2022-12-06T05:11:32.864 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/forward-scrub}']
2022-12-06T05:11:32.864 INFO:scrape:
2022-12-06T05:11:32.865 INFO:teuthology.results:Sending results to neesingh@redhat.com: Test Run: neesingh-2022-12-06_04:42:06-fs-issue_54557-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/neesingh-2022-12-06_04:42:06-fs-issue_54557-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/neesingh-2022-12-06_04:42:06-fs-issue_54557-distro-default-smithi/
failed:  6
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[7103820]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub}
-----------------------------------------------------------------
time:   00:19:46
info:   http://pulpito.ceph.com/neesingh-2022-12-06_04:42:06-fs-issue_54557-distro-default-smithi/7103820/
log:    http://qa-proxy.ceph.com/teuthology/neesingh-2022-12-06_04:42:06-fs-issue_54557-distro-default-smithi/7103820/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a777e9f7688b4ce19db5227408934e5a

    Test failure: test_health_status_after_dirfrag_repair
    (tasks.cephfs.test_forward_scrub.TestForwardScrub)

[7103821]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub}
-----------------------------------------------------------------
time:   00:19:02
info:   http://pulpito.ceph.com/neesingh-2022-12-06_04:42:06-fs-issue_54557-distro-default-smithi/7103821/
log:    http://qa-proxy.ceph.com/teuthology/neesingh-2022-12-06_04:42:06-fs-issue_54557-distro-default-smithi/7103821/
sentry: https://sentry.ceph.com/organizations/ceph/?query=88a484169af545e695952805ab3ab386

    Test failure: test_health_status_after_dirfrag_repair
    (tasks.cephfs.test_forward_scrub.TestForwardScrub)

[7103822]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub}
-----------------------------------------------------------------
time:   00:16:32
info:   http://pulpito.ceph.com/neesingh-2022-12-06_04:42:06-fs-issue_54557-distro-default-smithi/7103822/
log:    http://qa-proxy.ceph.com/teuthology/neesingh-2022-12-06_04:42:06-fs-issue_54557-distro-default-smithi/7103822/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b22fae621a27468ba36f85c32abe49cc

    Test failure: test_backtrace_repair
    (tasks.cephfs.test_forward_scrub.TestForwardScrub)

[7103823]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub}
-----------------------------------------------------------------
time:   00:19:07
info:   http://pulpito.ceph.com/neesingh-2022-12-06_04:42:06-fs-issue_54557-distro-default-smithi/7103823/
log:    http://qa-proxy.ceph.com/teuthology/neesingh-2022-12-06_04:42:06-fs-issue_54557-distro-default-smithi/7103823/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5b9fe7d50d984e0e84d1ddee3ca059a9

    Test failure: test_health_status_after_dirfrag_repair
    (tasks.cephfs.test_forward_scrub.TestForwardScrub)

[7103824]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub}
-----------------------------------------------------------------
time:   00:19:18
info:   http://pulpito.ceph.com/neesingh-2022-12-06_04:42:06-fs-issue_54557-distro-default-smithi/7103824/
log:    http://qa-proxy.ceph.com/teuthology/neesingh-2022-12-06_04:42:06-fs-issue_54557-distro-default-smithi/7103824/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5de19309956148feb4cc8f7c2c958aad

    Test failure: test_health_status_after_dirfrag_repair
    (tasks.cephfs.test_forward_scrub.TestForwardScrub)

[7103825]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub}
-----------------------------------------------------------------
time:   00:16:27
info:   http://pulpito.ceph.com/neesingh-2022-12-06_04:42:06-fs-issue_54557-distro-default-smithi/7103825/
log:    http://qa-proxy.ceph.com/teuthology/neesingh-2022-12-06_04:42:06-fs-issue_54557-distro-default-smithi/7103825/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e76b600cf49b4e8cb92e8bef0988a6e3

    Test failure: test_backtrace_repair
    (tasks.cephfs.test_forward_scrub.TestForwardScrub)