2023-11-08T07:54:54.906 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-08T07:54:54.907 INFO:teuthology.results:seed: '5135' 2023-11-08T07:56:45.758 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-08T07:56:45.762 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-11-08T08:34:48.702 INFO:teuthology.results:Tests finished! gathering results... 2023-11-08T08:34:48.983 INFO:scrape:Found 6 jobs 2023-11-08T08:34:49.387 INFO:scrape:Found 1 distinct failure reasons 2023-11-08T08:34:49.388 INFO:scrape:Failure: Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-08T08:34:49.388 INFO:scrape:2 jobs: ['7451825', '7451824'] 2023-11-08T08:34:49.388 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'osd}', 'overrides/{ignorelist_health', 'tasks/forward-scrub}'] 2023-11-08T08:34:49.389 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/forward-scrub}'] 2023-11-08T08:34:49.389 INFO:scrape: 2023-11-08T08:34:49.390 INFO:teuthology.results:Sending results to neesingh@redhat.com: Test Run: neesingh-2023-11-08_07:51:45-fs-wip-neesingh-testing-54557-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/neesingh-2023-11-08_07:51:45-fs-wip-neesingh-testing-54557-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/neesingh-2023-11-08_07:51:45-fs-wip-neesingh-testing-54557-distro-default-smithi/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 4 Fail ================================================================= [7451824] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} ----------------------------------------------------------------- time: 00:18:41 info: https://pulpito.ceph.com/neesingh-2023-11-08_07:51:45-fs-wip-neesingh-testing-54557-distro-default-smithi/7451824/ log: http://qa-proxy.ceph.com/teuthology/neesingh-2023-11-08_07:51:45-fs-wip-neesingh-testing-54557-distro-default-smithi/7451824/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6ffcb431f28d44b3b00d0c6363878d22 Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) [7451825] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} ----------------------------------------------------------------- time: 00:18:57 info: https://pulpito.ceph.com/neesingh-2023-11-08_07:51:45-fs-wip-neesingh-testing-54557-distro-default-smithi/7451825/ log: http://qa-proxy.ceph.com/teuthology/neesingh-2023-11-08_07:51:45-fs-wip-neesingh-testing-54557-distro-default-smithi/7451825/ sentry: https://sentry.ceph.com/organizations/ceph/?query=285ff3871979442389b67eadd91839e3 Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Pass ================================================================= [7451823] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} time: 00:26:33 info: https://pulpito.ceph.com/neesingh-2023-11-08_07:51:45-fs-wip-neesingh-testing-54557-distro-default-smithi/7451823/ [7451826] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} time: 00:24:15 info: https://pulpito.ceph.com/neesingh-2023-11-08_07:51:45-fs-wip-neesingh-testing-54557-distro-default-smithi/7451826/ [7451827] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} time: 00:23:37 info: https://pulpito.ceph.com/neesingh-2023-11-08_07:51:45-fs-wip-neesingh-testing-54557-distro-default-smithi/7451827/ [7451828] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} time: 00:28:56 info: https://pulpito.ceph.com/neesingh-2023-11-08_07:51:45-fs-wip-neesingh-testing-54557-distro-default-smithi/7451828/