2023-05-18T04:06:19.997 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-18T04:06:19.998 INFO:teuthology.results:seed: '5870' 2023-05-18T04:07:01.611 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-18T04:07:01.615 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-05-18T04:42:04.020 INFO:teuthology.results:Tests finished! gathering results... 2023-05-18T04:42:04.259 INFO:scrape:Found 6 jobs 2023-05-18T04:42:04.582 INFO:scrape:Found 1 distinct failure reasons 2023-05-18T04:42:04.583 INFO:scrape:Failure: Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-05-18T04:42:04.583 INFO:scrape:3 jobs: ['7276963', '7276960', '7276965'] 2023-05-18T04:42:04.583 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'osd}', 'overrides/{ignorelist_health', 'tasks/forward-scrub}'] 2023-05-18T04:42:04.584 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'rhel_8}', 'tasks/forward-scrub}'] 2023-05-18T04:42:04.584 INFO:scrape: 2023-05-18T04:42:04.585 INFO:teuthology.results:Sending results to neesingh@redhat.com: Test Run: neesingh-2023-05-18_04:04:53-fs-wip-neesingh-testing-54557-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/neesingh-2023-05-18_04:04:53-fs-wip-neesingh-testing-54557-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/neesingh-2023-05-18_04:04:53-fs-wip-neesingh-testing-54557-distro-default-smithi/ failed: 3 dead: 0 running: 0 waiting: 0 queued: 0 passed: 3 Fail ================================================================= [7276960] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} ----------------------------------------------------------------- time: 00:21:55 info: http://pulpito.ceph.com/neesingh-2023-05-18_04:04:53-fs-wip-neesingh-testing-54557-distro-default-smithi/7276960/ log: http://qa-proxy.ceph.com/teuthology/neesingh-2023-05-18_04:04:53-fs-wip-neesingh-testing-54557-distro-default-smithi/7276960/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a3170058d3264ce39fa0cea730eb39e1 Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) [7276963] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} ----------------------------------------------------------------- time: 00:15:35 info: http://pulpito.ceph.com/neesingh-2023-05-18_04:04:53-fs-wip-neesingh-testing-54557-distro-default-smithi/7276963/ log: http://qa-proxy.ceph.com/teuthology/neesingh-2023-05-18_04:04:53-fs-wip-neesingh-testing-54557-distro-default-smithi/7276963/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9286d5f22e13442db579f55bb4c1f8ea Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) [7276965] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} ----------------------------------------------------------------- time: 00:16:43 info: http://pulpito.ceph.com/neesingh-2023-05-18_04:04:53-fs-wip-neesingh-testing-54557-distro-default-smithi/7276965/ log: http://qa-proxy.ceph.com/teuthology/neesingh-2023-05-18_04:04:53-fs-wip-neesingh-testing-54557-distro-default-smithi/7276965/ sentry: https://sentry.ceph.com/organizations/ceph/?query=08dc409c094447d3be2acbd27c419179 Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Pass ================================================================= [7276961] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} time: 00:21:52 info: http://pulpito.ceph.com/neesingh-2023-05-18_04:04:53-fs-wip-neesingh-testing-54557-distro-default-smithi/7276961/ [7276962] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} time: 00:24:29 info: http://pulpito.ceph.com/neesingh-2023-05-18_04:04:53-fs-wip-neesingh-testing-54557-distro-default-smithi/7276962/ [7276964] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} time: 00:23:07 info: http://pulpito.ceph.com/neesingh-2023-05-18_04:04:53-fs-wip-neesingh-testing-54557-distro-default-smithi/7276964/